Overview
The Snowflake Connector for AWS Glue simplifies the process of connecting AWS Glue jobs to extract data from Snowflake, and also load data into Snowflake. This connector provides comprehensive access to Snowflake data, facilitating cloud ETL processes for operational reporting, backup and disaster recovery, data governance, and more.
Highlights
- * Connect to Snowflake from AWS Glue Jobs * Simplify data extracts from Snowflake * Simplify data loads to Snowflake
Details
Pricing
Vendor refund policy
This is a placeholder value. Please update this value via the AWS Marketplace Management Portal.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Glue 4.0
- Amazon ECS
- Amazon EKS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
Snowflake Connector for AWS Glue 2.11.1.
- This version is built with spark-snowflake 2.11.1.
- This version is compatible with AWS Glue 4.0.
- This version supports both read from and write to Snowflake
Additional details
Usage instructions
Please subscribe to the product from AWS Marketplace and Activate the Glue connector from AWS Glue Studio .
Pre-requisite
- An account in Snowflake
- Snowflake
- AWS Secrets Manager secret (you can create the secret in following steps)
Create a new secret for Snowflake in AWS Secrets Manager
We create a secret in AWS Secrets Manager to store the Snowflake account credentials.
- On the Secrets Manager console, choose Store a new secret.
- For Secret type, select Other type of secret.
- Enter your key as sfUrl and the value as your Snowflake hostname in the format <account_identifier>.snowflakecomputing.com.
- Enter your key as sfUser and the value as your Snowflake user name.
- Enter your key as sfPassword and the value as your Snowflake user password.
- Leave the rest of the options at their default.
- Choose Next.
- Give a name to the secret snowflake_credentials.
- Follow through the rest of the steps to store the secret.
Connection options
You can pass the following options to the connector.
- sfWarehouse(optional): The Snowflake virtual warehouse.
- sfDatabase(required): The Snowflake database.
- sfSchema(required): The Snowflake schema.
- query(optional, but you need to set this or dbtable): The name of the table to be read.
- dbtable(optional, but you need to set this or query): The exact query (SELECT statement) to run.
You can see other available options here: https://docs.snowflake.com/en/user-guide/spark-connector-use.html
Support
Vendor support
Please allow 24 hours
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
Customer reviews
Almost great, except can't call SPs
The connector works fine for SELECT queries, however, it is not clear whether calling stored procedures is supported. I tied a few different things but couldn't manage to make the call to a Snowflake stored procedure work.