Listing Thumbnail

    Snowflake Connector for AWS Glue

     Info
    Easily connect to Snowflake from AWS Glue
    Listing Thumbnail

    Snowflake Connector for AWS Glue

     Info

    Overview

    The Snowflake Connector for AWS Glue simplifies the process of connecting AWS Glue jobs to extract data from Snowflake, and also load data into Snowflake. This connector provides comprehensive access to Snowflake data, facilitating cloud ETL processes for operational reporting, backup and disaster recovery, data governance, and more.

    Highlights

    • * Connect to Snowflake from AWS Glue Jobs * Simplify data extracts from Snowflake * Simplify data loads to Snowflake

    Details

    Delivery method

    Delivery option
    Glue 4.0
    Glue 3.0
    Glue 1.0/2.0

    Latest version

    Operating system
    Linux

    Pricing

    Snowflake Connector for AWS Glue

     Info
    This product is free. Subscriptions have no end date and can be canceled anytime.

    Vendor refund policy

    This is a placeholder value. Please update this value via the AWS Marketplace Management Portal.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Glue 4.0

    Supported services: Learn more 
    • Amazon ECS
    • Amazon EKS
    Container image

    Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.

    Version release notes

    Snowflake Connector for AWS Glue 2.11.1.

    • This version is built with spark-snowflake  2.11.1.
    • This version is compatible with AWS Glue 4.0.
    • This version supports both read from and write to Snowflake

    Additional details

    Usage instructions

    Please subscribe to the product from AWS Marketplace and Activate the Glue connector from AWS Glue Studio .

    Pre-requisite

    • An account in Snowflake
    • Snowflake
    • AWS Secrets Manager secret (you can create the secret in following steps)

    Create a new secret for Snowflake in AWS Secrets Manager

    We create a secret in AWS Secrets Manager to store the Snowflake account credentials.

    1. On the Secrets Manager console, choose Store a new secret.
    2. For Secret type, select Other type of secret.
    3. Enter your key as sfUrl and the value as your Snowflake hostname in the format <account_identifier>.snowflakecomputing.com.
    4. Enter your key as sfUser and the value as your Snowflake user name.
    5. Enter your key as sfPassword and the value as your Snowflake user password.
    6. Leave the rest of the options at their default.
    7. Choose Next.
    8. Give a name to the secret snowflake_credentials.
    9. Follow through the rest of the steps to store the secret.

    Connection options

    You can pass the following options to the connector.

    • sfWarehouse(optional): The Snowflake virtual warehouse.
    • sfDatabase(required): The Snowflake database.
    • sfSchema(required): The Snowflake schema.
    • query(optional, but you need to set this or dbtable): The name of the table to be read.
    • dbtable(optional, but you need to set this or query): The exact query (SELECT statement) to run.

    You can see other available options here: https://docs.snowflake.com/en/user-guide/spark-connector-use.html 

    Support

    Vendor support

    Please allow 24 hours

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    4
    1 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    100%
    0%
    0%
    0%
    1 AWS reviews
    annoyed glue/snowflake user

    Almost great, except can't call SPs

    Reviewed on Sep 03, 2023
    Purchase verified by AWS

    The connector works fine for SELECT queries, however, it is not clear whether calling stored procedures is supported. I tied a few different things but couldn't manage to make the call to a Snowflake stored procedure work.

    View all reviews