Please subscribe to the product from AWS Marketplace and Activate the Glue connector from AWS Glue Studio .

Pre-requisite

• An account for Azure Blob Storage
• AWS Secrets Manager secret

Create a new secret for Azure Blob Storage in AWS Secrets Manager

We create a secret in AWS Secrets Manager to store the Azure Blob Storage credentials.

1. Please prepare the Azure Blob Storage connection info including container, account name and account Key in advance. Follow the instructions to manage account keys:https://docs.microsoft.com/en-us/azure/storage/common/storage-configure-connection-string?toc=/azure/storage/blobs/toc.json#configure-a-connection-string-for-azurite 
2. On the Secrets Manager console, choose Store a new secret.
3. For Secret type, select Other type of secret.
4. Enter your key as accountName, accountKey, container and the value respectively, for example,"devstoreaccount1", "Eby8vdM02xNOcqFlqUwJ***", "containername".
5. Leave the rest of the options at their default.
6. Choose Next.
7. Give a name to the secret azureblobstorage_credentials.
8. Follow through the rest of the steps to store the secret.

Create a custom connection

Select the created Secret name, azureblobstorage_credentials, in connection edit page. Then save it.

Create a Glue job and set connection options

Create a Glue Job and specify details:

1. Create a job of data source or target from this connector, select custom connection. Then input options and values.
2. File format connection options, we support 5 different formats, csv/parquet/json/orc/text. The basic options are path, the Azure Blob storage URI, e.g. /loadingtest-input/10g. fileFormat, input or output file format, e.g. csv/parquet/json/orc/text
3. For each format, there are different connection options supported. CSV: Option name, header, delimiter, compression, Option Value corresponding,true/false, any delimiter char, none/uncompressed/snappy/gzip/lzo/lz4/brotli/zstd, default value is false, , none. PARQUET, ORC, TEXT and JSON: Option name, compression, Option Value, none/uncompressed/snappy/gzip/lzo/lz4/brotli/zstd, default value is none.
4. Remember to set the Glue version to be Glue 4.0 on job detail tab.