Overview
MarkLogic customers now have an easy-to-use option to build and manage their Apache Spark based data pipelines using serverless, fully-managed AWS Glue service. The AWS Glue connector from MarkLogic enables customers to use Apache Spark for data ingestion and data transformation, and load the resulting data into MarkLogic. It also allows customers to read data from MarkLogic using Apache Spark.
The AWS Glue connector from MarkLogic enables customers to use Apache Spark for data ingestion and data transformation, and load the resulting data into MarkLogic Data Hub Service. It also helps the customers to read data from MarkLogic using Apache Spark.
Highlights
- High Performance Data Ingestion: Build rich and scalable Spark based data ingestion pipelines with readily-available connectors to diverse data sources for all data types.
- High Performance Data export: Build rich and scalable Spark based data export pipelines to read data from MarkLogic.
Details
Pricing
Vendor refund policy
No refunds
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
MarkLogic Connector for AWS Glue
- Amazon ECS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
Initial release of the MarkLogic connector for Apache Spark 3. The previous MarkLogic connector was designed for Apache Spark 2 and required use of the MarkLogic Data Hub Framework. This connector requires Apache Spark 3 and does not depend on the Data Hub Framework.
This release is compatible with AWS Glue 4.x
Additional details
Usage instructions
Please subscribe to the product from AWS Marketplace and Activate the Glue connector from AWS Glue Studio
Resources
Support
Vendor support
For support, Contact MarkLogic by creating a ticket at https://help.marklogic.com/ or sending an email to cloud-support@marklogic.com . Support is not included in hourly fee. Community-based support is available at http://developer.marklogic.com/qa . Free MarkLogic training is available here https://www.marklogic.com/learn/university/
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
