Amazon Glue

AWS Glue is an event-driven, serverless computing platform provided by Amazon as a part of Amazon Web Services. It is a computing service that runs code in response to events and automatically manages the computing resources required by that code. It was introduced in August 2017.[1]

AWS Glue
Developer(s)Amazon.com
Initial releaseAugust 2017 (2017-08)
Operating systemCross-platform
Available inEnglish

The primary purpose of Glue, as compared to AWS's sister ETL platform AWS Lambda, is to scan other services in the same Virtual Private Cloud (or equivalent accessible network element even if not provided by AWS), particularly S3. The jobs are billed according to compute time, with a minimum count of 1 minute.[2] Glue discovers the source data to store associated meta-data (e.g. the table's schema of field names, types lengths) in the AWS Glue Data Catalog (which is then accessible via AWS console or APIs).[3]

Languages supported

Scala and Python are officially supported as of 2020.[4]

Catalog interrogation via API

The catalog can be read in AWS console (via browser) and via API divided into topics including:[5]

  • Database API
  • Table API
  • Partition API
  • Connection API
  • User-Defined Function API
  • Importing an Athena Catalog to AWS Glue

See also

References
  1. "AWS Services List". ParkMyCloud. Retrieved October 6, 2020.
  2. "AWS Glue version 2.0 featuring 10x faster job start times and 1-minute minimum billing duration". AWS. August 10, 2020. Retrieved October 6, 2020.
  3. "AWS Glue API Documentation". AWS. Retrieved October 6, 2020.
  4. "AWS Glue Now Supports Scala in Addition to Python". AWS. January 12, 2018. Retrieved October 6, 2020.
  5. "Catalog API". AWS. Retrieved October 8, 2020.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.