AWS Glue 5.1 is now available in AWS European Sovereign Cloud Region

AWS Glue 5.1 has been launched in the AWS European Sovereign Cloud Region, extending its availability beyond commercial and AWS GovCloud (US) regions. The service remains a serverless, scalable data integration platform designed to simplify data discovery, preparation, movement, and integration across multiple sources. AWS Glue 5.1 introduces core engine upgrades to Apache Spark 3.5.6, Python 3.11, and Scala 2.12.18, which include performance and security improvements for data processing workflows.

The update enhances support for open table formats, including Apache Hudi 1.0.2, Apache Iceberg 1.10.0, and Delta Lake 3.3.2. A notable addition is support for Apache Iceberg format version 3.0, which introduces features such as default column values, deletion vectors for merge-on-read tables, multi-argument transforms, and row lineage tracking. These changes aim to improve data management and query efficiency within the service.

AWS Glue 5.1 also extends AWS Lake Formation fine-grained access control to write operations, including Data Manipulation Language (DML) and Data Definition Language (DDL) for Spark DataFrames and Spark SQL. Previously, this capability was restricted to read operations only. Additionally, full-table access control has been added for Apache Spark when working with Apache Hudi and Delta Lake tables, providing more comprehensive security options for data governance.

Users can begin utilizing AWS Glue 5.1 through AWS APIs, AWS CLI, AWS SDK, or AWS Glue Studio. The service is now accessible in the AWS European Sovereign Cloud Region, alongside all AWS commercial and AWS GovCloud (US) regions. Further details are available on the AWS Glue product page and in the official documentation.