Amazon MSK Express brokers now delivers Apache Kafka data to Amazon S3

Amazon Web Services announced that Amazon MSK Express brokers can now deliver Apache Kafka data directly to Amazon S3 general purpose buckets without requiring customers to manage separate connector fleets. The feature automates scaling, retries, and backpressure handling, ensuring reliable data delivery for mission-critical workloads while reducing operational overhead. Customers can use this capability for log archival, compliance retention, Kafka replay, and AI/ML model training without incurring the complexity of self-managed connectors. The announcement eliminates the need to provision additional broker egress throughput, lowering infrastructure costs by scaling delivery to actual workload demand rather than peak requirements.

The new capability supports throughput of up to 10 GB/s for data delivery to Amazon S3, with routine operations such as capacity scaling and version upgrades managed automatically. This removes the burden of coordinating across teams to deploy and maintain connector plugins, secure approvals, and apply security updates across fleets. By integrating delivery directly into MSK Express, AWS simplifies pipeline management while maintaining end-to-end reliability for high-throughput workloads. The feature is designed to handle the operational challenges that typically arise as Kafka workloads scale.

Amazon MSK data delivery to Amazon S3 is available today in every AWS Region where Amazon MSK Express brokers are offered, with no additional infrastructure costs for scaling delivery capacity. Customers can achieve reliable, high-throughput data delivery to S3 without the incremental expenses associated with connector-based pipelines. The feature aligns with common use cases such as log archival, compliance retention, and AI/ML model training, where large volumes of Kafka data must be stored and processed efficiently. AWS emphasizes the reduction in ingestion and delivery costs compared to self-managed alternatives.

For pricing details, customers are directed to the AWS pricing page, while technical documentation is available in the Amazon MSK Developer Guide and Amazon MSK AI skills. The announcement underscores AWS’s focus on simplifying data pipeline management for Kafka workloads by integrating delivery capabilities directly into MSK Express brokers. This reduces both operational complexity and infrastructure costs while ensuring scalable, reliable data delivery to Amazon S3.