Amazon MSK Connect now supports updating connector plugins and worker configurations
Amazon MSK Connect enables in-place updates to connector plugins and worker configurations, eliminating the need to recreate connectors and reducing operational risk.
Amazon MSK Connect now supports updating the custom plugin and worker configuration of existing connectors without deletion. This allows users to upgrade connector code versions or adjust worker settings such as converters and throughput tuning. The service is designed for deploying, monitoring, and scaling Apache Kafka Connect connectors with Amazon MSK. Previously, such updates required deleting and recreating connectors, which introduced operational overhead and risk.
The new capability enables in-place updates, preserving connector offsets so tasks resume processing from their last committed position. This maintains continuity and reduces downtime during configuration changes. The feature is available across all AWS Regions where Amazon MSK Connect is supported. Users can apply updates directly through the service interface or API.
Updating a connector’s plugin involves replacing the existing custom plugin with a new version, such as one with updated dependencies. Worker configuration updates allow changes to settings like key and value converters or producer and consumer properties. Both types of updates are now supported without disrupting ongoing operations. The service handles the update process automatically, ensuring minimal manual intervention.
This update removes the previous requirement to delete and recreate connectors for configuration changes, streamlining maintenance workflows. The capability is provided at no additional cost and integrates with existing Amazon MSK Connect workflows. For detailed guidance, users can refer to the Amazon MSK Connect developer guide. The feature enhances operational flexibility for managing Kafka connectors.