Trending

#AmazonMSK

Latest posts tagged with #AmazonMSK on Bluesky

Latest Top
Trending

Posts tagged #AmazonMSK

Preview
Amazon MSK announces support for Standard brokers Graviton-3 instance in Africa (Cape Town) region You can now create provisioned Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters with Standard brokers running on AWS Graviton3-based M7g instances in Africa (Cape Town) region. Graviton M7g instances for Standard brokers deliver up to 24% compute cost savings and up to 29% higher write and read throughput over comparable MSK clusters running on M5 instances. To get started, create a new cluster with M7g brokers or upgrade your M5 cluster to M7g through the Amazon MSK console or the Amazon CLI and read our Amazon MSK Developer Guide for more information.

🆕 Amazon MSK now supports Graviton-3 M7g instances in Africa (Cape Town), offering up to 24% cost savings and 29% higher throughput. Create or upgrade clusters via the MSK console or CLI; see the Amazon MSK Developer Guide for details.

#AWS #AmazonMsk

0 0 0 0
Amazon MSK announces support for Standard brokers Graviton-3 instance in Africa (Cape Town) region You can now create provisioned https://aws.amazon.com/msk/ clusters with Standard brokers running on AWS Graviton3-based M7g instances in Africa (Cape Town) region. Graviton M7g instances for Standard brokers deliver up to 24% compute cost savings and up to 29% higher write and read throughput over comparable MSK clusters running on M5 instances. To get started, create a new cluster with M7g brokers or upgrade your M5 cluster to M7g through the Amazon MSK console or the Amazon CLI and read our https://docs.aws.amazon.com/msk/latest/developerguide/what-is-msk.html for more information.

Amazon MSK announces support for Standard brokers Graviton-3 instance in Africa (Cape Town) region

You can now create provisioned https://aws.amazon.com/msk/ clusters with Standard brokers running on AWS Graviton3-based M7g instances in Africa (Cape Town) region.

Gravit...

#AWS #AmazonMsk

0 0 0 0
Amazon MSK Serverless expands to three new AWS regions You can now connect your Apache Kafka applications to https://aws.amazon.com/msk/features/msk-serverless/ in the Africa (Cape Town), Asia Pacific (Taipei), and Canada West (Calgary) https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/. Amazon MSK is a fully managed service that makes it easier for you to build and run applications that use Apache Kafka as a data store. Amazon MSK Serverless is a cluster type for Amazon MSK that allows you to run Apache Kafka without having to manage and scale cluster capacity. MSK Serverless automatically provisions and scales compute and storage resources, so you can use Apache Kafka on demand. With these launches, Amazon MSK Serverless is now generally available in Africa (Cape Town), Asia Pacific (Mumbai), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Taipei), Asia Pacific (Tokyo), Asia Pacific (Seoul), Canada (Central), Canada West (Calgary), Europe (Frankfurt), Europe (Ireland), Europe (Stockholm), Europe (Paris), Europe (London), South America (Sao Paulo), US East (N. Virginia), US East (Ohio), and US West (Oregon) AWS regions. To learn more and get started, see our https://docs.aws.amazon.com/msk/latest/developerguide/serverless.html.

Amazon MSK Serverless expands to three new AWS regions

You can now connect your Apache Kafka applications to https://aws.amazon.com/msk/features/msk-serverless/ in the Africa (Cape Town), Asia Pacific (Taipei), and Canada West (Calgary) https://aws.amazon.com/about-aws/global-

#AWS #AmazonMsk

0 0 0 0
Preview
Amazon MSK now supports dual-stack (IPv4 and IPv6) connectivity for existing clusters Amazon Managed Streaming for Apache Kafka (Amazon MSK) now supports dual-stack connectivity (IPv4 and IPv6) for existing MSK Provisioned and MSK Serverless clusters. This capability enables customers to connect to Amazon MSK using both IPv4 and IPv6 protocols, in addition to the existing IPv4-only option. It helps customers modernize applications for IPv6 environments while maintaining IPv4 compatibility, making it easier to meet compliance requirements and prepare for future network architectures. Amazon MSK is a fully managed service for Apache Kafka that makes it easier for customers to build and run applications that use Apache Kafka as a data store. Previously, MSK Provisioned and Serverless clusters exclusively utilized IPv4 addressing for all connectivity options. With this new capability, customers can now enable dual-stack connectivity (IPv4 and IPv6) on existing MSK clusters using Amazon MSK Console, AWS CLI, SDK, or CloudFormation by modifying the Network Type parameter for a cluster from IPv4 to dual-stack. Upon successful update, MSK provisions IPv6-enabled network interfaces while maintaining existing IPv4 connectivity, ensuring uninterrupted service. To retrieve new IPv6 bootstrap broker strings for MSK Provisioned clusters, customers can use the GetBootstrapBrokers API to obtain the necessary connection information. All MSK Provisioned and Serverless clusters will retain IPv4-only connectivity unless explicitly updated. Dual-stack connectivity for existing MSK Provisioned and Serverless clusters is now available in all AWS Regions where Amazon MSK is available, at no additional cost. To learn more about Amazon MSK dual-stack support, refer to the Amazon MSK developer guide.

🆕 Amazon MSK now supports dual-stack (IPv4/IPv6) for existing clusters, allowing both protocols for connectivity. This aids in modernizing apps for IPv6 while maintaining IPv4 compatibility, helping meet compliance and future network needs, at no extra cost.

#AWS #AwsGovcloudUs #AmazonMsk

0 0 0 0
Amazon MSK now supports dual-stack (IPv4 and IPv6) connectivity for existing clusters Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/) now supports dual-stack connectivity (IPv4 and IPv6) for existing MSK Provisioned and MSK Serverless clusters. This capability enables customers to connect to Amazon MSK using both IPv4 and IPv6 protocols, in addition to the existing IPv4-only option. It helps customers modernize applications for IPv6 environments while maintaining IPv4 compatibility, making it easier to meet compliance requirements and prepare for future network architectures. Amazon MSK is a fully managed service for Apache Kafka that makes it easier for customers to build and run applications that use Apache Kafka as a data store. Previously, MSK Provisioned and Serverless clusters exclusively utilized IPv4 addressing for all connectivity options. With this new capability, customers can now enable dual-stack connectivity (IPv4 and IPv6) on existing MSK clusters using Amazon MSK Console, AWS CLI, SDK, or CloudFormation by modifying the Network Type parameter for a cluster from IPv4 to dual-stack. Upon successful update, MSK provisions IPv6-enabled network interfaces while maintaining existing IPv4 connectivity, ensuring uninterrupted service. To retrieve new IPv6 bootstrap broker strings for MSK Provisioned clusters, customers can use the GetBootstrapBrokers API to obtain the necessary connection information. All MSK Provisioned and Serverless clusters will retain IPv4-only connectivity unless explicitly updated. Dual-stack connectivity for existing MSK Provisioned and Serverless clusters is now available in all https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/ where Amazon MSK is available, at no additional cost. To learn more about Amazon MSK dual-stack support, refer to the https://docs.aws.amazon.com/msk/latest/developerguide/what-is-msk.html. 

Amazon MSK now supports dual-stack (IPv4 and IPv6) connectivity for existing clusters

Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/ now supports dual-stack connectivity (IPv4 and IPv6) for existing MSK Provisioned and MSK Serverless clu...

#AWS #AwsGovcloudUs #AmazonMsk

0 0 0 0
Preview
MSK simplifies Kafka topic management with new APIs and console integration Amazon Managed Streaming for Apache Kafka (Amazon MSK) now offers three new APIs (CreateTopic, UpdateTopic, and DeleteTopic), making it easier to manage your Kafka topics for your MSK provisioned clusters without the need to set up and maintain Kafka admin clients. You can programmatically create, update, and delete Kafka topics using your familiar interfaces including AWS CLI, AWS SDKs, and AWS CloudFormation. With these APIs, you can define topic properties such as replication factor and partition count, along with configuration settings like retention and cleanup policies. The new APIs together with the ListTopics and DescribeTopic APIs are integrated into the Amazon MSK console, bringing all topic operstions to one place. You can now create or update topics with just a few clicks using guided defaults while gaining comprehensive visibility into topic configurations, partition-level information, and metrics. These MSK topic management capabilities are available at no additional cost for all Amazon MSK provisioned clusters using Kafka version 3.6 and above across AWS regions where Amazon MSK is offered. To start using these features, you'll need to set up the appropriate IAM permissions. To learn more on how to get started, see the Amazon MSK Developer Guide.

🆕 Amazon MSK now offers three new APIs for easier Kafka topic management, integrated into the console. Create, update, and delete topics via AWS CLI, SDKs, and CloudFormation. Manage properties and settings with no additional cost for Kafka 3.6+ clusters.

#AWS #AmazonMsk

0 0 0 0
MSK simplifies Kafka topic management with new APIs and console integration Amazon Managed Streaming for Apache Kafka (Amazon MSK) now offers three new APIs (CreateTopic, UpdateTopic, and DeleteTopic), making it easier to manage your Kafka topics for your MSK provisioned clusters without the need to set up and maintain Kafka admin clients. You can programmatically create, update, and delete Kafka topics using your familiar interfaces including AWS CLI, AWS SDKs, and AWS CloudFormation. With these APIs, you can define topic properties such as replication factor and partition count, along with configuration settings like retention and cleanup policies. The new APIs together with the ListTopics and DescribeTopic APIs are integrated into the Amazon MSK console, bringing all topic operstions to one place. You can now create or update topics with just a few clicks using guided defaults while gaining comprehensive visibility into topic configurations, partition-level information, and metrics. These MSK topic management capabilities are available at no additional cost for all Amazon MSK provisioned clusters using Kafka version 3.6 and above across https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/ where Amazon MSK is offered. To start using these features, you'll need to set up the appropriate IAM permissions. To learn more on how to get started, see the https://docs.aws.amazon.com/msk/latest/developerguide/getting-started.html.

MSK simplifies Kafka topic management with new APIs and console integration

Amazon Managed Streaming for Apache Kafka (Amazon MSK) now offers three new APIs (CreateTopic, UpdateTopic, and DeleteTopic), making it easier to manage your Kafka topics for your MSK provisioned clust...

#AWS #AmazonMsk

0 0 0 0
Amazon MSK now supports broker logs on Express Brokers https://aws.amazon.com/msk/ now supports broker logs for https://aws.amazon.com/msk/features/express-brokers-for-amazon-msk/ at no additional cost. With access to broker logs, you can troubleshoot client connectivity and availability issues and get insights into broker behavior during rebalances or fail-overs. You can also easily integrate Kafka operational telemetry into existing observability pipelines using pre-built integrations with Amazon CloudWatch Logs and Amazon S3. Broker Logs are available for both new and existing Express brokers . You can enable them from the Amazon MSK Console or AWS CLI. To learn how to setup broker log delivery, see the https://docs.aws.amazon.com/msk/latest/developerguide/msk-logging.html. MSK Express brokers are designed to deliver up to three times more throughput per broker, scale up to 20 times faster, and reduce recovery time by 90 percent compared to Standard brokers running Apache Kafka. Express broker logs are supported in all https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/ where express brokers are available. With Amazon MSK, you spend more time innovating on applications and less time managing clusters. Visit the https://docs.aws.amazon.com/msk/latest/developerguide/what-is-msk.html to get started. 

Amazon MSK now supports broker logs on Express Brokers

https://aws.amazon.com/msk/ now supports broker logs for aws.amazon.com/msk/features/express-bro... at no additional cost. With access to broker logs, you can troubleshoot client con...

#AWS #AmazonMsk #AwsGovcloudUs

0 0 0 0
Amazon MSK Replicator is now available in Asia Pacific (New Zealand) You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/) clusters in Asia Pacific (New Zealand) Region. MSK Replicator is a feature of Amazon MSK that enables you to reliably replicate data across Amazon MSK clusters in different or the same AWS Region(s) in a few clicks. With MSK Replicator, you can easily build regionally resilient streaming applications for increased availability and business continuity. MSK Replicator provides automatic asynchronous replication across MSK clusters, eliminating the need to write custom code, manage infrastructure, or setup cross-region networking. MSK Replicator automatically scales the underlying resources so that you can replicate data on-demand without having to monitor or scale capacity. MSK Replicator also replicates the necessary Kafka metadata including topic configurations, Access Control Lists (ACLs), and consumer group offsets. If an unexpected event occurs in a region, you can failover to the other AWS Region and seamlessly resume processing. You can get started with MSK Replicator from the Amazon MSK console or the Amazon CLI. With this launch, MSK Replicator is now available in thirty six AWS Regions. To learn more, visit the MSK Replicator https://docs.aws.amazon.com/msk/latest/developerguide/msk-replicator.html, https://aws.amazon.com/msk/features/msk-replicator/, and https://aws.amazon.com/msk/pricing/.

Amazon MSK Replicator is now available in Asia Pacific (New Zealand)

You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/ clusters in Asia Pacific (New Zealand) Region.

MSK Replica...

#AWS #AmazonMsk

0 0 0 0
Preview
Amazon MSK Replicator is now available in Asia Pacific (New Zealand) You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters in Asia Pacific (New Zealand) Region. MSK Replicator is a feature of Amazon MSK that enables you to reliably replicate data across Amazon MSK clusters in different or the same AWS Region(s) in a few clicks. With MSK Replicator, you can easily build regionally resilient streaming applications for increased availability and business continuity. MSK Replicator provides automatic asynchronous replication across MSK clusters, eliminating the need to write custom code, manage infrastructure, or setup cross-region networking. MSK Replicator automatically scales the underlying resources so that you can replicate data on-demand without having to monitor or scale capacity. MSK Replicator also replicates the necessary Kafka metadata including topic configurations, Access Control Lists (ACLs), and consumer group offsets. If an unexpected event occurs in a region, you can failover to the other AWS Region and seamlessly resume processing. You can get started with MSK Replicator from the Amazon MSK console or the Amazon CLI. With this launch, MSK Replicator is now available in thirty six AWS Regions. To learn more, visit the MSK Replicator documentation, product page, and pricing page.

🆕 Amazon MSK Replicator now available in Asia Pacific (New Zealand) to replicate streaming data across Amazon MSK clusters, offering automatic replication, scaling, and failover for resilient applications in 36 AWS Regions.

#AWS #AmazonMsk

0 0 0 0
Amazon MSK Connect is now available in three additional AWS Regions Amazon MSK Connect is now available in three additional AWS Regions: Asia Pacific (New Zealand), AWS GovCloud (US-East), and AWS GovCloud (US-West). MSK Connect enables you to run fully managed Kafka Connect clusters with Amazon Managed Streaming for Apache Kafka (Amazon MSK). With a few clicks, MSK Connect allows you to easily deploy, monitor, and scale connectors that move data in and out of Apache Kafka and Amazon MSK clusters from external systems such as databases, file systems, and search indices. MSK Connect eliminates the need to provision and maintain cluster infrastructure. Connectors scale automatically in response to increases in usage and you pay only for the resources you use. With full compatibility with Kafka Connect, it is easy to migrate workloads without code changes. MSK Connect will support both Amazon MSK-managed and self-managed Apache Kafka clusters. You can get started with MSK Connect from the Amazon MSK console or the Amazon CLI. With this launch, MSK Connect is now available in thirty eight AWS Regions. To get started visit, the MSK Connect https://aws.amazon.com/msk/features/msk-connect/, https://aws.amazon.com/msk/pricing/, and the https://docs.aws.amazon.com/msk/latest/developerguide/msk-connect.html.

Amazon MSK Connect is now available in three additional AWS Regions

Amazon MSK Connect is now available in three additional AWS Regions: Asia Pacific (New Zealand), AWS GovCloud (US-East), and AWS GovCloud (US-West).

MSK Connect enables you to run fully managed Kafka Conn...

#AWS #AmazonMsk

0 0 0 0
Preview
Amazon MSK Connect is now available in three additional AWS Regions Amazon MSK Connect is now available in three additional AWS Regions: Asia Pacific (New Zealand), AWS GovCloud (US-East), and AWS GovCloud (US-West). MSK Connect enables you to run fully managed Kafka Connect clusters with Amazon Managed Streaming for Apache Kafka (Amazon MSK). With a few clicks, MSK Connect allows you to easily deploy, monitor, and scale connectors that move data in and out of Apache Kafka and Amazon MSK clusters from external systems such as databases, file systems, and search indices. MSK Connect eliminates the need to provision and maintain cluster infrastructure. Connectors scale automatically in response to increases in usage and you pay only for the resources you use. With full compatibility with Kafka Connect, it is easy to migrate workloads without code changes. MSK Connect will support both Amazon MSK-managed and self-managed Apache Kafka clusters. You can get started with MSK Connect from the Amazon MSK console or the Amazon CLI. With this launch, MSK Connect is now available in thirty eight AWS Regions. To get started visit, the MSK Connect product page, pricing page, and the Amazon MSK Developer Guide.

🆕 Amazon MSK Connect now available in Asia Pacific (New Zealand) and AWS GovCloud (US-East, US-West), enabling managed Kafka Connect clusters for easy data movement between Apache Kafka and external systems. Available in 38 regions.

#AWS #AmazonMsk

0 0 0 0
Amazon MSK expands Standard Brokers and Express Brokers to Asia Pacific (New Zealand) Region Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/) is now available in Asia Pacific (New Zealand) region. Customers can create Amazon MSK Provisioned clusters in this region starting today. Amazon MSK is a fully managed service for Apache Kafka and Kafka Connect that makes it easier for you to build and run applications that use Apache Kafka as a data store. Amazon MSK is fully compatible with Apache Kafka, which enables you to more quickly migrate your existing Apache Kafka workloads to Amazon MSK with confidence or build new ones from scratch. With Amazon MSK, you spend more time building innovative streaming applications and less time managing Kafka clusters. Amazon MSK offers two types of Apache Kafka provisioned broker - Standard brokers and Express brokers. Standard brokers offer the most flexibility to configure your cluster’s performance. You can configure availability, durability, throughput, and latency. You also control the storage configurations on your cluster and are responsible for managing storage provisioning and utilization. Express brokers are a new broker type for Amazon MSK Provisioned designed to deliver up to 3x more throughput per broker, scale up to 20x faster, up to 5x more partitions per broker, and reduce recovery time by 90% as compared to Standard brokers. Express brokers come pre-configured with Kafka best practices by default, support all Kafka APIs, and provide the same low-latency performance that Amazon MSK customers expect, so they can continue using existing client applications without any changes. You can now create an MSK provisioned cluster with Standard or Express brokers in Asia Pacific (New Zealand) Region through the Amazon MSK console or the Amazon CLI. To get started, see the https://docs.aws.amazon.com/msk/latest/developerguide/what-is-msk.html.

Amazon MSK expands Standard Brokers and Express Brokers to Asia Pacific (New Zealand) Region

Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/ is now available in Asia Pacific (New Zealand) region. Customers can create Amazon MSK Provisioned clusters in t...

#AWS #AmazonMsk

0 0 0 0
Preview
Amazon MSK expands Standard Brokers and Express Brokers to Asia Pacific (New Zealand) Region Amazon Managed Streaming for Apache Kafka (Amazon MSK) is now available in Asia Pacific (New Zealand) region. Customers can create Amazon MSK Provisioned clusters in this region starting today. Amazon MSK is a fully managed service for Apache Kafka and Kafka Connect that makes it easier for you to build and run applications that use Apache Kafka as a data store. Amazon MSK is fully compatible with Apache Kafka, which enables you to more quickly migrate your existing Apache Kafka workloads to Amazon MSK with confidence or build new ones from scratch. With Amazon MSK, you spend more time building innovative streaming applications and less time managing Kafka clusters. Amazon MSK offers two types of Apache Kafka provisioned broker - Standard brokers and Express brokers. Standard brokers offer the most flexibility to configure your cluster’s performance. You can configure availability, durability, throughput, and latency. You also control the storage configurations on your cluster and are responsible for managing storage provisioning and utilization. Express brokers are a new broker type for Amazon MSK Provisioned designed to deliver up to 3x more throughput per broker, scale up to 20x faster, up to 5x more partitions per broker, and reduce recovery time by 90% as compared to Standard brokers. Express brokers come pre-configured with Kafka best practices by default, support all Kafka APIs, and provide the same low-latency performance that Amazon MSK customers expect, so they can continue using existing client applications without any changes. You can now create an MSK provisioned cluster with Standard or Express brokers in Asia Pacific (New Zealand) Region through the Amazon MSK console or the Amazon CLI. To get started, see the Amazon MSK Developer Guide.

🆕 Amazon MSK now supports Standard and Express brokers in the Asia Pacific (New Zealand) region, offering flexible performance and up to 3x more throughput per broker for faster scaling and reduced recovery time. Create provisioned clusters via the Amazon MSK console or CLI.

#AWS #AmazonMsk

1 0 0 0
Amazon MSK introduces KRaft support for Express Brokers with Apache Kafka v3.9 Amazon Managed Streaming for Apache Kafka (MSK) now supports Apache Kafka version 3.9 for Express Brokers. This release introduces support for KRaft (Kafka Raft), Apache Kafka's new consensus protocol that eliminates the dependency on Apache ZooKeeper for metadata management. KRaft shifts metadata management in Kafka clusters from external Apache ZooKeeper nodes to a group of controllers within Kafka. This change allows metadata to be stored and replicated as topics within Kafka brokers, resulting in faster propagation of metadata. New Express Broker clusters created using Kafka v3.9 will automatically use KRaft as the metadata management mode, giving you the benefits of this modern architecture from the start. The ability to upgrade existing clusters to v3.9 will be available in a future release. Amazon MSK Express Brokers with Kafka v3.9 are available in all AWS regions where MSK Express is supported. To get started, create a new Express Broker cluster and select Kafka version 3.9 in the AWS Management Console or via the AWS CLI or AWS SDKs.

Amazon MSK introduces KRaft support for Express Brokers with Apache Kafka v3.9

Amazon Managed Streaming for Apache Kafka (MSK) now supports Apache Kafka version 3.9 for Express Brokers. This release introduces support for KRaft (Kafka Raft), Apache Kafka's new consensus protoc...

#AWS #AmazonMsk

0 0 0 0
Amazon MSK Connect now supports dual-stack (IPv4 and IPv6) connectivity for new connectors Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/) now supports dual-stack connectivity (IPv4 and IPv6) for new connectors on Amazon MSK Connect. This capability enables customers to create connectors on MSK Connect using both IPv4 and IPv6 protocols, in addition to the existing IPv4-only option. It helps customers modernize applications for IPv6 environments while maintaining IPv4 compatibility, making it easier to meet compliance requirements and prepare for future network architectures. Amazon MSK Connect is a fully managed service that allows you to deploy and operate Apache Kafka Connect connectors in a fully managed environment. Previously, connectors on MSK Connect only supported IPv4 addressing for all connectivity options. With this new capability, customers can now enable dual-stack connectivity (IPv4 and IPv6) on new connectors using the Amazon MSK Console, AWS CLI, SDK, or CloudFormation by setting the Network Type parameter during connector creation. All connectors on MSK Connect will by default use IPv4-only connectivity unless explicitly opted-in for dual-stack while creating new connectors. Existing connectors will continue using IPv4 connectivity. To change that you will need to delete and recreate the connector. Dual-stack connectivity for new connectors on MSK Connect is now available in all https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/ where Amazon MSK Connect is available, at no additional cost. To learn more about Amazon MSK dual-stack support, refer to the https://docs.aws.amazon.com/msk/latest/developerguide/msk-connect.html.

Amazon MSK Connect now supports dual-stack (IPv4 and IPv6) connectivity for new connectors

Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/ now supports dual-stack connectivity (IPv4 and IPv6) for new connectors on Amazon MSK Connect. This capability ena...

#AWS #AmazonMsk

0 0 0 0
Preview
Amazon MSK introduces KRaft support for Express Brokers with Apache Kafka v3.9 Amazon Managed Streaming for Apache Kafka (MSK) now supports Apache Kafka version 3.9 for Express Brokers. This release introduces support for KRaft (Kafka Raft), Apache Kafka's new consensus protocol that eliminates the dependency on Apache ZooKeeper for metadata management. KRaft shifts metadata management in Kafka clusters from external Apache ZooKeeper nodes to a group of controllers within Kafka. This change allows metadata to be stored and replicated as topics within Kafka brokers, resulting in faster propagation of metadata. New Express Broker clusters created using Kafka v3.9 will automatically use KRaft as the metadata management mode, giving you the benefits of this modern architecture from the start. The ability to upgrade existing clusters to v3.9 will be available in a future release. Amazon MSK Express Brokers with Kafka v3.9 are available in all AWS regions where MSK Express is supported. To get started, create a new Express Broker cluster and select Kafka version 3.9 in the AWS Management Console or via the AWS CLI or AWS SDKs.

🆕 Amazon MSK now supports Kafka v3.9 for Express Brokers, introducing KRaft for metadata management without ZooKeeper. New clusters use KRaft by default, offering faster metadata propagation. Available in all MSK Express regions.

#AWS #AmazonMsk

0 0 0 0
Preview
Amazon MSK Connect now supports dual-stack (IPv4 and IPv6) connectivity for new connectors Amazon Managed Streaming for Apache Kafka (Amazon MSK) now supports dual-stack connectivity (IPv4 and IPv6) for new connectors on Amazon MSK Connect. This capability enables customers to create connectors on MSK Connect using both IPv4 and IPv6 protocols, in addition to the existing IPv4-only option. It helps customers modernize applications for IPv6 environments while maintaining IPv4 compatibility, making it easier to meet compliance requirements and prepare for future network architectures. Amazon MSK Connect is a fully managed service that allows you to deploy and operate Apache Kafka Connect connectors in a fully managed environment. Previously, connectors on MSK Connect only supported IPv4 addressing for all connectivity options. With this new capability, customers can now enable dual-stack connectivity (IPv4 and IPv6) on new connectors using the Amazon MSK Console, AWS CLI, SDK, or CloudFormation by setting the Network Type parameter during connector creation. All connectors on MSK Connect will by default use IPv4-only connectivity unless explicitly opted-in for dual-stack while creating new connectors. Existing connectors will continue using IPv4 connectivity. To change that you will need to delete and recreate the connector. Dual-stack connectivity for new connectors on MSK Connect is now available in all AWS Regions where Amazon MSK Connect is available, at no additional cost. To learn more about Amazon MSK dual-stack support, refer to the Amazon MSK developer guide.

🆕 Amazon MSK Connect now supports dual-stack (IPv4/IPv6) connectivity for new connectors, allowing customers to modernize applications for IPv6 while maintaining IPv4 compatibility, at no extra cost.

#AWS #AmazonMsk

0 0 0 0
Amazon MSK Replicator is now available in ten additional AWS Regions You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/) clusters in ten additional AWS Regions: Middle East (Bahrain), Middle East (UAE), Asia Pacific (Jakarta), Asia Pacific (Hong Kong), Asia Pacific (Osaka), Asia Pacific (Melbourne), Africa (Cape Town), Europe (Milan), Europe (Zurich) and Israel (Tel Aviv). MSK Replicator is a feature of Amazon MSK that enables you to reliably replicate data across Amazon MSK clusters in different or the same AWS Region(s) in a few clicks. With MSK Replicator, you can easily build regionally resilient streaming applications for increased availability and business continuity. MSK Replicator provides automatic asynchronous replication across MSK clusters, eliminating the need to write custom code, manage infrastructure, or setup cross-region networking. MSK Replicator automatically scales the underlying resources so that you can replicate data on-demand without having to monitor or scale capacity. MSK Replicator also replicates the necessary Kafka metadata including topic configurations, Access Control Lists (ACLs), and consumer group offsets. If an unexpected event occurs in a region, you can failover to the other AWS Region and seamlessly resume processing. You can get started with MSK Replicator from the Amazon MSK console or the Amazon CLI. With this launch, MSK Replicator is now available in thirty five AWS Regions. To learn more, visit the MSK Replicator https://docs.aws.amazon.com/msk/latest/developerguide/msk-replicator.html, https://aws.amazon.com/msk/features/msk-replicator/, and https://aws.amazon.com/msk/pricing/.

Amazon MSK Replicator is now available in ten additional AWS Regions

You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/ clusters in ten additional AWS Regions: Middle East (Bahrain), ...

#AWS #AmazonMsk

0 0 0 0
Preview
Amazon MSK Replicator is now available in ten additional AWS Regions You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters in ten additional AWS Regions: Middle East (Bahrain), Middle East (UAE), Asia Pacific (Jakarta), Asia Pacific (Hong Kong), Asia Pacific (Osaka), Asia Pacific (Melbourne), Africa (Cape Town), Europe (Milan), Europe (Zurich) and Israel (Tel Aviv). MSK Replicator is a feature of Amazon MSK that enables you to reliably replicate data across Amazon MSK clusters in different or the same AWS Region(s) in a few clicks. With MSK Replicator, you can easily build regionally resilient streaming applications for increased availability and business continuity. MSK Replicator provides automatic asynchronous replication across MSK clusters, eliminating the need to write custom code, manage infrastructure, or setup cross-region networking. MSK Replicator automatically scales the underlying resources so that you can replicate data on-demand without having to monitor or scale capacity. MSK Replicator also replicates the necessary Kafka metadata including topic configurations, Access Control Lists (ACLs), and consumer group offsets. If an unexpected event occurs in a region, you can failover to the other AWS Region and seamlessly resume processing. You can get started with MSK Replicator from the Amazon MSK console or the Amazon CLI. With this launch, MSK Replicator is now available in thirty five AWS Regions. To learn more, visit the MSK Replicator documentation, product page, and pricing page.

🆕 Amazon MSK Replicator is now available in ten more regions: Bahrain, UAE, Jakarta, Hong Kong, Osaka, Melbourne, Cape Town, Milan, Zurich, Tel Aviv. It replicates data across Amazon MSK clusters for resilient streaming apps, scaling automatically and managing failover. Available …

#AWS #AmazonMsk

0 0 0 0
AWS Lambda announces enhanced error handling capabilities for Kafka event processing AWS Lambda launches enhanced error handling capabilities for Amazon Managed Streaming for Apache Kafka (MSK) and self-managed Apache Kafka (SMK) event sources. These capabilities allow customers to build custom retry configurations, optimize retries of failed messages, and send failed events to a Kafka topic as an on-failure destination, enabling customers to build resilient Kafka workloads with robust error handling strategies. Customers use Kafka event source mappings (ESM) with their Lambda functions to build their mission-critical Kafka applications. Kafka ESM offers robust error handling of failed events by retrying events with exponential backoff, and retaining failed events in on-failure destinations like Amazon SQS, Amazon S3, Amazon SNS. However, customers need customized error handling to meet stringent business and performance requirements. With this launch, developers can now exercise precise control over failed event processing and leverage Kafka topics as an additional on-failure destination when using Provisioned mode for Kafka ESM. Customers can now define specific retry limits and time boundaries for retry, automatically discarding failed records beyond these limits to customer-specified destination. They can now also set automatic retries of failed records in the batch and enhance their function code to report individual failed messages, optimizing the retry process. This feature is available in all https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/ where AWS Lambda’s Provisioned mode for Kafka ESM is available. To enable these capabilities, provide configuration parameters for your Kafka ESM in the ESM API, AWS Console, and AWS CLI. To learn more, read the https://docs.aws.amazon.com/lambda/latest/dg/with-kafka-esm.html and https://aws.amazon.com/lambda/pricing/. 

AWS Lambda announces enhanced error handling capabilities for Kafka event processing

AWS Lambda launches enhanced error handling capabilities for Amazon Managed Streaming for Apache Kafka (MSK) and self-managed Apache Kafka (SMK) event sources. These capabilities al...

#AWS #AwsLambda #AmazonMsk

1 0 0 0
Preview
AWS Lambda announces enhanced error handling capabilities for Kafka event processing AWS Lambda launches enhanced error handling capabilities for Amazon Managed Streaming for Apache Kafka (MSK) and self-managed Apache Kafka (SMK) event sources. These capabilities allow customers to build custom retry configurations, optimize retries of failed messages, and send failed events to a Kafka topic as an on-failure destination, enabling customers to build resilient Kafka workloads with robust error handling strategies. Customers use Kafka event source mappings (ESM) with their Lambda functions to build their mission-critical Kafka applications. Kafka ESM offers robust error handling of failed events by retrying events with exponential backoff, and retaining failed events in on-failure destinations like Amazon SQS, Amazon S3, Amazon SNS. However, customers need customized error handling to meet stringent business and performance requirements. With this launch, developers can now exercise precise control over failed event processing and leverage Kafka topics as an additional on-failure destination when using Provisioned mode for Kafka ESM. Customers can now define specific retry limits and time boundaries for retry, automatically discarding failed records beyond these limits to customer-specified destination. They can now also set automatic retries of failed records in the batch and enhance their function code to report individual failed messages, optimizing the retry process. This feature is available in all AWS Commercial Regions where AWS Lambda’s Provisioned mode for Kafka ESM is available. To enable these capabilities, provide configuration parameters for your Kafka ESM in the ESM API, AWS Console, and AWS CLI. To learn more, read the Lambda ESM documentation and AWS Lambda pricing.

🆕 AWS Lambda enhances error handling for Kafka event processing, allowing custom retry, failed event destinations, and precise control over retries in Provisioned mode, available in all commercial regions. Configure via API, console, or CLI.

#AWS #AwsLambda #AmazonMsk

1 0 0 0
Preview
Improving throughput of serverless streaming workloads for Kafka | Amazon Web Services Event-driven applications often need to process data in real-time. When you use AWS Lambda to process records from Apache Kafka topics, you frequently encounter two typical requirements: you need to p...

High-throughput, low-latency data streaming is now essential for real-time analytics and event-driven apps—but scaling serverless consumers reliably is complex. AWS Lambda’s integration with Apache Kafka, via Event Source Mappings (ESMs), just got a robust upgrade!

#ApacheKafka #Kafka #AmazonMSK

3 0 1 0
Amazon MSK Replicator is now available in five additional AWS Regions You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/) clusters in five additional AWS Regions: Asia Pacific (Thailand), Mexico (Central), Asia Pacific (Taipei), Canada West (Calgary), Europe (Spain). MSK Replicator is a feature of Amazon MSK that enables you to reliably replicate data across Amazon MSK clusters in different or the same AWS Region(s) in a few clicks. With MSK Replicator, you can easily build regionally resilient streaming applications for increased availability and business continuity. MSK Replicator provides automatic asynchronous replication across MSK clusters, eliminating the need to write custom code, manage infrastructure, or setup cross-region networking. MSK Replicator automatically scales the underlying resources so that you can replicate data on-demand without having to monitor or scale capacity. MSK Replicator also replicates the necessary Kafka metadata including topic configurations, Access Control Lists (ACLs), and consumer group offsets. If an unexpected event occurs in a region, you can failover to the other AWS Region and seamlessly resume processing. You can get started with MSK Replicator from the Amazon MSK console or the Amazon CLI. To learn more, visit the MSK Replicator https://aws.amazon.com/msk/features/msk-replicator/, https://aws.amazon.com/msk/pricing/, and https://docs.aws.amazon.com/msk/latest/developerguide/msk-replicator.html.

Amazon MSK Replicator is now available in five additional AWS Regions

You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/ clusters in five additional AWS Regions: Asia Pacific (Thailan...

#AWS #AmazonMsk

1 0 0 0
Preview
Amazon MSK Replicator is now available in five additional AWS Regions You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters in five additional AWS Regions: Asia Pacific (Thailand), Mexico (Central), Asia Pacific (Taipei), Canada West (Calgary), Europe (Spain). MSK Replicator is a feature of Amazon MSK that enables you to reliably replicate data across Amazon MSK clusters in different or the same AWS Region(s) in a few clicks. With MSK Replicator, you can easily build regionally resilient streaming applications for increased availability and business continuity. MSK Replicator provides automatic asynchronous replication across MSK clusters, eliminating the need to write custom code, manage infrastructure, or setup cross-region networking. MSK Replicator automatically scales the underlying resources so that you can replicate data on-demand without having to monitor or scale capacity. MSK Replicator also replicates the necessary Kafka metadata including topic configurations, Access Control Lists (ACLs), and consumer group offsets. If an unexpected event occurs in a region, you can failover to the other AWS Region and seamlessly resume processing. You can get started with MSK Replicator from the Amazon MSK console or the Amazon CLI. To learn more, visit the MSK Replicator product page, pricing page, and documentation.

🆕 Amazon MSK Replicator now available in five regions: Asia Pacific (Thailand), Mexico (Central), Asia Pacific (Taipei), Canada West (Calgary), Europe (Spain). It replicates data across Amazon MSK clusters, scaling on-demand, and supports failover for business continuity.

#AWS #AmazonMsk

0 0 0 0
Amazon MSK Serverless expands availability to South America (São Paulo) region You can now connect your Apache Kafka applications to https://aws.amazon.com/msk/features/msk-serverless/ in the South America (São Paulo) https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/. Amazon MSK is a fully managed service for Apache Kafka and Kafka Connect that makes it easier for you to build and run applications that use Apache Kafka as a data store. Amazon MSK Serverless is a cluster type for Amazon MSK that allows you to run Apache Kafka without having to manage and scale cluster capacity. MSK Serverless automatically provisions and scales compute and storage resources, so you can use Apache Kafka on demand. With these launches, Amazon MSK Serverless is now generally available in Asia Pacific (Sydney), Asia Pacific (Singapore), Asia Pacific (Mumbai), Asia Pacific (Tokyo), Asia Pacific (Seoul), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (Stockholm), Europe (Paris), Europe (London), South America (São Paulo), US East (N. Virginia), US East (Ohio), and US West (Oregon) AWS regions. To learn more and get started, see our https://aws.amazon.com/msk/features/msk-serverless/.

Amazon MSK Serverless expands availability to South America (São Paulo) region

You can now connect your Apache Kafka applications to https://aws.amazon.com/msk/features/msk-serverless/ in the South America (São Paulo) aws.amazon.com/about-aws/global-infrast...

#AWS #AmazonMsk

1 0 0 0
Preview
Amazon MSK Serverless expands availability to South America (São Paulo) region You can now connect your Apache Kafka applications to Amazon MSK Serverless in the South America (São Paulo) AWS Regions. Amazon MSK is a fully managed service for Apache Kafka and Kafka Connect that makes it easier for you to build and run applications that use Apache Kafka as a data store. Amazon MSK Serverless is a cluster type for Amazon MSK that allows you to run Apache Kafka without having to manage and scale cluster capacity. MSK Serverless automatically provisions and scales compute and storage resources, so you can use Apache Kafka on demand. With these launches, Amazon MSK Serverless is now generally available in Asia Pacific (Sydney), Asia Pacific (Singapore), Asia Pacific (Mumbai), Asia Pacific (Tokyo), Asia Pacific (Seoul), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (Stockholm), Europe (Paris), Europe (London), South America (São Paulo), US East (N. Virginia), US East (Ohio), and US West (Oregon) AWS regions. To learn more and get started, see our developer guide.

🆕 Amazon MSK Serverless now available in South America (São Paulo); fully managed Apache Kafka service lets you run Kafka without managing clusters, scaling resources automatically. Now available in 13 AWS regions.

#AWS #AmazonMsk

0 0 0 0
Amazon MSK Console now supports viewing Kafka topics with new public APIs Amazon Managed Streaming for Apache Kafka (Amazon MSK) now supports viewing topics directly through the Amazon MSK console, making it easier to inspect all your Kafka topics without setting up Kafka admin clients. You can browse and search topics within a cluster, quickly review replication settings and partition counts, and drill into individual topics to examine detailed configuration, partition-level information, and metrics. These console capabilities are powered by three new MSK APIs, ListTopics, DescribeTopic, and DescribeTopicPartitions that you can also use directly for programmatic access. The ListTopics API returns the list of all topics in a cluster, while the DescribeTopic and DescribeTopicPartitions APIs provide detailed configuration and partition information for a topic. All three APIs are available through the AWS CLI and AWS SDKs. These MSK topic viewing capabilities are available for all Amazon MSK Provisioned clusters using Kafka version 3.6 and above across https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/ where Amazon MSK is offered. To start using these features, you'll need to set up the appropriate IAM permissions. To learn more on how to get started, see the https://docs.aws.amazon.com/msk/latest/developerguide/getting-started.html.

Amazon MSK Console now supports viewing Kafka topics with new public APIs

Amazon Managed Streaming for Apache Kafka (Amazon MSK) now supports viewing topics directly through the Amazon MSK console, making it easier to inspect all your Kafka topics without settin...

#AWS #AmazonMsk #AwsGovcloudUs

1 0 0 0
Amazon MSK Replicator is now available in two additional AWS Regions You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/) clusters in Asia Pacific (Hyderabad) and Asia Pacific (Malaysia) https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/s. MSK Replicator is a feature of Amazon MSK that enables you to reliably replicate data across Amazon MSK clusters in different or the same AWS Region(s) in a few clicks. With MSK Replicator, you can easily build regionally resilient streaming applications for increased availability and business continuity. MSK Replicator provides automatic asynchronous replication across MSK clusters, eliminating the need to write custom code, manage infrastructure, or setup cross-region networking. MSK Replicator automatically scales the underlying resources so that you can replicate data on-demand without having to monitor or scale capacity. MSK Replicator also replicates the necessary Kafka metadata including topic configurations, Access Control Lists (ACLs), and consumer group offsets. If an unexpected event occurs in a region, you can failover to the other AWS Region and seamlessly resume processing. With this launch, MSK Replicator is now available in the following AWS Regions: US East (N. Virginia), US East (Ohio), US West (N. California), US West (Oregon), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Paris), Europe (Stockholm), South America (Sao Paulo), China (Beijing), China (Ningxia), Asia Pacific (Hyderabad), and Asia Pacific (Malaysia). You can get started with MSK Replicator from the Amazon MSK console or the Amazon CLI. To learn more, visit the MSK Replicator https://aws.amazon.com/msk/features/msk-replicator/, https://aws.amazon.com/msk/pricing/, and https://docs.aws.amazon.com/msk/latest/developerguide/msk-replicator.html.

Amazon MSK Replicator is now available in two additional AWS Regions

You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (https://aws.amazon.com/msk/ clusters in Asia Pacific (Hyderabad) and Asia Pacific (Malaysia...

#AWS #AmazonMsk

1 0 0 0
Preview
Amazon MSK Replicator is now available in two additional AWS Regions You can now use Amazon MSK Replicator to replicate streaming data across Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters in Asia Pacific (Hyderabad) and Asia Pacific (Malaysia) Regions. MSK Replicator is a feature of Amazon MSK that enables you to reliably replicate data across Amazon MSK clusters in different or the same AWS Region(s) in a few clicks. With MSK Replicator, you can easily build regionally resilient streaming applications for increased availability and business continuity. MSK Replicator provides automatic asynchronous replication across MSK clusters, eliminating the need to write custom code, manage infrastructure, or setup cross-region networking. MSK Replicator automatically scales the underlying resources so that you can replicate data on-demand without having to monitor or scale capacity. MSK Replicator also replicates the necessary Kafka metadata including topic configurations, Access Control Lists (ACLs), and consumer group offsets. If an unexpected event occurs in a region, you can failover to the other AWS Region and seamlessly resume processing. With this launch, MSK Replicator is now available in the following AWS Regions: US East (N. Virginia), US East (Ohio), US West (N. California), US West (Oregon), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Paris), Europe (Stockholm), South America (Sao Paulo), China (Beijing), China (Ningxia), Asia Pacific (Hyderabad), and Asia Pacific (Malaysia). You can get started with MSK Replicator from the Amazon MSK console or the Amazon CLI. To learn more, visit the MSK Replicator product page, pricing page, and documentation.

🆕 Amazon MSK Replicator now available in Asia Pacific (Hyderabad) and Malaysia for reliable, automatic data replication across Amazon MSK clusters, enhancing regional resilience and failover capabilities.

#AWS #AmazonMsk

1 0 0 0