Improving throughput of serverless streaming workloads for Kafka | Amazon Web Services
Event-driven applications often need to process data in real-time. When you use AWS Lambda to process records from Apache Kafka topics, you frequently encounter two typical requirements: you need to p...
High-throughput, low-latency data streaming is now essential for real-time analytics and event-driven appsβbut scaling serverless consumers reliably is complex. AWS Lambdaβs integration with Apache Kafka, via Event Source Mappings (ESMs), just got a robust upgrade!
#ApacheKafka #Kafka #AmazonMSK
24.11.2025 18:31
π 3
π 0
π¬ 1
π 0
Amazon Kinesis Data Streams now supports up to 50 enhanced fan-out consumers - AWS
Discover more about what's new at AWS with Amazon Kinesis Data Streams now supports up to 50 enhanced fan-out consumers
Amazon Kinesis Data Streams now supports 50 enhanced fan-out consumers for On-demand Advantage streams!
Now you can attach more low-latency, high-throughput consumers to the same streamβunlocking parallel analytics, ML pipelines, and multi-team architectures.
21.11.2025 01:42
π 0
π 0
π¬ 0
π 0
Amazon MQ release notes - Amazon MQ
Learn about important changes to Amazon MQ and the Amazon MQ Developer Guide.
Amazon MQ now supports RabbitMQ 4.2 which introduces native support for the AMQP 1.0 protocol, a new Raft based metadata store, local shovels, and message priorities for quorum queues.
docs.aws.amazon.com/amazon-mq/la...
21.11.2025 01:38
π 2
π 0
π¬ 0
π 0
Amazon MSK Console now supports viewing Kafka topics with new public APIs - AWS
Discover more about what's new at AWS with Amazon MSK Console now supports viewing Kafka topics with new public APIs
Amazon Managed Streaming for Apache Kafka has just enhanced the MSK Console with the ability to view and manage Kafka topics directlyβno need to set up Kafka admin clients anymore. You can now browse, search, and inspect all topics in your MSK cluster effortlessly.
aws.amazon.com/about-aws/wh...
20.11.2025 01:20
π 0
π 0
π¬ 0
π 0
Amazon EventBridge now supports targeting SQS fair queues - AWS
Discover more about what's new at AWS with Amazon EventBridge now supports targeting SQS fair queues
Amazon EventBridge now supports Amazon #SQS Fair Queues, empowering architects to build truly equitable, multi-tenant event-driven apps that benefit from fair message distributionβnoisy neighbor impacts are a thing of the past.
aws.amazon.com/about-aws/wh...
19.11.2025 16:15
π 0
π 0
π¬ 0
π 0
Amazon Kinesis Data Streams announces new Fault Injection Service (FIS) actions for API errors - AWS
Discover more about what's new at AWS with Amazon Kinesis Data Streams announces new Fault Injection Service (FIS) actions for API errors
Amazon Kinesis Data Streams has launched new Fault Injection Service (FIS) actions to inject API errors, such as throttling, internal faults, service unavailable events, or expired iterator exceptions, directly into their workflows.
aws.amazon.com/about-aws/wh...
15.10.2025 19:16
π 0
π 0
π¬ 0
π 0
LinkedIn
This link will take you to a page thatβs not on LinkedIn
Amazon Managed Service for Apache Flink now supports Customer Managed Keys (CMKs), giving you enhanced control over your data security. You can leverage your own AWS Key Management Service (KMS) keys to manage encryption for your streaming applications.
lnkd.in/gMEBynSJ
20.08.2025 21:16
π 0
π 0
π¬ 0
π 0
Amazon SQS increases maximum message payload size to 1 MiB - AWS
Discover more about what's new at AWS with Amazon SQS increases maximum message payload size to 1 MiB
π Data Volumes Are GrowingβNow Amazon #SQS Message Sizes Are, Too! π
Amazon SQS now supports individual message payloads up to 1MiB. This is a fourfold increase from the previous 256KiB limit.
#AWS #AmazonSQS #Data #Messaging #EventDriven #Serverless
05.08.2025 16:43
π 1
π 0
π¬ 0
π 0
Optimize traffic costs of Amazon MSK consumers on Amazon EKS with rack awareness | Amazon Web Services
In this post, we walk you through a solution for implementing rack awareness in consumer applications that are dynamically deployed across multiple Availability Zones using Amazon EKS.
Just read the latest AWS Big Data blog post: βOptimize traffic costs of Amazon #MSK consumers on Amazon EKS with rack awareness.β If youβre running #ApacheKafka workloads in #Kubernetes, this is a must-read to cut costs without sacrificing resilience!
#ApacheKafka #DataStreaming
01.08.2025 16:50
π 1
π 0
π¬ 0
π 0
Amazon SNS launches additional message filtering operators - AWS
Discover more about what's new at AWS with Amazon SNS launches additional message filtering operators
#Amazon #SNS now introduces three powerful message filtering operators: wildcard matching, anything-but matching, and expanded case-insensitive matching. These enhancements make it even easier to route only the right messages to your subscribers and cut down unnecessary processing.
ο»Ώ#Messaging #AWS
01.08.2025 00:39
π 1
π 0
π¬ 0
π 0
Amazon SNS standard topics now support Amazon SQS fair queues - AWS
Discover more about what's new at AWS with Amazon SNS standard topics now support Amazon SQS fair queues
Amazon #SNS standard topics now support Amazon SQS fair queues, making it easier to manage message distribution in multi-tenant environments. By including message group IDs in messages sent to SNS topics, you can now activate fair queueing in all subscribed SQS standard queues.
#Queues #Messaging
01.08.2025 00:37
π 0
π 0
π¬ 0
π 0
LinkedIn
This link will take you to a page thatβs not on LinkedIn
Now you can streamline industrial hashtag#IoT analytics with Amazon Data Firehose and Amazon hashtag#S3 Tables with Apache Iceberg. This low-code architecture enables you to ingest, transform, and route data from edge devices to AWS using Greengrass.
#AWS #Iceberg #Firehose #Data
lnkd.in/ggPvKb2b
28.07.2025 14:56
π 1
π 0
π¬ 0
π 0
LinkedIn
This link will take you to a page thatβs not on LinkedIn
Yesterday, I shared that Amazon Simple Queue Service (hashtag#SQS) launched Fair Queues and today I want to dive deep into why it matters. lnkd.in/gs7V85WD
#Queues #Messaging #AWS
22.07.2025 18:26
π 1
π 0
π¬ 0
π 0
Best practices for Express brokers - Amazon Managed Streaming for Apache Kafka
Best practices for managing your Amazon MSK cluster when using Express brokers.
#Amazon Managed Streaming for Apache Kafka (Amazon #MSK) now supports up to 5x more partitions per Express Broker, improving price-performance by up to 50% for partition-bound workloads. With this launch, partition-bound workloads can be hosted on fewer brokers.
#ApacheKafka #AWS #Day1
21.07.2025 23:10
π 1
π 0
π¬ 0
π 0
Amazon SQS introduces fair queues for multi-tenant workloads - AWS
Discover more about what's new at AWS with Amazon SQS introduces fair queues for multi-tenant workloads
Today, Amazon SQS announced the launch of Fair Queuesβa powerful new feature tackling the βnoisy neighborβ problem in multi-tenant standard queues.
#AWS #SQS #Messaging #Queues
21.07.2025 22:47
π 1
π 0
π¬ 0
π 0
Amazon SQS expands IPv6 support to VPC endpoints in AWS commercial Regions - AWS
Discover more about what's new at AWS with Amazon SQS expands IPv6 support to VPC endpoints in AWS commercial Regions
Amazon Simple Queue Service (#SQS) now supports #IPv6 over #VPC endpoints across all AWS commercial regions, including those in China. This enhancement, delivered via #AWS #PrivateLink, means you can now make API requests to Amazon SQS using IPv6 within your VPC.
aws.amazon.com/about-aws/wh...
21.07.2025 14:43
π 2
π 0
π¬ 0
π 0
Amazon SNS expands IPv6 support to VPC endpoints in AWS commercial Regions - AWS
Discover more about what's new at AWS with Amazon SNS expands IPv6 support to VPC endpoints in AWS commercial Regions
Amazon Simple Notification Service (Amazon #SNS) now supports IPv6 connectivity through VPC endpoints via AWS PrivateLink across all AWS commercial regions! This major enhancement means you can make API requests to Amazon SNS over IPv6 from your VPCs.
#AWS #ipv6
aws.amazon.com/about-aws/wh...
21.07.2025 14:36
π 2
π 0
π¬ 0
π 0