Kinesis enhanced fanout latency issue. #3115
Unanswered
sohaib-rasool
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am using AWS SDK for C++ to develop a consumer for Kinesis Data Streams with enhanced fanout enabled. I'm utilizing
SubscribeToShard()
to receive data, and I've set an event handler usingSetEventStreamHandler()
. Additionally, I've built a custom record producer.What I’ve noticed is that records are delivered to the event handler in batches. It appears the SDK waits until either a certain number of records have been received or a specific time threshold has passed before pushing the batch to the handler. For instance, when the producer sends a single record (a simple JSON with two string fields), it takes about 150 seconds to be processed by the event stream handler on the consumer side.
Furthermore, reviewing the AWS logs, I see that the
SubscribeToShard
request is being sent over HTTP/1.1, even though the documentation indicates it should be using HTTP/2.SDK Version: 1.11.389
CURL: 7.81 with HTTP/2 enabled.
Beta Was this translation helpful? Give feedback.
All reactions