Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Tutorial: reorder records based on timestamp #1022

Open
ybyzek opened this issue Jan 21, 2022 · 0 comments
Open

New Tutorial: reorder records based on timestamp #1022

ybyzek opened this issue Jan 21, 2022 · 0 comments
Labels
kstreams Kafka Streams Related use case A tutorial with an extended business use case

Comments

@ybyzek
Copy link
Contributor

ybyzek commented Jan 21, 2022

Issue described in ksqlDB : confluentinc/ksql#8440

Solutions described in Kafka streams : confluentinc/kafka-streams-examples#411

This GitHub issue is to track adding the KStreams solutions as a Kafka Tutorial

Additional notes:

you simply will have to decide how long to “wait” until you assume you’ve received “all” the messages within a given window, at which point you order them as desired. But there will always be the risk that if you wanted just one second longer - a message may arrive that was supposed to be processed first.

The only way to really fix this - is to fix it all the way up the chain to the source, so that all messages of a given key flow along the same path, and rely on TCP’s reordering.

if order is mission critical, then you either fix it all as above, or you wait so long that you know you’ve got all relevant messages…

@ybyzek ybyzek added kstreams Kafka Streams Related use case A tutorial with an extended business use case labels Jan 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kstreams Kafka Streams Related use case A tutorial with an extended business use case
Projects
None yet
Development

No branches or pull requests

1 participant