Kafka Issues
Does Apache kafka works efficiently. Sometimes it duplicates the data. Please share your experiences if you guys worked on Kafka.
I thought of handling kafka duplicate issues using KSQL. Not explored much.. But i think it cna be achieved
HI Karan, Kafka is just a Queue, it will take data and give data in an ordered queue, by default or prioritized. The logics for duplicacy avoidance need to be applied at app end only. You can also use Kafka tools provided by LinkedIn itself, https://github.com/linkedin/kafka-tools
Sign in to reply to this thread