Karan Arora
from Chandigarh |
Does Apache kafka works efficiently. Sometimes it duplicates the data. Please share your experiences if you guys worked on Kafka.
Kafka Issues
The IndiBlogger forum is now a read-only archive. Every public discussion is still here to read, but new topics and replies are closed.
Replies 1 to 2 of 2
Karan Arora
from Chandigarh |
I thought of handling kafka duplicate issues using KSQL. Not explored much.. But i think it cna be achieved
BALVINDER SINGH
from Hisar |
HI Karan, Kafka is just a Queue, it will take data and give data in an ordered queue, by default or prioritized. The logics for duplicacy avoidance need to be applied at app end only. You can also use Kafka tools provided by LinkedIn itself, https://github.com/linkedin/kafka-tools