Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Because Kafka message expiry has only two policies, as far as I could tell: time or space.

You can use log compaction to remove all messages apart from the latest for any given key. This gives you a Kafka queue with a bounded size, that is proportional to the table size that you're replicating.

https://kafka.apache.org/documentation/#compaction



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: