I ran my application on AWS machine having 32GB ram. This application is
written in Java using Kafka-Streaming low level api. When I ran it for 72
hours or more and load (messages) are keep on pumping to kafka-topic then
entire memory i.e. 32 GB of aws machine gets exhausted. While I ran my java
application with -xms4gb and -xmx12gb. As per Kafka-Streaming memory
management, RocksDB uses off-heap space which might be causing this issue.
Can you please help me to resolve this problem.
Deepak Pengoria 's gravatar image asked Feb 17 2017 at 05:30 in Incubator-Kafka-Users by Deepak Pengoria

1 Answers

Hi Deepak,
Could you tell us a bit more on what your app is doing (e.g., aggregates, or joins)? Also which version of Kafka are you using?
Have you changed any default configs?
Eno Thereska 's gravatar image answered Feb 17 2017 at 07:16 by Eno Thereska

Related Discussions