kafka配置参考
删除pv
kubectl patch pv kafka -p '{"metadata":{"finalizers":null}}' persistentvolume/kafka patched
压测脚本
进入kafka容器中
/opt/kafka/bin/kafka-producer-perf-test.sh --topic demo1 --num-records 100000000 --record-size 100 --throughput 4000000 --producer-props bootstrap.servers=kafka1:9091,kafka2:9092,kafka3:9093
/opt/kafka/bin/kafka-producer-perf-test.sh --topic demo1 --num-records 100000000 --record-size 20 --throughput 4000000 --producer-props bootstrap.servers=kafka1:9091,kafka2:9092,kafka3:9093
ES吞吐量
配置 32C64G SSD 每条日志 1KB
kafka 写入峰值 472118.6 records/sec (450.25 MB/sec)
ES 写入峰值 10W/秒