Take Python, for example, from Pykafka to Kafka-Python to Confluent-Kafka to Flink
Note that it is best to use the latest versions of Pykafka and Kafka-Python for poor performance, as you can find out
Coufluent-Kafka is a Python module, which is a lightweight package for Librdkafka. Librdkafka is a C/C ++ based Kafka library. It is superior to Kafka-Python in use. Also support asynchronous, a round-robin events, so use in combination with torando there seems to be a problem, because a tornado is a single process, and GIL lock, we can see this: https://github.com/confluenti…
H :22:32: fatal error: librdkafka/rdkafka.h: : fatal error: librdkafka/rdkafka.h: : : Apt-get install librdkafka-dev-y: No such file or directory “apt-get install librdkafka-dev-y
In addition, it is better for Producer and Consumer to use the same module and version. Recently, when viewing the old project Kafka, the createTime displayed in the message is equal to -1
So it’s best to use Flink for projects