gevent-kafka is a client library for Apache Kafka, for the gevent framework.
You also need Kazoo installed.
The example below sends messages to the test topic:
from gevent_kafka import producer
p = producer.Producer(kazoo_client, 'test')
p.start()
while True:
p.send(["hello there on the other side"])
gevent.sleep(2)
A consumer group is created using consumer.Consumer. Using that,
you can subscribe to different topics:
from gevent_kafka import consumer
def callback(messages):
for message in messages:
print message
c = consumer.Consumer(framework, 'example-group')
c.start()
c.subscribe('test', 0.200).start(callback)
while True:
gevent.sleep(5)
There are a lot of things to do:
- Unit tests
- Battle tests
- Multi-fetch operations
Apache License 2.0
Written by Johan Rydberg johan.rydberg@gmail.com