asyncio (PEP 3156) support for ZeroMQ.
The difference between aiozmq and vanilla pyzmq (zmq.asyncio).
zmq.asyncio works only by replacement event loop with custom one. This approach works but have two disadvantages:
zmq.asyncio.ZMQEventLoopcannot be combined with other loop implementations (most notable is ultra fastuvloop).It uses internal ZMQ Poller which has fast ZMQ Sockets support but doesn't intended to work fast with many (thousands) regular TCP sockets.
In practice it means that
zmq.asynciois not recommended to be used with web servers likeaiohttp.See also zeromq/pyzmq#894
See http://aiozmq.readthedocs.org
Simple high-level client-server RPC example:
import asyncio
import aiozmq.rpc
class ServerHandler(aiozmq.rpc.AttrHandler):
@aiozmq.rpc.method
def remote_func(self, a:int, b:int) -> int:
return a + b
@asyncio.coroutine
def go():
server = yield from aiozmq.rpc.serve_rpc(
ServerHandler(), bind='tcp://127.0.0.1:5555')
client = yield from aiozmq.rpc.connect_rpc(
connect='tcp://127.0.0.1:5555')
ret = yield from client.call.remote_func(1, 2)
assert 3 == ret
server.close()
client.close()
asyncio.get_event_loop().run_until_complete(go())Low-level request-reply example:
import asyncio
import aiozmq
import zmq
@asyncio.coroutine
def go():
router = yield from aiozmq.create_zmq_stream(
zmq.ROUTER,
bind='tcp://127.0.0.1:*')
addr = list(router.transport.bindings())[0]
dealer = yield from aiozmq.create_zmq_stream(
zmq.DEALER,
connect=addr)
for i in range(10):
msg = (b'data', b'ask', str(i).encode('utf-8'))
dealer.write(msg)
data = yield from router.read()
router.write(data)
answer = yield from dealer.read()
print(answer)
dealer.close()
router.close()
asyncio.get_event_loop().run_until_complete(go())zmq.asyncio provides a asyncio compatible loop implementation.
But it's based on zmq.Poller which doesn't work well with massive non-zmq sockets usage.
E.g. if you build a web server for handling at least thousands of parallel web requests (1000-5000) pyzmq internal Poller will be slow.
aiozmq works with epoll natively, it doesn't need custom loop implementation and cooperates pretty weel with uvloop for example.
For details see zeromq/pyzmq#894
aiozmq is offered under the BSD license.