ZeroMQ explained

Developer:iMatix
Programming Language:C++
Platform:Cross-platform
Genre:Message queue, concurrency framework
License:MPL-2.0[1]

ZeroMQ (also spelled ØMQ, 0MQ or ZMQ) is an asynchronous messaging library, aimed at use in distributed or concurrent applications. It provides a message queue, but unlike message-oriented middleware, a ZeroMQ system can run without a dedicated message broker; the zero in the name is for zero broker.[2] The library's API is designed to resemble Berkeley sockets.

ZeroMQ is developed by a large community of contributors, founded by iMatix, which holds the domain name and trademarks. There are third-party bindings for many popular programming languages.

Technology

The ZeroMQ API provides sockets (a kind of generalization over the traditional IP and Unix domain sockets), each of which can represent a many-to-many connection between endpoints. Operating with a message-wise granularity, they require that a messaging pattern be used, and are particularly optimized for that kind of pattern.

The basic ZeroMQ patterns are:

Request–reply
  • Connects a set of clients to a set of services. This is a remote procedure call and task distribution pattern.
    Publish–subscribe
  • Connects a set of publishers to a set of subscribers. This is a data distribution pattern.
    Push–pull (pipeline)
  • Connects nodes in a fan-out / fan-in pattern that can have multiple steps, and loops. This is a parallel task distribution and collection pattern.
    Exclusive pair
  • Connects two sockets in an exclusive pair. (This is an advanced low-level pattern for specific use cases.)

    Each pattern defines a particular network topology. Request-reply defines a so-called "service bus", publish-subscribe defines a "data distribution tree", and push-pull defines "parallelised pipeline". All the patterns are deliberately designed in such a way as to be infinitely scalable and thus usable on Internet scale.[3]

    Any message through the socket is treated as an opaque blob of data. Delivery to a subscriber can be automatically filtered by the blob leading string. Available message transports include TCP, PGM (reliable multicast), inter-process communication (IPC) and inter-thread communication (ITC).

    The ZeroMQ core library performs very well due to its internal threading model, and can outperform conventional TCP applications in terms of throughput by utilizing an automatic message batching technique.[4] [5]

    ZeroMQ implements ZMTP, the ZeroMQ Message Transfer Protocol.[6] ZMTP defines rules for backward interoperability, extensible security mechanisms, command and message framing, connection metadata, and other transport-level functionality. A growing number of projects implement ZMTP directly as an alternative to using the full ZeroMQ implementations.[7]

    History

    iMatix CEO Pieter Hintjens registered the zeromq.org domain in May 2007 and started the ZeroMQ project together with Martin Sustrik, who was its architect and lead developer until December 2011.

    On March 30, 2010, Hintjens announced that iMatix (the original designer of Advanced Message Queuing Protocol) would leave the AMQP workgroup and did not plan to support AMQP/1.0 in favor of the significantly simpler and faster ZeroMQ.[8] [9]

    In 2011, CERN was investigating ways to unify middleware solutions used to operate CERN accelerators. The CERN study compared two open source implementations of CORBA, Ice, Thrift, ZeroMQ, YAMI4,[10] RTI, and Qpid (AMQP) and scored ZeroMQ highest, in part for its versatility, including its easy adaptability to the LynxOS.

    At the start of 2012, two of the original developers forked ZeroMQ as Crossroads I/O.[11] [12] Martin Sustrik has started nanomsg,[13] a rewrite of the ZeroMQ core library.[14]

    In August 2012, Dongmin Yu announced his pure Java conversion of ZeroMQ, JeroMQ.[15] This has inspired further full-native ports of ZeroMQ, such as NetMQ for C#[16] and zmq.rsfor Rust.[17]

    In March 2013, Pieter Hintjens announced a new draft of the ZMTP wire-level protocol bringing extensible security mechanisms to ZeroMQ.[18] Martin Hurton implemented the CurveZMQ authentication and encryption mechanism[19] in the core library shortly afterwards.

    In 2016, long-time ZeroMQ developer Garrett D'Amore forked Nanomsg to create project NNG (Nanomsg Next Generation).[20]

    Development process

    The ZeroMQ community mostly uses the Collective Code Construction Contract (C4)[21] as a development contract. C4 is inspired by Wikipedia processes and GitHub's fork + pull request model. It focuses on making it simpler for new contributors to participate and reducing dependency on older contributors.

    See also

    External links

    Notes and References

    1. Web site: ØMQ Licensing. 8 June 2023.
    2. Web site: Get started.
    3. Web site: Scalability Layer Hits the Internet Stack . 2013-09-04 . 2019-05-28 . https://web.archive.org/web/20190528130558/http://250bpm.com/hits . dead .
    4. Web site: How come ØMQ has higher throughput than TCP although it's built on top of TCP?. ZeroMQ FAQ. 8 June 2013.
    5. Web site: Middleware Trends And Market Leaders 2011. 8 June 2013.
    6. Web site: ZeroMQ Message Transfer Protocol. 8 June 2013.
    7. Web site: GitHub Search: ZMTP. GitHub. 8 June 2013.
    8. Web site: iMatix will end OpenAMQ support by 2011. openamq-dev maillist. 5 September 2018. https://web.archive.org/web/20160305155601/http://lists.openamq.org/pipermail/openamq-dev/2010-March/001598.html. 2016-03-05.
    9. Web site: What is wrong with AMQP (and how to fix it). iMatix Corporation. 14 July 2012.
    10. Web site: Inspirel YAMI4. 14 July 2012.
    11. Web site: ZeroMQ and Crossroads I/O: Forking over trademarks. LWN.net. 14 July 2012.
    12. Web site: Crossroads I/O. 14 July 2012.
    13. Web site: nanomsg. 8 June 2013.
    14. Web site: Why should I [sic] have written ZeroMQ in C, not C++].
    15. Web site: jeromq - java pojo zeromq. zeromq-dev mailing list. 23 May 2013. 31 July 2013. https://web.archive.org/web/20130731225620/http://lists.zeromq.org/pipermail/zeromq-dev/2012-August/018265.html. dead.
    16. Web site: NetMQ. GitHub. 23 May 2013.
    17. Web site: zmq.rs. GitHub. 24 Oct 2020.
    18. Web site: Securing ZeroMQ: draft ZMTP v3.0 Protocol. Hintjens.com. 23 May 2013.
    19. http://curvezmq.org curvezmq.org
    20. Web site: NNG: Nanomsg-NG. nanomsg.org. 4 Aug 2023.
    21. Web site: Collective Code Construction Contract (C4.1). ZeroMQ RFCs. 23 May 2013.