Myrinet Explained

Myrinet, ANSI/VITA 26-1998, is a high-speed local area networking system designed by the company Myricom to be used as an interconnect between multiple machines to form computer clusters.

Description

Myrinet was promoted as having lower protocol overhead than standards such as Ethernet, and therefore better throughput, less interference, and lower latency while using the host CPU. Although it can be used as a traditional networking system, Myrinet is often used directly by programs that "know" about it, thereby bypassing a call into the operating system.

Myrinet physically consists of two fibre optic cables, upstream and downstream, connected to the host computers with a single connector. Machines are connected via low-overhead routers and switches, as opposed to connecting one machine directly to another. Myrinet includes a number of fault-tolerance features, mostly backed by the switches. These include flow control, error control, and "heartbeat" monitoring on every link. The "fourth-generation" Myrinet, called Myri-10G, supported a 10 Gbit/s data rate and can use 10 Gigabit Ethernet on PHY, the physical layer (cables, connectors, distances, signaling). Myri-10G started shipping at the end of 2005.

Myrinet was approved in 1998 by the American National Standards Institute for use on the VMEbus as ANSI/VITA 26-1998.[1] One of the earliest publications on Myrinet is a 1995 IEEE article.[2]

Performance

Generation!Year[3] !Bandwidth!Notes
1Myrinet19940.64 Gbit/sPECL PHY
2Myrinet-LAN19961.28 Gbit/sBackwards compatible with original Myrinet.
LVDS PHY for 1.28 Gbit/s operation.[4]
Myrinet-SANSystem-Area Network, shorter reach (3m) but lower cost[5]
3Myrinet-200020002 Gbit/sBackwards-compatible with Gigabit Ethernet
4Myri-10G200510 Gbit/sBackwards-compatible with 10 Gigabit Ethernet
Myrinet is a lightweight protocol with little overhead that allows it to operate with throughput close to the basic signaling speed of the physical layer. For supercomputing, the low latency of Myrinet is even more important than its throughput performance, since, according to Amdahl's law, a high-performance parallel system tends to be bottlenecked by its slowest sequential process, which in all but the most embarrassingly parallel supercomputer workloads is often the latency of message transmission across the network.

Deployment

According to Myricom, 141 (28.2%) of the June 2005 TOP500 supercomputers used Myrinet technology. In the November 2005 TOP500, the number of supercomputers using Myrinet was down to 101 computers, or 20.2%, in November 2006, 79 (15.8%), and by November 2007, 18 (3.6%), a long way behind gigabit Ethernet at 54% and InfiniBand at 24.2%.

In the June 2014 TOP500 list, the number of supercomputers using Myrinet interconnect was 1 (0.2%).[6] [7]

In November, 2013, the assets of Myricom (including the Myrinet technology) were acquired by CSP Inc.[8] In 2016, it was reported that Google had also offered to buy the company.[9]

See also

External links

Notes and References

  1. Book: American National Standard for Myrinet-on-VME Protocol Specification . November 2, 1998 . VMEbus International Trade Association . 1-885731-15-9 . September 1, 2016 . November 11, 2014 . https://web.archive.org/web/20141111221726/https://ph-dep-ese.web.cern.ch/ph-dep-ese/crates/standards/Av26.pdf . live .
  2. 10.1109/40.342015. Myrinet: A gigabit-per-second local area network. 1995. Boden. N.J.. Cohen. D.. Felderman. R.E.. Kulawik. A.E.. Seitz. C.L.. Seizovic. J.N.. Wen-King Su. IEEE Micro. 15. 29–36.
  3. Book: Encyclopedia of Parallel Computing . IEEE . 2011 . 978-0-387-09765-7 . Padua . David . 1239-1247 . 10.1007/978-0-387-09766-4.
  4. Web site: 1997-01-17 . M2M-M2F description . 2023-11-11 . https://web.archive.org/web/19970117054039/http://www.myri.com/myrinet/linkdev/m2m-m2f.html . 1997-01-17 .
  5. Web site: 1997-01-17 . Myrinet - A Brief, Technical Overview . 2023-11-11 . https://web.archive.org/web/19970117053706/http://www.myri.com/myrinet/overview.html . 1997-01-17 .
  6. Web site: List Statistics . 2014-01-13 . 2018-07-18 . https://web.archive.org/web/20180718013118/https://www.top500.org/statistics/list/ . live .
  7. Web site: Deployment Time Series Chart . 2014-01-16 . 2014-02-01 . https://web.archive.org/web/20140201110442/http://www.top500.org/statistics/details/connfam/2 . live .
  8. Web site: CSP, Inc. Broadens MultiComputer Business Opportunities With Asset Purchase of Myricom, Inc. . Press Release . November 6, 2013 . September 1, 2016 . September 11, 2016 . https://web.archive.org/web/20160911083804/http://globenewswire.com/news-release/2013/11/06/587343/10056536/en/CSP-Inc-Broadens-MultiComputer-Business-Opportunities-With-Asset-Purchase-of-Myricom-Inc.html . live .
  9. Web site: Google crafts custom networking CPU with parallel computing links . The Register . Chris Williams . February 9, 2016 . September 1, 2016 . August 11, 2016 . https://web.archive.org/web/20160811165403/http://www.theregister.co.uk/2016/02/09/google_processor/ . live .