Matrix (protocol) explained

Logo Alt:[matrix]
Logo Size:220px
Is Stack:no
Purpose:Federated messaging and data synchronization
Developer:The Matrix.org Foundation CIC
Based On:HTTP, WebRTC

Matrix (sometimes stylized as ['''matrix''']) is an open standard and communication protocol for real-time communication.[1] It aims to make real-time communication work seamlessly between different service providers, in the way that standard Simple Mail Transfer Protocol email currently does for store-and-forward email service, by allowing users with accounts at one communications service provider to communicate with users of a different service provider via online chat, voice over IP, and videotelephony. It therefore serves a similar purpose to protocols like XMPP, but is not based on any existing communication protocol.

From a technical perspective, it is an application layer communication protocol for federated real-time communication. It provides HTTP APIs and open source reference implementations for securely distributing and persisting messages in JSON format over an open federation of servers. It can integrate with standard web services via WebRTC, facilitating browser-to-browser applications.

History

The initial project was created inside Amdocs, while building a chat tool called "Amdocs Unified Communications", by Matthew Hodgson and . Amdocs then funded most of the development work from 2014 to October 2017. Matrix was the winner of the Innovation award at WebRTC 2014 Conference & Expo,[2] and of the "Best in Show" award at WebRTC World in 2015. The protocol received praise mixed with some cautionary notes after it launched in 2014. Reviewers noted that other attempts at defining an open instant messaging or multimedia signalling protocol of this type had difficulties becoming widely adopted—e.g. XMPP and IRCv3—and have highlighted the challenges involved, both technological and political. Some were unclear if there was enough demand among users for services which interoperate among providers. In 2015, a subsidiary of Amdocs was created, named "Vector Creations Limited", and the Matrix staff was moved there.

In July 2017, the funding by Amdocs was announced to be cut and in the following weeks the core team created their own UK-based company, "New Vector Limited", which was mainly built to support the development of Matrix and Riot, which was later renamed to Element. During this time period, there were multiple calls for support to the community and companies that build on Matrix, to help pay for the wages of at least part of the core team. Patreon and Liberapay crowdfunding accounts were created, and the core team started a video podcast, called Matrix "Live" to keep the contributors up to speed with ongoing developments. This was expanded by a weekly blog format, called "This Week in Matrix", where interested community members could read, or submit their own, Matrix-related news. The company was created with the goal of offering consultancy services for Matrix and paid hosting of Matrix servers (as a platform called modular.im, which was later renamed to Element matrix services[3]) to generate income.

In the early weeks after its creation, the Matrix team and the company Purism published plans to collaborate in the creation of the Librem 5 phone. The Librem 5 was intended to be a Matrix native phone, where the default pre-installed messaging and caller app should use Matrix for audio and video calls and instant messaging.

In 2017, KDE announced it was working on including support for the protocol in its IRC client Konversation.

In late January 2018, the company received an investment of US$5 million from Status, an  Ethereum based startup.

In April 2018, the French Government announced plans to create their own instant messaging tool. Work on the application based on Riot and Matrix protocol—called after French scientist Claude Chappe—had started in early 2018,[4] and the program was open-sourced and released on iOS and Android in April 2019.[5]

In October 2018, a Community Interest Company called "The Matrix.org Foundation C.I.C." was incorporated, to serve as a neutral legal entity for further development of the standard.

In February 2019, the KDE community announced plans to adopt Matrix for its internal communications needs, as a decentralized alternative to other instant messaging servers like Telegram, Slack, and Discord, and operate its own server instance.

In April 2019, Matrix.org suffered a security breach in which the production servers were compromised.This breach was not an issue with the Matrix protocol and did not directly affect home servers other than matrix.org.

In June 2019, the Matrix protocol left beta phase with the version 1.0 across all APIs (and Synapse, at the time the reference home server), and the Matrix foundation was officially launched.[6] [7]

In October 2019, New Vector raised an additional US$8.5 million to develop Matrix.[8]

In December 2019, German Ministry of Defense announced a pilot project called BwMessenger for secure instant messaging tool based on Matrix protocol, Synapse server and Riot application. This is modeled after French Tchap project. The long-term goal of the Federal Government is the secure use of messenger services that covers all ministries and subordinate authorities.[9]

In December 2019, Mozilla announced that it would begin to use Matrix as a replacement for IRC. In the announcement, they said that they would be completing the move in late January 2020. The Mozilla IRC server, irc.mozilla.org, is said to be removed "no later than March of next year [2020]".[10] In March 2020, the IRC server was turned off and users were directed to join chat.mozilla.org, Mozilla's Element instance.[11]

In May 2020, Matrix enabled end-to-end encryption by default for private conversations.[12]

In October 2020, Element acquired Gitter from GitLab.[13] This meant that all Gitter users would be transitioned over to Matrix.[14]

In March 2021, matrix.org announced that there are 28 million global visible accounts.[15]

In September 2022, some security issues were found in the implementation of one client-side encryption library.[16] Due to the interoperable architecture, only the affected client applications needed upgrade and third-party implementations were not affected.[16] All critical issues were fixed, with the remaining ones being either non-exploitable in practice, or already prominently warned for in the client.[16]

In February 2023, the Matrix foundation has been invited to the Digital Markets Act stakeholder workshop on "Interoperability between messaging services" and showcased how a standardised open protocol can be used to interoperate without sacrificing privacy.[17]

In June 2023, Beeper became the first member of The Matrix Foundation.[18]

In April 2024, the first elections of the Matrix Foundation's Governing Board were held, which is made up of nine different constituency groups across three categories: nonprofit and community representatives, funder representatives, and foundation representatives.

Protocol

Matrix targets use cases like voice over IP, Internet of things and instant messaging, including group communication, along with a longer-term goal to be a generic messaging and data synchronization system for the web. The protocol supports security and replication, maintaining full conversation history, with no single points of control or failure. Existing communication services can integrate with the Matrix ecosystem.

Client software is available for open-federated Instant Messaging (IM), voice over IP (VoIP) and Internet of Things (IoT) communication.

The Matrix standard specifies RESTful HTTP APIs for securely transmitting and replicating JSON data between Matrix-capable clients, servers and services. Clients send data by PUTing it to a ‘room’ on their server, which then replicates the data over all the Matrix servers participating in this ‘room’. This data is signed using a git-style signature to mitigate tampering, and the federated traffic is encrypted with HTTPS and signed with each server's private key to avoid spoofing. Replication follows eventual consistency semantics, allowing servers to function even if offline or after data-loss by re-synchronizing missing history from other participating servers.

Olm encryption

The Olm library provides for optional end-to-end encryption on a room-by-room basis via a Double Ratchet Algorithm implementation. It can ensure that conversation data at rest is only readable by the room participants. With it configured, data transmitted over Matrix is only visible as ciphertext to the Matrix servers, and can be decrypted only by authorized participants in the room. The encryption protocol is called Olm; Megolm is an expansion of Olm to better suit the need for bigger rooms. There are two main implementations:

Outbound group session keys are needed for initiating new Megolm sessions for group chats. In addition, cross-signing-keys are used to verify the overall identity of the user and their device(s). When enabling a secure backup, all those keys are encrypted using a strong passphrase or a randomly generated recovery key. This ensures that even a person who has access to the backup of the keys could not decrypt messages, guaranteeing full E2EE.

Bridges

Matrix supports bridging messages from different chat applications into Matrix rooms. These bridges are programs that run on the server and communicate with the non-Matrix servers. Bridges can either be acting as puppets or relays, where in the former the individual user's account is visibly posting the messages, and in the latter a bot posts the messages for non-puppeteered user accounts.

Currently there are official bridges for:

Bridges for the following notable applications are maintained by the community:

Adoption

Communication among the public agents of France's central administration happens on a Matrix-based internal network, named .[21] The project is developed by the Interministerial Directorate for Digital Affairs with the explicit goals of security and digital sovereignty, both of which were deemed to be impossible through WhatsApp, Telegram and Slack.[22]

Germany's national healthcare system's internal communication network uses a Matrix-based[23] system (Ti-Messenger) for real-time communication among Germany's healthcare organizations and sharing of sensitive patient data, and is developed by the national agency for the digitalisation of the healthcare system (GmbH).[24] Reasons for choosing Matrix included federated identity management, which allows to reuse the existing identity infrastructure into the new chat system; the decentralized architecture, which allows cross-linking data from disparate sources; and the open protocol, which ensures interoperability and future-proof data exchange and prevents vendor lock-in.[25]

Employees of the Bundeswehr (Germany's armed forces) communicate with each other, and share classified documents (German VS-NfD), on a private Matrix network, with a customized version of the Matrix Element app: BwMessenger (as mentioned above).[26] [27]

Two states of Germany run their own Matrix chat networks for schools. Rhineland-Palatinate is offering SchulchatRLP as a fork of FluffyChat since the beginning of 2024.[28] The server is sized for half a million pupils and deployed on kubernetes and the client was enhanced with features such as read receipt for parents or polls by fairkom.[29], who became a silver partner of the Matrix foundation in 2023. Bavaria has adapted the Element client as a proprietary ByCS messenger.[30]

Luxembourg has developed a Matrix-based chat service for government officials, named Luxchat4Gov, planned to be released in the second quartal of 2023.[31]

The Swedish Social Insurance Agency (Försäkringskassan) is using Matrix for internal communications.[32]

RocketChat recommends federation between RocketChat servers with its built-in Matrix bridge since version 4.7.0.[33]

The FOSDEM uses Matrix since 2021.[34] [35] [36] The hosting is provided by Element Matrix Services, which publishes the technical details for public review soon after the event.[37] [38]

See also

External links

Notes and References

  1. Web site: 2021-10-27 . What Is the Matrix Protocol and How Does It Work? . 2023-07-24 . MUO . en.
  2. News: Award Winners of the WebRTC 2014 Conference & Expo. 2014-12-23. Upperside Blog. 2015-06-28. https://web.archive.org/web/20150315032553/http://blog.uppersideconferences.com/award-winners-webrtc-2014-conference-expo/#.VZBLdbIVhBc. 2015-03-15. dead.
  3. Web site: Element Secure instant messenger Riot.im download End-to-end messages encryption and open network. 2020-11-01. Element.
  4. Web site: L'Etat lance un "Telegram" à la française cet été, ouvert à tous. Kaminsky. Jean. 2018-04-22. Solutions Numériques. fr-FR. 2019-12-28. Après 3 mois de développement pour un coût très limité [...].
  5. Web site: French government releases in-house IM app to replace WhatsApp and Telegram use. Cimpanu. Catalin. ZDNet. en. 2019-12-28.
  6. Web site: Introducing Matrix 1.0 and the Matrix.org Foundation. Matrix blog.
  7. Web site: Synapse 1.0.0 released. Matrix blog.
  8. Web site: 10 October 2019 . New Vector scores $8.5M to plug more users into its open, decentralized messaging Matrix . https://web.archive.org/web/20191010162513/https://techcrunch.com/2019/10/10/new-vector-scores-8-5m-to-plug-more-users-into-its-open-decentralized-messaging-matrix/ . dead . October 10, 2019 . 2019-12-18 . TechCrunch . en-US.
  9. Web site: Open Source: Bundeswehr baut eigene verschlüsselte Messenger-App. online. heise. heise online. 24 December 2019 . de. 2019-12-28.
  10. Web site: Synchronous Messaging at Mozilla: The Decision. 19 December 2019.
  11. Web site: Moznet IRC is dead; long live Mozilla Matrix!. 2020-10-31. Matrix blog. en.
  12. Web site: Cross-signing and End-to-end Encryption by Default is HERE!!!. Matrix blog.
  13. Web site: 2020-09-30. Gitter is joining Element. 2020-11-01. Element Blog.
  14. Web site: Welcoming Gitter to Matrix!. 2020-11-01. Matrix blog. en.
  15. Web site: FOSDEM 2021: Building massive virtual communities in Matrix . YouTube. 7 February 2021 . 31 March 2021 . en.
  16. Web site: Upgrade now to address E2EE vulnerabilities in matrix-js-sdk, matrix-ios-sdk and matrix-android-sdk2. en-US.
  17. Web site: The DMA Stakeholder Workshop: Interoperability between messaging services . 2024-06-02 . matrix.org.
  18. Web site: Beeper joins the foundation.
  19. Web site: Archived copy . leastauthority.com . 22 May 2022 . https://web.archive.org/web/20220516164237/https://leastauthority.com/static/publications/LeastAuthority-Matrix_vodozemac_Final_Audit_Report.pdf . 16 May 2022 . dead.
  20. Web site: Independent public audit of Vodozemac, a native Rust reference implementation of Matrix end-to-end encryption . Matrix blog.
  21. Web site: French government launches in-house developed messaging. European Commission.
  22. Web site: Open Source Software powering the newly developed internal messaging service of the French government.. European Commission. 18 October 2019 .
  23. Web site: TI-Messenger | gematik. www.gematik.de.
  24. Web site: Germany's national healthcare system adopts Matrix! . Matrix blog.
  25. Web site: German health professionals will communicate with each other through the open source Matrix protocol. 6 August 2021 .
  26. Web site: Bundeswehr | BwMessenger | Matrix | Defence case study .
  27. Web site: German armed forces testing open source chat. 16 January 2020.
  28. Web site: Statt WhatsApp: Rheinland-Pfalz testet Messenger für Schulen . 2024-06-02 . www.golem.de.
  29. Web site: SchulchatRLP unterstützt im Schulalltag . 2024-06-02 . www.fairkom.eu.
  30. Web site: BayernCloud Schule Messenger Übersicht . 2024-06-02 . www.bycs.de.
  31. Web site: Luxembourg launches open source chat for officials and citizens. 16 February 2023 .
  32. Web site: dSam and eSam endorse Matrix for secure and federated communications in the Swedish public sector. December 2022 .
  33. Web site: Rocket.Chat Leverages The Matrix Protocol for Decentralized and Interoperable Communications . 2024-06-02 . www.rocket.chat.
  34. Web site: Troubleshooting Matrix at FOSDEM 2021.
  35. Web site: 2022-02-14 . FOSDEM 2022's communication infrastructure was provided by Element Matrix Services . 2023-01-25 . Element Blog.
  36. Web site: Troubleshooting Matrix at FOSDEM 2022.
  37. Web site: How we hosted FOSDEM 2021 on Matrix.
  38. Web site: Hosting FOSDEM 2022 on Matrix.