End-to-end encryption explained

End-to-end encryption (E2EE) is a private communication system in which only communicating users can participate. As such, no one else, including the communication system provider, telecom providers, Internet providers or malicious actors, can access the cryptographic keys needed to converse.[1] End-to-end encryption is intended to prevent data being read or secretly modified, other than by the true sender and recipient(s). The messages are encrypted by the sender but the third party does not have a means to decrypt them, and stores them encrypted. The recipients retrieve the encrypted data and decrypt it themselves. Because no third parties can decipher the data being communicated or stored, for example, companies that provide end-to-end encryption are unable to hand over texts of their customers' messages to the authorities.[2]

In 2022, the UK's Information Commissioner's Office, the government body responsible for enforcing online data standards, stated that opposition to E2EE was misinformed and the debate too unbalanced, with too little focus on benefits, since E2EE helped keep children safe online and law enforcement access to stored data on servers was "not the only way" to find abusers.[3]

E2EE and privacy

In many messaging systems, including email and many chat networks, messages pass through intermediaries and are stored by a third party,[4] from which they are retrieved by the recipient. Even if the messages are encrypted, they are only encrypted 'in transit', and are thus accessible by the service provider,[5] regardless of whether server-side disk encryption is used. Server-side disk encryption simply prevents unauthorized users from viewing this information. It does not prevent the company itself from viewing the information, as they have the key and can simply decrypt this data.

This allows the third party to provide search and other features, or to scan for illegal and unacceptable content, but also means they can be read and misused by anyone who has access to the stored messages on the third-party system, whether this is by design or via a backdoor. This can be seen as a concern in many cases where privacy is very important, such as in governmental and military communications, financial transactions, and when sensitive information such as health and biometric data are sent, as a malicious actor or adversarial government could obtain such information sent in unencrypted messages.[6]

E2EE alone does not guarantee privacy or security.[7] For example, data may be held unencrypted on the user's own device, or be accessible via their own app, if their login is compromised.

Etymology of the term

The term "end-to-end encryption" originally only meant that the communication is never decrypted during its transport from the sender to the receiver.[8] For example, around 2003, E2EE has been proposed as an additional layer of encryption for GSM[9] or TETRA,[10] in addition to the existing radio encryption protecting the communication between the mobile device and the network infrastructure. This has been standardized by SFPG for TETRA.[11] Note that in TETRA E2EE, the keys are generated by a Key Management Centre (KMC) or a Key Management Facility (KMF), not by the communicating users.[12] Later, around 2014, the meaning of "end-to-end encryption" started to evolve when WhatsApp encrypted a portion of its network,[13] requiring that not only the communication stays encrypted during transport,[14] This new meaning is now the widely accepted one.[15]

Modern usage

As of 2016,[16] typical server-based communications systems do not include end-to-end encryption.[17] These systems can only guarantee the protection of communications between clients and servers,[18] meaning that users have to trust the third parties who are running the servers with the sensitive content. End-to-end encryption is regarded as safer[19] because it reduces the number of parties who might be able to interfere or break the encryption.[20] In the case of instant messaging, users may use a third-party client or plugin to implement an end-to-end encryption scheme over an otherwise non-E2EE protocol.[21]

Some non-E2EE systems, such as Lavabit and Hushmail, have described themselves as offering "end-to-end" encryption when they did not.[22] Other systems, such as Telegram and Google Allo, have been criticized for not enabling end-to-end encryption by default. Telegram did not enable end-to-end encryption by default on VoIP calls while users were using desktop software version, but that problem was fixed quickly.[23] [24] However, as of 2020, Telegram still features no end-to-end encryption by default, no end-to-end encryption for group chats, and no end-to-end encryption for its desktop clients. In 2022, Facebook Messenger came under scrutiny because the messages between a mother and daughter in Nebraska were used to seek criminal charges in an abortion-related case against both of them. The daughter told the police that she had a miscarriage and tried to search for the date of her miscarriage in her Messenger app. Police suspected there could be more information within the messages and obtained and served a warrant against Facebook to gain access. The messages allegedly mentioned the mother obtaining abortion pills for her daughter and then burning the evidence. Facebook expanded default end-to-end encryption in the Messenger app just days later.[25] [26] Writing for Wired, Albert Fox Cahn criticized Messenger's approach to end-to-end encryption, which was not enabled by default, required opt-in for each conversation, and split the message thread into two chats which were easy for the user to confuse.[27]

Some encrypted backup and file sharing services provide client-side encryption. This type of encryption is not referred to as end-to-end encryption because only one end has the ability to decrypt the data. However, the term "end-to-end encryption" is sometimes incorrectly used to describe client-side encryption.[28]

Challenges

Man-in-the-middle attacks

End-to-end encryption ensures that data is transferred securely between endpoints. But, rather than try to break the encryption, an eavesdropper may impersonate a message recipient (during key exchange or by substituting their public key for the recipient's), so that messages are encrypted with a key known to the attacker. After decrypting the message, the snoop can then encrypt it with a key that they share with the actual recipient, or their public key in case of asymmetric systems, and send the message on again to avoid detection. This is known as a man-in-the-middle attack (MITM).[29]

Authentication

See also: Key Transparency. Most end-to-end encryption protocols include some form of endpoint authentication specifically to prevent MITM attacks. For example, one could rely on certification authorities or a web of trust.[30] An alternative technique is to generate cryptographic hashes (fingerprints) based on the communicating users’ public keys or shared secret keys. The parties compare their fingerprints using an outside (out-of-band) communication channel that guarantees integrity and authenticity of communication (but not necessarily secrecy), before starting their conversation. If the fingerprints match, there is, in theory, no man in the middle.

When displayed for human inspection, fingerprints usually use some form of Binary-to-text encoding.[31] These strings are then formatted into groups of characters for readability. Some clients instead display a natural language representation of the fingerprint.[32] As the approach consists of a one-to-one mapping between fingerprint blocks and words, there is no loss in entropy. The protocol may choose to display words in the user's native (system) language.[32] This can, however, make cross-language comparisons prone to errors.

In order to improve localization, some protocols have chosen to display fingerprints as base 10 strings instead of more error prone hexadecimal or natural language strings.[33] An example of the base 10 fingerprint (called safety number in Signal and security code in WhatsApp) would be:

37345 35585 86758 07668 05805 48714 98975 19432 47272 72741 60915 64451

Other applications such as Telegram, instead, encode fingerprints using emojis.

Modern messaging applications can also display fingerprints as QR codes that users can scan off each other's devices.[34]

Endpoint security

The end-to-end encryption paradigm does not directly address risks at the communications endpoints themselves. Each user's computer can still be hacked to steal their cryptographic key (to create a MITM attack) or simply read the recipients’ decrypted messages both in real time and from log files. Even the most perfectly encrypted communication pipe is only as secure as the mailbox on the other end. Major attempts to increase endpoint security have been to isolate key generation, storage and cryptographic operations to a smart card such as Google's Project Vault.[35] However, since plaintext input and output are still visible to the host system, malware can monitor conversations in real time. A more robust approach is to isolate all sensitive data to a fully air gapped computer.[36] PGP has been recommended by experts for this purpose.[37] However, as Bruce Schneier points out, Stuxnet developed by US and Israel successfully jumped air gap and reached Natanz nuclear plant's network in Iran.[38] To deal with key exfiltration with malware, one approach is to split the Trusted Computing Base behind two unidirectionally connected computers that prevent either insertion of malware, or exfiltration of sensitive data with inserted malware.[39]

Backdoors

A backdoor is usually a secret method of bypassing normal authentication or encryption in a computer system, a product, an embedded device, etc.[40] Companies may also willingly or unwillingly introduce backdoors to their software that help subvert key negotiation or bypass encryption altogether. In 2013, information leaked by Edward Snowden showed that Skype had a backdoor which allowed Microsoft to hand over their users' messages to the NSA despite the fact that those messages were officially end-to-end encrypted.[41] [42]

Following terrorist attacks in San Bernardino in 2015 and Pensacola in 2019, the FBI requested backdoors to Apple's iPhone software. The company, however, refused to create a backdoor for the government, citing concern that such a tool could pose risk for its consumers’ privacy.[43]

Compliance and regulatory requirements for content inspection

While E2EE can offer privacy benefits that make it desirable in consumer-grade services, many businesses have to balance these benefits with their regulatory requirements. For example, many organizations are subject to mandates that require them to be able to decrypt any communication between their employees or between their employees and third parties.[44] This might be needed for archival purposes, for inspection by Data Loss Prevention (DLP) systems, for litigation-related eDiscovery or for detection of malware and other threats in the data streams. For this reason, some enterprise-focused communications and information protection systems might implement encryption in a way that ensures all transmissions are encrypted with the encryption being terminated at their internal systems (on-premises or cloud-based) so they can have access to the information for inspection and processing.

See also

Further reading

Notes and References

  1. Hacker Lexicon: What Is End-to-End Encryption?. WIRED. 22 December 2015. en-US. live. https://web.archive.org/web/20151223002912/http://www.wired.com/2014/11/hacker-lexicon-end-to-end-encryption/. 23 December 2015. 2014-11-25. Greenberg. Andy.
  2. News: McLaughlin. Jenna. 21 December 2015. Democratic Debate Spawns Fantasy Talk on Encryption. The Intercept. live. https://web.archive.org/web/20151223045636/https://theintercept.com/2015/12/21/democratic-debate-spawns-fantasy-talk-on-encryption/. 23 December 2015.
  3. Web site: Encryption: UK data watchdog criticises government campaign. BBC News. 21 January 2022.
  4. Web site: Cryptography Concepts – Fundamentals – E3Kit Virgil Security. 2020-10-30. developer.virgilsecurity.com.
  5. Web site: Mundhenk. Ben Rothke and David. 2009-09-10. End-to-End Encryption: The PCI Security Holy Grail. 2020-11-04. CSO Online. en.
  6. Web site: Weinstein . Gary . Encryption: The Necessary Tool For U.S. National Security And The Intelligence Community . 2024-07-26 . Forbes . en.
  7. Web site: Meehan . Tom . 2021-11-29 . End-to-End Encryption Doesn't Guarantee Internet Privacy . 2022-11-05 . Loss Prevention Media . en-US.
  8. Book: Baran, Paul. On Distributed Communications. IX. Security, Secrecy, and Tamper-Free Considerations. III. Some Fundamentals of Cryptography. 1964. RAND corporation. 2020-04-07. 2020-04-07. https://web.archive.org/web/20200407143949/https://www.rand.org/pubs/research_memoranda/RM3765/RM3765.chapter3.html. dead.
  9. Moldal. L.. Jorgensen. T.. IEE Seminar Secure GSM and Beyond: End to End Security for Mobile Communications . End to end encryption in GSM, DECT and satellite networks using NSK200. IET. https://ieeexplore.ieee.org/document/1292124. 11 February 2003. 2003 . 5 . 10.1049/ic:20030013.
  10. Murgatroyd. Brian. IEE Seminar Secure GSM and Beyond: End to End Security for Mobile Communications . End to end encryption in public safety TETRA networks. IET. https://ieeexplore.ieee.org/document/1292126. 11 February 2003. 2003 . 7 . 10.1049/ic:20030015.
  11. Web site: New chair for the SFPG. 2007.
  12. Master's Thesis. Morquecho Martinez. Raul Alejandro. Delivery of encryption keys in TETRA networks. 31 March 2016. Aalto University.
  13. Forget Apple vs. the FBI: WhatsApp Just Switched on Encryption for a Billion People. en-us. Wired. 2021-03-02. 1059-1028.
  14. Mtega. Wulystan Pius. Jan 2021. Using WhatsApp Messenger for improving learners' engagement in teaching and learning: a case of undergraduate students at the Sokoine University of Agriculture, Tanzania. Library Philosophy and Practice. 1–18. . ProQuest.
  15. Lewis, James A., Denise E. Zheng, and William A. Carter.. The effect of encryption on lawful access to communications and data. Rowman & Littlefield.
  16. Web site: A history of end-to-end encryption and the death of PGP. 2020-10-30. www.cryptologie.net.
  17. Book: Nabeel, Mohamed. 2017 IEEE International Conference on Edge Computing (EDGE) . The Many Faces of End-to-End Encryption and Their Security Analysis . 2017-06-23. http://dx.doi.org/10.1109/ieee.edge.2017.47. IEEE. 252–259. 10.1109/ieee.edge.2017.47. 978-1-5386-2017-5. 3419988.
  18. Web site: 2016-02-19. What is End-to-end encryption (E2EE) ?. 2020-11-05. Geneva Business News Actualités: Emploi, RH, économie, entreprises, Genève, Suisse.. fr-FR.
  19. Book: Bai. Wei. Pearson. Michael. Kelley. Patrick Gage. Mazurek. Michelle L.. 2020 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW) . Improving Non-Experts' Understanding of End-to-End Encryption: An Exploratory Study . September 2020. https://ieeexplore.ieee.org/document/9229664. Genoa, Italy. IEEE. 210–219. 10.1109/EuroSPW51379.2020.00036. 978-1-7281-8597-2. 220524858.
  20. Web site: End-to-End Encryption. EFF Surveillance Self-Defense Guide. Electronic Frontier Foundation. 2 February 2016. live. https://web.archive.org/web/20160305112131/https://ssd.eff.org/en/glossary/end-end-encryption. 5 March 2016.
  21. Web site: How to: Use OTR for Windows. EEF Surveillance Self-Defence Guide. Electronic Frontier Foundation. 2 February 2016. dead. https://web.archive.org/web/20160120015142/https://ssd.eff.org/en/module/how-use-otr-windows. 20 January 2016.
  22. News: Grauer. Yael. Mr. Robot Uses ProtonMail, But It Still Isn't Fully Secure. WIRED. en-US. live. https://web.archive.org/web/20170309013643/https://www.wired.com/2015/10/mr-robot-uses-protonmail-still-isnt-fully-secure/ . 2017-03-09.
  23. Web site: Why Telegram's security flaws may put Iran's journalists at risk. Committee to Protect Journalists. 23 September 2016. 31 May 2016. live. https://web.archive.org/web/20160819013449/https://cpj.org/blog/2016/05/why-telegrams-security-flaws-may-put-irans-journal.php. 19 August 2016.
  24. Web site: Hackett. Robert. Here's Why Privacy Savants Are Blasting Google Allo. 21 May 2016. Fortune. Time Inc.. 23 September 2016. live. https://web.archive.org/web/20160910182246/http://fortune.com/2016/05/21/google-allo-privacy-2/. 10 September 2016.
  25. Web site: Duffy . Sara O'Brien,Clare . 2022-08-10 . Nebraska teen and mother facing charges in abortion-related case that involved obtaining their Facebook messages CNN Business . 2024-07-26 . CNN . en.
  26. Web site: Duffy . Clare . 2022-08-11 . Meta testing expanded encryption features amid renewed scrutiny of messaging data CNN Business . 2024-07-26 . CNN . en.
  27. News: Cahn . Albert Fox . Facebook's Message Encryption Was Built to Fail . 2024-07-27 . Wired . en-US . 1059-1028.
  28. Web site: Improving Non-Experts' Understanding of End-to-End Encryption: An Exploratory Study. 2020-11-05. ResearchGate. en.
  29. Book: Schneier. Bruce. Ferguson. Niels. Kohno. Tadayoshi. Cryptography engineering : design principles and practical applications. limited. 2010. Wiley Pub., inc.. Indianapolis, IN. 978-0470474242. 183.
  30. Web site: What is man-in-the-middle attack (MitM)? – Definition from WhatIs.com. IoT Agenda. 7 January 2016. en-US. live. https://web.archive.org/web/20160105000628/http://internetofthingsagenda.techtarget.com/definition/man-in-the-middle-attack-MitM. 5 January 2016.
  31. Dechand. Sergej. 10–12 August 2016. An Empirical Study of Textual Key-Fingerprint Representations. The Advanced Computing System Association. 1–17.
  32. Web site: pEp White Paper. pEp Foundation Council. 18 July 2016. 11 October 2016. live. https://web.archive.org/web/20161001160110/https://pep.foundation/docs/pEp-whitepaper.pdf. 1 October 2016.
  33. Web site: Marlinspike. Moxie. WhatsApp's Signal Protocol integration is now complete. Open Whisper Systems. 11 October 2016. 5 April 2016. live. https://web.archive.org/web/20161010101243/https://whispersystems.org/blog/whatsapp-complete/. 10 October 2016.
  34. Web site: Budington. Bill. WhatsApp Rolls Out End-To-End Encryption to its Over One Billion Users. Deeplinks Blog. Electronic Frontier Foundation. 11 October 2016. 7 April 2016. live. https://web.archive.org/web/20160912010025/https://www.eff.org/deeplinks/2016/04/whatsapp-rolls-out-end-end-encryption-its-1bn-users. 12 September 2016.
  35. Julie Bort, Matt Weinberger "Google's Project Vault is a tiny computer for sending secret messages", Business Insider, NYC May 29, 2015
  36. Whonix Wiki "Air Gapped OpenPGP Key"
  37. Web site: If I really had to trust my life to a piece of software, I would probably use something much less flashy — GnuPG, maybe, running on an isolated computer locked in a basement. . . A Few Thoughts on Cryptographic Engineering . 9 Mar 2013.
  38. Bruce Schneier "Air Gaps", Schneier on Security, October 11, 2013
  39. Web site: maqp/tfc. GitHub. 26 April 2018. live. https://web.archive.org/web/20170331092533/https://github.com/maqp/tfc/. 31 March 2017.
  40. News: Eckersley. Peter. Portnoy. Erica. Intel's Management Engine is a security hazard, and users need a way to disable it. 7 March 2018. www.eff.org.. 8 May 2017. live. https://web.archive.org/web/20180306011455/https://www.eff.org/deeplinks/2017/05/intels-management-engine-security-hazard-and-users-need-way-disable-it. 6 March 2018.
  41. News: Goodin. Dan. Think your Skype messages get end-to-end encryption? Think again. Ars Technica. 20 May 2013. live. https://web.archive.org/web/20151222185542/http://arstechnica.com/security/2013/05/think-your-skype-messages-get-end-to-end-encryption-think-again/ . 22 December 2015.
  42. News: Greenwald. Glenn. Glenn Greenwald. MacAskill. Ewen. Poitras. Laura. Ackerman. Spencer. Rushe. Dominic. Microsoft handed the NSA access to encrypted messages. the Guardian. 12 July 2013. live. https://web.archive.org/web/20151119014627/http://www.theguardian.com/world/2013/jul/11/microsoft-nsa-collaboration-user-data . 19 November 2015.
  43. Web site: Leswing. Kif. 2020-01-16. Apple's fight with Trump and the Justice Department is about more than two iPhones. 2021-04-16. CNBC. en.
  44. News: Why GDPR Makes it Urgent to Scan Encrypted Traffic for Data Loss. SonicWall. 28 November 2017.