Disk encryption theory explained

Disk encryption is a special case of data at rest protection when the storage medium is a sector-addressable device (e.g., a hard disk). This article presents cryptographic aspects of the problem. For an overview, see disk encryption. For discussion of different software packages and hardware devices devoted to this problem, see disk encryption software and disk encryption hardware.

Problem definition

Disk encryption methods aim to provide three distinct properties:

1. The data on the disk should remain confidential.
2. Data retrieval and storage should both be fast operations, no matter where on the disk the data is stored.
3. The encryption method should not waste disk space (i.e., the amount of storage used for encrypted data should not be significantly larger than the size of plaintext).

The first property requires defining an adversary from whom the data is being kept confidential. The strongest adversaries studied in the field of disk encryption have these abilities:

1. they can read the raw contents of the disk at any time;
2. they can request the disk to encrypt and store arbitrary files of their choosing;
3. and they can modify unused sectors on the disk and then request their decryption.

A method provides good confidentiality if the only information such an adversary can determine over time is whether the data in a sector has or has not changed since the last time they looked.

The second property requires dividing the disk into several sectors, usually 512 bytes (bits) long, which are encrypted and decrypted independently of each other. In turn, if the data is to stay confidential, the encryption method must be tweakable; no two sectors should be processed in exactly the same way. Otherwise, the adversary could decrypt any sector of the disk by copying it to an unused sector of the disk and requesting its decryption. Whereas a purpose of a usual block cipher

E _{K} is to mimic a random permutation for any secret key K , the purpose of tweakable encryption E ^{T} _{K} is to mimic a random permutation for any secret key K and any known tweak T .

The third property is generally non-controversial. However, it indirectly prohibits the use of stream ciphers, since stream ciphers require, for their security, that the same initial state not be used twice (which would be the case if a sector is updated with different data); thus this would require an encryption method to store separate initial states for every sector on disk—seemingly a waste of space. The alternative, a block cipher, is limited to a certain block size (usually 128 or 256 bits). Because of this, disk encryption chiefly studies chaining modes, which expand the encryption block length to cover a whole disk sector. The considerations already listed make several well-known chaining modes unsuitable: ECB mode, which cannot be tweaked, and modes that turn block ciphers into stream ciphers, such as the CTR mode.

These three properties do not provide any assurance of disk integrity; that is, they don't tell you whether an adversary has been modifying your ciphertext. In part, this is because an absolute assurance of disk integrity is impossible: no matter what, an adversary could always revert the entire disk to a prior state, circumventing any such checks. If some non-absolute level of disk integrity is desired, it can be achieved within the encrypted disk on a file-by-file basis using message authentication codes.

Narrow and wide block

Disk encryption methods are also distinguished into "narrow-block" and "wide-block" methods. For a sector-sized plaintext, narrow-block method encrypts it in multiple blocks, while a wide-block methods does it in just one. Narrow-block methods such as LRW, XES, and XTS allow an attacker to exploit the block granularity to perform traffic analysis and replay. A wide-block cipher ideally makes the entire ciphertext unrecognizable for a change anywhere in the plaintext.^[1]

Block cipher-based modes

Like most encryption schemes, block cipher-based disk encryption makes use of modes of operation, which allow encrypting larger amounts of data than the ciphers' block-size (typically 128 bits). Modes are therefore rules on how to repeatedly apply the ciphers' single-block operations.

Cipher-block chaining (CBC)

Cipher-block chaining (CBC) is a common chaining mode in which the previous block's ciphertext is xored with the current block's plaintext before encryption:

C _{i} = E _{K(C} _{i-1} ⊕ P _{i).}

Since there isn't a "previous block's ciphertext" for the first block, an initialization vector (IV) must be used as

C _{-1} . This, in turn, makes CBC tweakable in some ways.

CBC suffers from some problems. For example, if the IVs are predictable, then an adversary may leave a "watermark" on the disk, i.e., store a specially created file or combination of files identifiable even after encryption. The exact method of constructing the watermark depends on the exact function providing the IVs, but the general recipe is to create two encrypted sectors with identical first blocks

b _{1} and b _{2} ; these two are then related to each other by b _{1} ⊕ IV _{1} = b _{2} ⊕ IV _{2} . Thus the encryption of b _{1} is identical to the encryption of b _{2} , leaving a watermark on the disk. The exact pattern of "same-different-same-different" on disk can then be altered to make the watermark unique to a given file.

To protect against the watermarking attack, a cipher or a hash function is used to generate the IVs from the key and the current sector number, so that an adversary cannot predict the IVs. In particular, the ESSIV approach uses a block cipher in CTR mode to generate the IVs.

Encrypted salt-sector initialization vector (ESSIV)

ESSIV^[2] is a method for generating initialization vectors for block encryption to use in disk encryption. The usual methods for generating IVs are predictable sequences of numbers based on, for example, time stamp or sector number, and permit certain attacks such as a watermarking attack. ESSIV prevents such attacks by generating IVs from a combination of the sector number SN with the hash of the key. It is the combination with the key in form of a hash that makes the IV unpredictable.

IV( rm{SN}) = E _{s(SN), where s} = hash (K).

ESSIV was designed by Clemens Fruhwirth and has been integrated into the Linux kernel since version 2.6.10, though a similar scheme has been used to generate IVs for OpenBSD's swap encryption since 2000.^[3]

ESSIV is supported as an option by the dm-crypt^[4] and FreeOTFE disk encryption systems.

Malleability attack

While CBC (with or without ESSIV) ensures confidentiality, it does not ensure integrity of the encrypted data. If the plaintext is known to the adversary, it is possible to change every second plaintext block to a value chosen by the attacker, while the blocks in between are changed to random values. This can be used for practical attacks on disk encryption in CBC or CBC-ESSIV mode.^[5]

Liskov, Rivest, and Wagner (LRW)

The tweakable narrow-block encryption (LRW)^[6] is an instantiation of the mode of operations introduced by Liskov, Rivest, and Wagner^[7] (see Theorem 2). This mode uses two keys:

K is the key for the block cipher and F is an additional key of the same size as block. For example, for AES with a 256-bit key, K is a 256-bit number and F is a 128-bit number. Encrypting block P with logical index (tweak) I uses the following formula:\begin{align} X & = F ⊗ I,\\ C & = E _{K(P} ⊕ X) ⊕ X. \end{align}

Here multiplication

⊗ and addition ⊕ are performed in the finite field (GF \left( 2 ^{128} \right) for AES). With some precomputation, only a single multiplication per sector is required (note that addition in a binary finite field is a simple bitwise addition, also known as xor): F ⊗ I = F ⊗ (I _{0} ⊕ \delta) = F ⊗ I _{0} ⊕ F ⊗ \delta , where F ⊗ \delta are precomputed for all possible values of \delta . This mode of operation needs only a single encryption per block and protects against all the above attacks except a minor leak: if the user changes a single plaintext block in a sector then only a single ciphertext block changes. (Note that this is not the same leak the ECB mode has: with LRW mode equal plaintexts in different positions are encrypted to different ciphertexts.)

Some security concerns exist with LRW, and this mode of operation has now been replaced by XTS.

LRW is employed by BestCrypt and supported as an option for dm-crypt and FreeOTFE disk encryption systems.

Xor–encrypt–xor (XEX)

See main article: Xor–encrypt–xor. Another tweakable encryption mode, XEX (xor–encrypt–xor), was designed by Rogaway to allow efficient processing of consecutive blocks (with respect to the cipher used) within one data unit (e.g., a disk sector). The tweak is represented as a combination of the sector address and index of the block within the sector (the original XEX mode proposed by Rogaway allows several indices). The ciphertext,

C , is obtained using:\begin{align} X & = E _{K(I)} ⊗ \alpha ^{j,} \\ C & = E _{K(P} ⊕ X) ⊕ X, \end{align}

where:

P is the plaintext,I is the number of the sector,\alpha is the primitive element of GF ( 2 ^{128} ) defined by polynomial x ; i.e., the number 2,j is the number of the block within the sector. XEX uses j \geq 1 ; XTS uses j \geq 0 .

The basic operations of the LRW mode (AES cipher and Galois field multiplication) are the same as the ones used in the Galois/Counter Mode (GCM), thus permitting a compact implementation of the universal LRW/XEX/GCM hardware.

The original XEX has a weakness.^[8]

XEX-based tweaked-codebook mode with ciphertext stealing (XTS)

Ciphertext stealing provides support for sectors with size not divisible by block size, for example, 520-byte sectors and 16-byte blocks. XTS-AES was standardized on December 19, 2007^[9] as IEEE P1619.^[10] The XTS standard requires using a different key for the IV encryption than for the block encryption; this differs from XEX which uses only a single key.^{[11] [12]} As a result, users wanting AES-256 and AES-128 encryption must supply 512 bits and 256 bits of key respectively. The two keys (i.e., both halves of the XTS key) must be distinct for XTS to be CCA-secure, since XTS computes the sequence

\alpha ^{j} starting at j =0 ; this differs from XEX which starts at j =1 .^{[11] [12]}

On January 27, 2010, NIST released Special Publication (SP) 800-38E^[13] in final form. SP 800-38E is a recommendation for the XTS-AES mode of operation, as standardized by IEEE Std 1619-2007, for cryptographic modules. The publication approves the XTS-AES mode of the AES algorithm by reference to the IEEE Std 1619-2007, subject to one additional requirement, which limits the maximum size of each encrypted data unit (typically a sector or disk block) to 2²⁰ AES blocks. According to SP 800-38E, "In the absence of authentication or access control, XTS-AES provides more protection than the other approved confidentiality-only modes against unauthorized manipulation of the encrypted data."

XTS is supported by BestCrypt, Botan, NetBSD's cgd,^[14] dm-crypt, FreeOTFE, TrueCrypt, VeraCrypt,^[15] DiskCryptor, FreeBSD's geli, OpenBSD softraid disk encryption software, OpenSSL, Mac OS X Lion's FileVault 2, Windows 10's BitLocker^[16] and wolfCrypt.

XTS weaknesses

XTS mode is susceptible to data manipulation and tampering, and applications must employ measures to detect modifications of data if manipulation and tampering is a concern: "...since there are no authentication tags then any ciphertext (original or modified by attacker) will be decrypted as some plaintext and there is no built-in mechanism to detect alterations. The best that can be done is to ensure that any alteration of the ciphertext will completely randomize the plaintext, and rely on the application that uses this transform to include sufficient redundancy in its plaintext to detect and discard such random plaintexts." This would require maintaining checksums for all data and metadata on disk, as done in ZFS or Btrfs. However, in commonly used file systems such as ext4 and NTFS only metadata is protected against tampering, while the detection of data tampering is non-existent.

The mode is susceptible to traffic analysis, replay and randomization attacks on sectors and 16-byte blocks. As a given sector is rewritten, attackers can collect fine-grained (16 byte) ciphertexts, which can be used for analysis or replay attacks (at a 16-byte granularity). It would be possible to define sector-wide block ciphers, unfortunately with degraded performance (see below).^[17]

CBC–mask–CBC (CMC) and ECB–mask–ECB (EME)

CMC and EME protect even against the minor leak mentioned above for LRW. Unfortunately, the price is a twofold degradation of performance: each block must be encrypted twice; many consider this to be too high a cost, since the same leak on a sector level is unavoidable anyway.

CMC, introduced by Halevi and Rogaway, stands for CBC–mask–CBC: the whole sector encrypted in CBC mode (with

C _{-1} = E _{A(I)} ), the ciphertext is masked by xoring with 2 (C' _{0} ⊕ C' _{k-1} ) , and re-encrypted in CBC mode starting from the last block. When the underlying block cipher is a strong pseudorandom permutation (PRP) then on the sector level the scheme is a tweakable PRP. One problem is that in order to decrypt P _{0} one must sequentially pass over all the data twice.

In order to solve this problem, Halevi and Rogaway introduced a parallelizable variant called EME (ECB–mask–ECB). It works in the following way:

• the plaintexts are xored with

L = E _{K(0)} , shifted by different amount to the left, and are encrypted: P' _{i} = E _{K(P} _{i} ⊕ 2 ^{i} L) ;

• the mask is calculated: $M\; =\; M\_P\; \backslash oplus\; M\_C$, where $M\_P\; =\; I\; \backslash oplus\; \backslash bigoplus\; P\text{'}\_i$ and

M _{C} = E _{K(M} _{P)} ;

• intermediate ciphertexts are masked: $C\text{'}\_i\; =\; P\text{'}\_i\; \backslash oplus\; 2^i\; M$ for

i = 1 , \ldots, k - 1 and $C\text{'}\_0\; =\; M\_C\; \backslash oplus\; I\; \backslash oplus\; \backslash bigoplus\_^\; C\text{'}\_i$;

• the final ciphertexts are calculated:

C _{i} = E _{K(C'} _{i)} ⊕ 2 ^{i} L for i = 0 , \ldots, k - 1 .Note that unlike LRW and CMC there is only a single key K .

CMC and EME were considered for standardization by SISWG. EME is patented, and so is not favored to be a primary supported mode.^[18]

HCTR and HCTR2

HCTR (2005) is mode of operation for block ciphers that is length-preserving, wide-block, and tweakable.^[19] It, however, has a bug in the specification and another in its security proof, rendering its claimed security level invalid. HCTR2 (2021) is a variant that fixes these issues and improves on security, performance, and flexibility.^[20] HCTR2 is available in the Linux kernel since version 6.0.

HCTR and HCTR2 uses a custom block cipher mode of operation called XCTR; AES-128-XCTR is usually used for HCTR2. HCTR2 uses a polynomial hash function called POLYVAL. HCTR2 is efficient on modern processors with an AES instructions and carry-less multiplication instructions.^[20]

Stream cipher modes

The HBSH (hash, block cipher, stream cipher, hash) construction, published by Google employees in 2018, allow a fast stream cipher to be used in disk encryption. The Adiantum scheme used in low-end Android devices specifically chooses NH, 256-bit Advanced Encryption Standard (AES-256), ChaCha12, and Poly1305. The construction is tweakable and wide-block. It requires three passes over the data, but it still faster than AES-128-XTS on a ARM Cortex-A7 (which has no AES instruction set).^[21] It is available in Linux kernel since version 5.0.

In 2023, Aldo Gunsing, Joan Daemen and Bart Mennink presented the "double-decker" construction, which also uses a stream cipher. It is again tweakable and wide-block.^[1]

Patents

While the authenticated encryption scheme IAPM provides encryption as well as an authentication tag, the encryption component of the IAPM mode completely describes the LRW and XEX schemes above, and hence XTS without the ciphertext stealing aspect. This is described in detail in Figures 8 and 5 of the US patent 6,963,976.^[22]

See also

• Data remanence
• Cold boot attack
• Disk encryption software
• Disk encryption hardware
• IEEE P1619, standardization project for encryption of the storage data

Further reading

• S. Halevi and P. Rogaway, A Tweakable Enciphering Mode, CRYPTO '03 (LNCS, volume 2729), 2003.
• S. Halevi and P. Rogaway, A Parallelizable Enciphering Mode http://www.cs.ucdavis.edu/~rogaway/papers/eme.ps, 2003.
• Standard Architecture for Encrypted Shared Storage Media, IEEE Project 1619 (P1619), https://web.archive.org/web/20161220171852/http://siswg.net/index.php?option=com_content&task=view&id=38.
• SISWG, Draft Proposal for Key Backup Format https://web.archive.org/web/20060714161658/http://www.siswg.org/docs/KeyBackup-10-04-2004.pdf, 2004.
• SISWG, Draft Proposal for Tweakable Wide-block Encryption https://web.archive.org/web/20050128092039/http://www.siswg.org/docs/EME-AES-03-22-2004.pdf, 2004.  - describes EME-32-AES
• James Hughes, Encrypted Storage - Challenges and Methods http://www.dtc.umn.edu/resources/hughes1.pdf
• Lest We Remember: Cold Boot Attacks on Encryption Keys. J. Alex Halderman, Seth D. Schoen, Nadia Heninger, William Clarkson, William Paul, Joseph A. Calandrino, Ariel J. Feldman, Jacob Appelbaum, and Edward W. Felten. Princeton University. 2008-02-21. dead. https://web.archive.org/web/20080514160137/http://citp.princeton.edu.nyud.net/pub/coldboot.pdf. 2008-05-14.
• Niels Fergusson. AES-CBC + Elephant Diffuser: A Disk Encryption Algorithm for Windows Vista. Microsoft. August 2006.
• Chakraborty . Debrup . López . Cuauhtemoc Mancillas . Sarkar . Palash . Disk encryption: do we need to preserve length? . Journal of Cryptographic Engineering . April 2018 . 8 . 1 . 49–69 . 10.1007/s13389-016-0147-0 . 4647765 .

External links

• Security in Storage Working Group SISWG.
• Web site: The eSTREAM project . 2010-03-28 . 2012-04-15 . https://web.archive.org/web/20120415032728/http://www.ecrypt.eu.org/stream/ . dead .

Notes and References

1. The Third NIST Workshop on Block Cipher Modes of Operation 2023. Aldo Gunsing. Joan Daemen. Bart Mennink . Deck-Based Wide Block Cipher Modes .
2. New Methods in Hard Disk Encryption. PDF. Clemens Fruhwirth. Institute for Computer Languages: Theory and Logic Group . Vienna University of Technology. July 18, 2005.
3. Encrypting Virtual Memory . Postscript.
4. Web site: DMCrypt dm-crypt: Linux kernel device-mapper crypto target . April 5, 2015. Milan Broz. gitlab.com.
5. Web site: Jakob Lell. Practical malleability attack against CBC-encrypted LUKS partitions. 2013-12-22.
6. Latest SISWG and IEEE P1619 drafts and meeting information are on the P1619 home page http://siswg.net/.
7. M. Liskov, R. Rivest, and D. Wagner. Tweakable block ciphers http://theory.lcs.mit.edu/~rivest/LiskovRivestWagner-TweakableBlockCiphers.pdf, CRYPTO '02 (LNCS, volume 2442), 2002.
8. Book: https://link.springer.com/content/pdf/10.1007/978-3-540-74462-7_8.pdf . 10.1007/978-3-540-74462-7_8 . Improved Security Analysis of XEX and LRW Modes . Selected Areas in Cryptography . Lecture Notes in Computer Science . 2007 . Minematsu . Kazuhiko . 4356 . 96–113 . 978-3-540-74461-0 .
9. Web site: IEEE Approves Standards for Data Encryption. https://web.archive.org/web/20080306040807/http://standards.ieee.org/announcements/StdsForEncryption.html . Karen McCabe. IEEE Standards Association. 19 December 2007. 2008-03-06.
10. Book: IEEE Standard for Cryptographic Protection of Data on Block-Oriented Storage Devices . April 18, 2008. 1–40. 978-0-7381-5363-6 . 10.1109/IEEESTD.2008.4493450 . IEEE STD 1619-2007 .
11. Rogaway . Phillip . 2004-09-24 . Efficient Instantiations of Tweakable Blockciphers and Refinements to Modes OCB and PMAC. PDF. University of California, Davis. Dept. Of Computer Science.
12. Web site: Moses . Liskov . Kazuhiko . Minematsu . 2008-09-02 . Comments on XTS-AES.
13. Recommendation for Block Cipher Modes of Operation: The XTS-AES Mode for Confidentiality on Storage Devices. Morris Dworkin. January 2010. NIST Special Publication 800-38E. National Institute of Standards and Technology. 10.6028/NIST.SP.800-38E.
14. Web site: NetBSD cryptographic disk driver. 2019-01-07. 2019-01-08. https://web.archive.org/web/20190108145520/http://netbsd.gw.com/cgi-bin/man-cgi?cgd++NetBSD-current. dead.
15. Web site: Modes of Operation . VeraCrypt Documentation . IDRIX . 2017-10-13.
16. Web site: What's new in BitLocker? . 2015-11-15 . November 12, 2015.
17. Web site: 2014-04-30 . You Don't Want XTS . Thomas Ptacek. Erin Ptacek .
18. P. Rogaway, Block cipher mode of operation for constructing a wide-blocksize block cipher from a conventional block cipher, US Patent Application 20040131182 A1.
19. Wang . Peng . Feng . Dengguo . Wu . Wenling . HCTR: A Variable-Input-Length Enciphering Mode . Information Security and Cryptology . 2005 . 3822 . 175–188 . 10.1007/11599548_15.
20. Web site: Length-preserving encryption with HCTR2 .
21. Crowley . Paul . Biggers . Eric . Adiantum: length-preserving encryption for entry-level processors . IACR Transactions on Symmetric Cryptology . 13 December 2018 . 39–61 . 10.13154/tosc.v2018.i4.39-61 . free.
22. • U.S. Patent 6,963,976, "Symmetric Key Authenticated Encryption Schemes" (filed Nov. 2000, issued Nov. 2005, expires 25 Nov. 2022) http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&co1=AND&d=PTXT&s1=6,963,976.PN.&OS=PN/6,963,976&RS=PN/6,963,976 http://pdfpiw.uspto.gov/.piw?Docid=06963976&homeurl=http%3A%2F%2Fpatft.uspto.gov%2Fnetacgi%2Fnph-Parser%3FSect1%3DPTO2%2526Sect2%3DHITOFF%2526p%3D1%2526u%3D%25252Fnetahtml%25252FPTO%25252Fsearch-bool.html%2526r%3D1%2526f%3DG%2526l%3D50%2526co1%3DAND%2526d%3DPTXT%2526s1%3D6,963,976.PN.%2526OS%3DPN%2F6,963,976%2526RS%3DPN%2F6,963,976&PageNum=&Rtype=&SectionNum=&idkey=NONE&Input=View+first+page.