Key stretching explained

In cryptography, key stretching techniques are used to make a possibly weak key, typically a password or passphrase, more secure against a brute-force attack by increasing the resources (time and possibly space) it takes to test each possible key. Passwords or passphrases created by humans are often short or predictable enough to allow password cracking, and key stretching is intended to make such attacks more difficult by complicating a basic step of trying a single password candidate. Key stretching also improves security in some real-world applications where the key length has been constrained, by mimicking a longer key length from the perspective of a brute-force attacker.[1]

There are several ways to perform key stretching. One way is to apply a cryptographic hash function or a block cipher repeatedly in a loop. For example, in applications where the key is used for a cipher, the key schedule in the cipher may be modified so that it takes a specific length of time to perform. Another way is to use cryptographic hash functions that have large memory requirements – these can be effective in frustrating attacks by memory-bound adversaries.[2]

Process

Key stretching algorithms depend on an algorithm which receives an input key and then expends considerable effort to generate a stretched cipher (called an enhanced key) mimicking randomness and longer key length. The algorithm must have no known shortcut, so the most efficient way to relate the input and cipher is to repeat the key stretching algorithm itself. This compels brute-force attackers to expend the same effort for each attempt. If this added effort compares to a brute-force key search of all keys with a certain key length, then the input key may be described as stretched by that same length.

Key stretching leaves an attacker with two options:

If the attacker uses the same class of hardware as the user, each guess will take the similar amount of time to process as it took the user (for example, one second). Even if the attacker has much greater computing resources than the user, the key stretching will still slow the attacker down while not seriously affecting the usability of the system for any legitimate user. This is because the user's computer only has to compute the stretching function once upon the user entering their password, whereas the attacker must compute it for every guess in the attack.

This process does not alter the original key-space entropy. The key stretching algorithm is deterministic, allowing a weak input to always generate the same enhanced key, but therefore limiting the enhanced key to no more possible combinations than the input key space. Consequently, this attack remains vulnerable if unprotected against certain time-memory tradeoffs such as developing rainbow tables to target multiple instances of the enhanced key space in parallel (effectively a shortcut to repeating the algorithm). For this reason, key stretching is often combined with salting.

Hash-based

Many libraries provide functions which perform key stretching as part of their function; see crypt(3) for an example. PBKDF2 is for generating an encryption key from a password, and not necessarily for password authentication. PBKDF2 can be used for both if the number of output bits is less than or equal to the internal hashing algorithm used in PBKDF2, which is usually SHA-2 (up to 512 bits), or used as an encryption key to encrypt static data.[4]

Strength and time

These examples assume that a consumer CPU can do about 65,000 SHA-1 hashes in one second. Thus, a program that uses key stretching can use 65,000 rounds of hashes and delay the user for at most one second.

Testing a trial password or passphrase typically requires one hash operation. But if key stretching was used, the attacker must compute a strengthened key for each key they test, meaning there are 65,000 hashes to compute per test. This increases the attacker's workload by a factor of 65,000, approximately 216, which means the enhanced key is worth about 16 additional bits in key strength.

Moore's law asserts that computer speed doubles roughly every 2 years. Under this assumption, every 2 years one more bit of key strength is plausibly brute-forcible. This implies that 16 extra bits of strength is worth about 16×2 = 32 years later cracking, but it also means that the number of key stretching rounds a system uses should be doubled about every 2 years to maintain the same level of security (since most keys are more secure than necessary, systems that require consistent deterministic key generation will likely not update the number of iterations used in key stretching. In such a case, the designer should take into consideration how long they wish for the key derivation system to go unaltered and should choose an appropriate number of hashes for the lifespan of the system).

CPU-bound hash functions are still vulnerable to hardware implementations. Such implementations of SHA-1 exist using as few as 5,000 gates, and 400 clock cycles.[5] With multi-million gate FPGAs costing less than $100,[6] an attacker can build a fully unrolled hardware cracker for about $5,000. Such a design, clocked at 100 MHz can test about 300,000 keys/second. The attacker is free to choose a good price/speed compromise, for example a 150,000 keys/second design for $2,500. The key stretching still slows down the attacker in such a situation; a $5,000 design attacking a straight SHA-1 hash would be able to try 300,000÷216 ≈ 4.578 keys/second.

Similarly, modern consumer GPUs can speed up hashing considerably. For example, in a benchmark, a Nvidia RTX 2080 SUPER FE computes over 10 billion SHA1 hashes per second.[7]

To defend against the hardware approach, memory-bound cryptographic functions have been developed. These functions access a lot of memory in a way that makes caching ineffective. Since large amounts of low latency memory are expensive, potential attackers are discouraged from pursuing such attacks.

History

The first deliberately slow password-based key derivation function "CRYPT" was described in 1978 by Robert Morris for encrypting Unix passwords.[8] It used an iteration count of 25, a 12-bit salt and a variant of DES as the sub-function. (DES proper was avoided in an attempt to frustrate attacks using standard DES hardware.) Passwords were limited to a maximum of eight ASCII characters. While it was a great advancement for its time, CRYPT(3) is now considered inadequate. The iteration count, designed for the PDP-11 era, is too low, 12 bits of salt is an inconvenience but does not stop precomputed dictionary attacks, and the eight-character limit prevents the use of stronger passphrases.

Modern password-based key derivation functions, such as PBKDF2, use a cryptographic hash, such as SHA-2, a longer salt (e.g. 64 bits) and a high iteration count. The U.S. National Institute of Standards and Technology (NIST) recommends a minimum iteration count of 10,000.[9] "For especially critical keys, or for very powerful systems or systems where user-perceived performance is not critical, an iteration count of 10,000,000 may be appropriate.”[10]

In 2009, a memory-intensive key strengthening algorithm, scrypt, was introduced with the intention of limiting the use of custom, highly parallel hardware to speed up key testing.[11]

In 2013, a Password Hashing Competition was held to select an improved key stretching standard that would resist attacks from graphics processors and special purpose hardware. The winner, Argon2, was selected on July 1, 2015.[12]

Some systems that use key stretching

See also

Notes and References

  1. Kelsey . John . Schneier . Bruce . Hall . Chris . Wagner . David A. . Okamoto . Eiji . Davida . George I. . Mambo . Masahiro . Secure Applications of Low-Entropy Keys . 10.1007/BFb0030415 . 121–134 . Springer . Lecture Notes in Computer Science . Information Security, First International Workshop, ISW '97, Tatsunokuchi, Japan, September 17-19, 1997, Proceedings . 1396 . 1997. 978-3-540-64382-1 .
  2. Web site: Reinhold . Arnold . July 15, 1999 . HEKS: A Family of Key Stretching Algorithms .
  3. Book: McMillan, Troy . CompTIA Advanced Security Practitioner (CASP+) CAS-004 Cert Guide . 2022-07-07 . Pearson IT Certification . 978-0-13-734870-1 . en.
  4. Web site: Moriarty . Kathleen . 2017 . PKCS#5: Password-Based Cryptography Specification, Version 2.1 .
  5. Web site: Low-cost SHA-1 Hash Function Architecture for RFID Tags. https://web.archive.org/web/20120319023331/http://events.iaik.tugraz.at/RFIDSec08/Papers/Publication/04%20-%20ONeill%20-%20Low%20Cost%20SHA-1%20-%20Slides.pdf. O'Neill. Máire. 2012-03-19 .
  6. Web site: New 90nm Xilinx Spartan-3 FPGAs Reshape Semiconductor Landscape (0333) : Xilinx Press Releases . 2010-08-08 . https://web.archive.org/web/20110716142011/http://www.xilinx.com/prs_rls/silicon_spart/0333spartan3.htm . 2011-07-16 . dead .
  7. https://gist.github.com/epixoip/47098d25f171ec1808b519615be1b90d, PBKDF2-HMAC-SHA1 with 1,000 iterations costs 2,002 SHA-1 hashes at a speed of 5,164.9 kH/s which comes to 10,340,129,800 SHA-1 hashes per second.
  8. Web site: Password Security: A Case History. . https://web.archive.org/web/20030322053727/http://cm.bell-labs.com/cm/cs/who/dmr/passwd.ps . dead . 2003-03-22 . Bell Laboratories . Morris, Robert . Thompson, Ken . 1978-04-03 . 2011-05-09.
  9. Book: SP 800-63B-3 – Digital Identity Guidelines, Authentication and Lifecycle Management . NIST . June 2017 . 10.6028/NIST.SP.800-63b . Grassi Paul A..
  10. Book: SP 800-132 – Recommendation for Password-Based Key Derivation, Part 1: Storage Applications . NIST . December 2010 . 10.6028/NIST.SP.800-132 . Meltem Sönmez Turan, Elaine Barker, William Burr, and Lily Chen.
  11. Percival . Colin . 2009 . scrypt: A new key derivation function . BSDCan 2009 . https://web.archive.org/web/20240629081652/https://www.bsdcan.org/2009/schedule/events/147.en.html . 2024-06-29 . live .
  12. https://password-hashing.net Password Hashing Competition
  13. Web site: 7z Format .
  14. https://keepass.info/help/kb/kdbx_4.html KBDF 4
  15. https://keepassxc.org/docs/KeePassXC_UserGuide.html#_creating_your_first_database KeePassXC—Creating Your First Database
  16. Web site: Unix crypt using SHA-256 and SHA-512 . Ulrich . Drepper .
  17. RFC 4880