Scrypt Explained

Scrypt should not be confused with Script (disambiguation).

scrypt
Designers:Colin Percival
Publish Date:2009
Digest Size:variable
Block Size:variable
Rounds:variable

In cryptography, scrypt (pronounced "ess crypt"[1]) is a password-based key derivation function created by Colin Percival in March 2009, originally for the Tarsnap online backup service.[2] [3] The algorithm was specifically designed to make it costly to perform large-scale custom hardware attacks by requiring large amounts of memory. In 2016, the scrypt algorithm was published by IETF as RFC 7914.[4] A simplified version of scrypt is used as a proof-of-work scheme by a number of cryptocurrencies, first implemented by an anonymous programmer called ArtForz in Tenebrix and followed by Fairbrix and Litecoin soon after.[5]

Introduction

A password-based key derivation function (password-based KDF) is generally designed to be computationally intensive, so that it takes a relatively long time to compute (say on the order of several hundred milliseconds). Legitimate users only need to perform the function once per operation (e.g., authentication), and so the time required is negligible. However, a brute-force attack would likely need to perform the operation billions of times, at which point the time requirements become significant and, ideally, prohibitive.

Previous password-based KDFs (such as the popular PBKDF2 from RSA Laboratories) have relatively low resource demands, meaning they do not require elaborate hardware or very much memory to perform. They are therefore easily and cheaply implemented in hardware (for instance on an ASIC or even an FPGA). This allows an attacker with sufficient resources to launch a large-scale parallel attack by building hundreds or even thousands of implementations of the algorithm in hardware and having each search a different subset of the key space. This divides the amount of time needed to complete a brute-force attack by the number of implementations available, very possibly bringing it down to a reasonable time frame.

The scrypt function is designed to hinder such attempts by raising the resource demands of the algorithm. Specifically, the algorithm is designed to use a large amount of memory compared to other password-based KDFs,[6] making the size and the cost of a hardware implementation much more expensive, and therefore limiting the amount of parallelism an attacker can use, for a given amount of financial resources.

Overview

The large memory requirements of scrypt come from a large vector of pseudorandom bit strings that are generated as part of the algorithm. Once the vector is generated, the elements of it are accessed in a pseudo-random order and combined to produce the derived key. A straightforward implementation would need to keep the entire vector in RAM so that it can be accessed as needed.

Because the elements of the vector are generated algorithmically, each element could be generated on the fly as needed, only storing one element in memory at a time and therefore cutting the memory requirements significantly. However, the generation of each element is intended to be computationally expensive, and the elements are expected to be accessed many times throughout the execution of the function. Thus there is a significant trade-off in speed to get rid of the large memory requirements.

This sort of time–memory trade-off often exists in computer algorithms: speed can be increased at the cost of using more memory, or memory requirements decreased at the cost of performing more operations and taking longer. The idea behind scrypt is to deliberately make this trade-off costly in either direction. Thus an attacker could use an implementation that doesn't require many resources (and can therefore be massively parallelized with limited expense) but runs very slowly, or use an implementation that runs more quickly but has very large memory requirements and is therefore more expensive to parallelize.

Algorithm

Function scrypt Inputs: This algorithm includes the following parameters: Passphrase: Bytes string of characters to be hashed Salt: Bytes string of random characters that modifies the hash to protect against Rainbow table attacks CostFactor (N): Integer CPU/memory cost parameter – Must be a power of 2 (e.g. 1024) BlockSizeFactor (r): Integer blocksize parameter, which fine-tunes sequential memory read size and performance. (8 is commonly used) ParallelizationFactor (p): Integer Parallelization parameter. (1 .. 232-1 * hLen/MFlen) DesiredKeyLen (dkLen): Integer Desired key length in bytes (Intended output length in octets of the derived key; a positive integer satisfying dkLen ≤ (232− 1) * hLen.) hLen: Integer The length in octets of the hash function (32 for SHA256). MFlen: Integer The length in octets of the output of the mixing function (SMix below). Defined as r * 128 in RFC7914. Output: DerivedKey: Bytes array of bytes, DesiredKeyLen long Step 1. Generate expensive salt blockSize ← 128*BlockSizeFactor // Length (in bytes) of the SMix mixing function output (e.g. 128*8 = 1024 bytes) Use PBKDF2 to generate initial 128*BlockSizeFactor*p bytes of data (e.g. 128*8*3 = 3072 bytes) Treat the result as an array of p elements, each entry being blocksize bytes (e.g. 3 elements, each 1024 bytes) [B<sub>0</sub>...B<sub>p−1</sub>] ← PBKDF2HMAC-SHA256(Passphrase, Salt, 1, blockSize*ParallelizationFactor) Mix each block in B Costfactor times using ROMix function (each block can be mixed in parallel) for i ← 0 to p-1 do Bi ← ROMix(Bi, CostFactor) All the elements of B is our new "expensive" salt expensiveSalt ← B0∥B1∥B2∥ ... ∥Bp-1 // where ∥ is concatenation Step 2. Use PBKDF2 to generate the desired number of bytes, but using the expensive salt we just generated return PBKDF2HMAC-SHA256(Passphrase, expensiveSalt, 1, DesiredKeyLen);

Where PBKDF2(P, S, c, dkLen) notation is defined in RFC 2898, where c is an iteration count.

This notation is used by RFC 7914 for specifying a usage of PBKDF2 with c = 1. Function ROMix(Block, Iterations)

Create Iterations copies of X X ← Block for i ← 0 to Iterations−1 do Vi ← X X ← BlockMix(X) for i ← 0 to Iterations−1 do j ← Integerify(X) mod Iterations X ← BlockMix(X xor Vj) return X

Where RFC 7914 defines as the result of interpreting the last 64 bytes of X as a little-endian integer A1.

Since Iterations equals 2 to the power of N, only the first Ceiling(N / 8) bytes among the last 64 bytes of X, interpreted as a little-endian integer A2, are actually needed to compute Integerify(X) mod Iterations = A<sub>1</sub> mod Iterations = A<sub>2</sub> mod Iterations.

Function BlockMix(B):

The block B is r 128-byte chunks (which is equivalent of 2r 64-byte chunks) r ← Length(B) / 128; Treat B as an array of 2r 64-byte chunks [B<sub>0</sub>...B<sub>2r-1</sub>] ← B X ← B2r−1 for i ← 0 to 2r−1 do X ← Salsa20/8(X xor Bi) // Salsa20/8 hashes from 64-bytes to 64-bytes Yi ← X return ← Y0∥Y2∥...∥Y2r−2 ∥ Y1∥Y3∥...∥Y2r−1

Where Salsa20/8 is the 8-round version of Salsa20.

Cryptocurrency uses

Scrypt is used in many cryptocurrencies as a proof-of-work algorithm (more precisely, as the hash function in the Hashcash proof-of-work algorithm). It was first implemented for Tenebrix (released in September 2011) and served as the basis for Litecoin and Dogecoin, which also adopted its scrypt algorithm.[7] [8] Mining of cryptocurrencies that use scrypt is often performed on graphics processing units (GPUs) since GPUs tend to have significantly more processing power (for some algorithms) compared to the CPU.[9] This led to shortages of high end GPUs due to the rising price of these currencies in the months of November and December 2013.[10]

Utility

scrypt encryption utility
Developer:Colin Percival
Latest Release Version:

The scrypt utility was written in May 2009 by Colin Percival as a demonstration of the scrypt key derivation function.[2] [3] It's available in most Linux and BSD distributions.

See also

External links

Notes and References

  1. Web site: Colin Percival . Twitter. https://web.archive.org/web/20190217215034/https://twitter.com/cperciva/status/734613598383841281 . 17 February 2019 . live.
  2. Web site: The scrypt key derivation function . Tarsnap . 21 January 2014 . 28 May 2019 . https://web.archive.org/web/20190528073159/https://www.tarsnap.com/scrypt.html . live .
  3. Web site: SCRYPT(1) General Commands Manual . Debian Manpages . 2 March 2022 . 2 March 2022 . https://web.archive.org/web/20220302173629/https://manpages.debian.org/testing/scrypt/scrypt.1.en.html . live .
  4. Web site: Percival . Colin . Josefsson . Simon . The scrypt Password-Based Key Derivation Function . August 2016 . RFC Editor . 13 December 2021 . RFC 7914 . 13 December 2021 . https://web.archive.org/web/20211213142419/https://datatracker.ietf.org/doc/html/rfc7914 . live .
  5. Web site: Beyond Bitcoin: A Guide to the Most Promising Cryptocurrencies. Alec Liu. 29 November 2013. 8 July 2017. 13 June 2018. https://web.archive.org/web/20180613111615/https://motherboard.vice.com/en_us/article/4x3ywn/beyond-bitcoin-a-guide-to-the-most-promising-cryptocurrencies. live.
  6. Web site: Stronger Key Derivation Via Sequential Memory-Hard Functions . 2022-11-11 . Percival . Colin . 14 April 2019 . https://web.archive.org/web/20190414144147/http://www.tarsnap.com/scrypt/scrypt.pdf . live .
  7. Book: Mastering Bitcoin: Unlocking Digital Cryptocurrencies . 221, 223 . Andreas M. Antonopoulos . 3 December 2014 . O'Reilly Media . 9781491902646 .
  8. Web site: History of cryptocurrency . 7 February 2014. litecoin.info wiki. 27 June 2014 . https://web.archive.org/web/20160611133738/https://litecoin.info/History_of_cryptocurrency . 11 June 2016 . dead .
  9. Book: Litecoin Scrypt Mining Configurations for Radeon 7950. Roman Guelfi-Gibbs. Amazon Digital Services. 11 September 2017. 24 October 2016. https://web.archive.org/web/20161024084236/https://www.amazon.com/Litecoin-Scrypt-Mining-Configurations-Radeon-ebook/dp/B00E2RT1I4. live.
  10. Web site: Massive surge in Litecoin mining leads to graphics card shortage. Joel Hruska. 10 December 2013. ExtremeTech. 1 January 2014. 12 December 2017. https://web.archive.org/web/20171212093559/http://www.extremetech.com/computing/172381-massive-surge-in-litecoin-mining-leads-to-radeon-shortage. live.
  11. Web site: Bcrypt – Blowfish File Encryption (homepage). 8 April 2024. Johnny. Shelley. Philip. Stolarczyk. Sourceforge. 29 August 2015. https://web.archive.org/web/20150829060804/http://bcrypt.sourceforge.net/. live.
  12. Web site: bcrypt APK for Android – free download on Droid Informer. droidinformer.org. 2 March 2022. 15 February 2020. https://web.archive.org/web/20200215210334/https://droidinformer.org/tools/bcrypt/. live.
  13. Web site: T2 package – trunk – bcrypt – A utility to encrypt files.. t2sde.org. 2 March 2022. 28 October 2017. https://web.archive.org/web/20171028043502/http://t2sde.org/packages/bcrypt.html. live.
  14. Web site: Oracle® GoldenGate Licensing Information. Oracle Help Center. 8 April 2024. 6 March 2024. https://web.archive.org/web/20240306230633/https://docs.oracle.com/goldengate/1212/gg-winux/OGGLC/ogglc_licenses.htm. live.