Lattice problem explained

In computer science, lattice problems are a class of optimization problems related to mathematical objects called lattices. The conjectured intractability of such problems is central to the construction of secure lattice-based cryptosystems: lattice problems are an example of NP-hard problems which have been shown to be average-case hard, providing a test case for the security of cryptographic algorithms. In addition, some lattice problems which are worst-case hard can be used as a basis for extremely secure cryptographic schemes. The use of worst-case hardness in such schemes makes them among the very few schemes that are very likely secure even against quantum computers. For applications in such cryptosystems, lattices over vector spaces (often

Q ^{n} ) or free modules (often Z ^{n} ) are generally considered.

For all the problems below, assume that we are given (in addition to other more specific inputs) a basis for the vector space V and a norm N. The norm usually considered is the Euclidean norm L². However, other norms (such as L^p) are also considered and show up in a variety of results.^[1]

Throughout this article, let

λ (L) denote the length of the shortest non-zero vector in the lattice L: that is,λ (L) = min _{v} } \|v\|_N.

Shortest vector problem (SVP)

In the SVP, a basis of a vector space V and a norm N (often L²) are given for a lattice L and one must find the shortest non-zero vector in V, as measured by N, in L. In other words, the algorithm should output a non-zero vector v such that .

In the γ-approximation version SVP_γ, one must find a non-zero lattice vector of length at most

\gamma ⋅ λ (L) for given .

Hardness results

The exact version of the problem is only known to be NP-hard for randomized reductions.^[2] By contrast, the corresponding problem with respect to the uniform norm is known to be NP-hard.^[3]

Algorithms for the Euclidean norm

To solve the exact version of the SVP under the Euclidean norm, several different approaches are known, which can be split into two classes: algorithms requiring superexponential time (

2 ^{\omega(n)} ) and \operatorname{poly}(n) memory, and algorithms requiring both exponential time and space (2 ^{\Theta(n)} ) in the lattice dimension. The former class of algorithms most notably includes lattice enumeration^{[4] [5]} and random sampling reduction,^{[6] [7]} while the latter includes lattice sieving,^{[8] [9]} computing the Voronoi cell of the lattice,^[10] and discrete Gaussian sampling.^[11] An open problem is whether algorithms for solving exact SVP exist running in single exponential time (2 ^{O(n)} ) and requiring memory scaling polynomially in the lattice dimension.^[12]

To solve the γ-approximation version SVP_γ for

\gamma > 1 for the Euclidean norm, the best known approaches are based on using lattice basis reduction. For large, the Lenstra–Lenstra–Lovász (LLL) algorithm can find a solution in time polynomial in the lattice dimension. For smaller values \gamma , the Block Korkine-Zolotarev algorithm (BKZ)^{[13] [14] [15]} is commonly used, where the input to the algorithm (the blocksize \beta ) determines the time complexity and output quality: for large approximation factors \gamma , a small block size \beta suffices, and the algorithm terminates quickly. For small \gamma , larger \beta are needed to find sufficiently short lattice vectors, and the algorithm takes longer to find a solution. The BKZ algorithm internally uses an exact SVP algorithm as a subroutine (running in lattices of dimension at most \beta ), and its overall complexity is closely related to the costs of these SVP calls in dimension .

GapSVP

The problem GapSVP_β consists of distinguishing between the instances of SVP in which the length of the shortest vector is at most

1 or larger than, where \beta can be a fixed function of the dimension of the lattice . Given a basis for the lattice, the algorithm must decide whether λ (L) \leq 1 or . Like other promise problems, the algorithm is allowed to err on all other cases.

Yet another version of the problem is GapSVP_ζ,γ for some functions ζ and γ. The input to the algorithm is a basis

B and a number d . It is assured that all the vectors in the Gram–Schmidt orthogonalization are of length at least 1, and that λ (L(B)) \leq \zeta(n) and that, where n is the dimension. The algorithm must accept if, and reject if . For large \zeta (i.e.), the problem is equivalent to GapSVP_γ because^[16] a preprocessing done using the LLL algorithm makes the second condition (and hence,) redundant.

Closest vector problem (CVP)

In CVP, a basis of a vector space V and a metric M (often L²) are given for a lattice L, as well as a vector v in V but not necessarily in L. It is desired to find the vector in L closest to v (as measured by M). In the

\gamma -approximation version CVP_γ, one must find a lattice vector at distance at most \gamma .

Relationship with SVP

The closest vector problem is a generalization of the shortest vector problem. It is easy to show that given an oracle for CVP_γ (defined below), one can solve SVP_γ by making some queries to the oracle.^[17] The naive method to find the shortest vector by calling the CVP_γ oracle to find the closest vector to 0 does not work because 0 is itself a lattice vector and the algorithm could potentially output 0.

The reduction from SVP_γ to CVP_γ is as follows: Suppose that the input to the SVP_γ is the basis for lattice

B = [b _{1,b} _{2,\ldots,b} _{n]} . Consider the basis B ^{i = [b} _{1 ,\ldots, 2 b} _{i,\ldots,b} _{n]} and let x _{i} be the vector returned by . The claim is that the shortest vector in the set \{x _{i-b} _{i\}} is the shortest vector in the given lattice.

Hardness results

Goldreich et al. showed that any hardness of SVP implies the same hardness for CVP.^[18] Using PCP tools, Arora et al. showed that CVP is hard to approximate within factor

2 ^{log ^{1-\epsilon} (n)} unless \operatorname{NP} \subseteq \operatorname{DTIME}( 2 ^{\operatorname{poly} ( log n)}) .^[19] Dinur et al. strengthened this by giving a NP-hardness result with \epsilon = ( log log n) ^{c} for c< 1 / 2 .^[20]

Sphere decoding

Algorithms for CVP, especially the Fincke and Pohst variant,^[21] have been used for data detection in multiple-input multiple-output (MIMO) wireless communication systems (for coded and uncoded signals).^{[22] [23]} In this context it is called sphere decoding due to the radius used internal to many CVP solutions.^[24]

It has been applied in the field of the integer ambiguity resolution of carrier-phase GNSS (GPS).^[25] It is called the LAMBDA method in that field. In the same field, the general CVP problem is referred to as Integer Least Squares.

GapCVP

This problem is similar to the GapSVP problem. For GapSVP_β, the input consists of a lattice basis and a vector

v , and the algorithm must answer whether one of the following holds:

• there is a lattice vector such that the distance between it and

v is at most 1, and

• every lattice vector is at a distance greater than

\beta away from v .The opposite condition is that the closest lattice vector is at a distance 1 < λ (L) \leq \beta , hence the name GapCVP.

Known results

The problem is trivially contained in NP for any approximation factor.

Schnorr, in 1987, showed that deterministic polynomial time algorithms can solve the problem for

\beta =2 ^{O(n( loglog n) ^{2/log} n)} .^[26] Ajtai et al. showed that probabilistic algorithms can achieve a slightly better approximation factor of \beta =2 ^{O(n} .^[27]

In 1993, Banaszczyk showed that GapCVP_n is in

NP\capcoNP .^[28] In 2000, Goldreich and Goldwasser showed that \beta = \sqrt{n/ log n} puts the problem in both NP and coAM.^[29] In 2005, Aharonov and Regev showed that for some constant c , the problem with \beta = c\sqrt{n} is in NP\capcoNP .^[30]

For lower bounds, Dinur et al. showed in 1998 that the problem is NP-hard for

\beta = n ^{o(1/log{log{n} })}.^[31]

Shortest independent vectors problem (SIVP)

v _{1,} v _{2,} \ldots, v _{n} so that max \|v _{i\|} \leq max _{B} \|b _{i\|} , where the right-hand side considers all bases B = \{b _{1,\ldots,b} _{n\}} of the lattice.

In the

\gamma -approximate version, given a lattice L with dimension n, one must find n linearly independent vectors v _{1,} v _{2,\ldots,} v _{n} of length, where λ _{n(L)} is the ^th successive minimum of .

Bounded distance decoding

This problem is similar to CVP. Given a vector such that its distance from the lattice is at most

λ (L)/ 2 , the algorithm must output the closest lattice vector to it.

Covering radius problem

Given a basis for the lattice, the algorithm must find the largest distance (or in some versions, its approximation) from any vector to the lattice.

Shortest basis problem

Many problems become easier if the input basis consists of short vectors. An algorithm that solves the Shortest Basis Problem (SBP) must, given a lattice basis, output an equivalent basis

B' such that the length of the longest vector in B' is as short as possible.

The approximation version SBP_γ problem consist of finding a basis whose longest vector is at most

\gamma times longer than the longest vector in the shortest basis.

Use in cryptography

See main article: Lattice-based cryptography.

Average-case hardness of problems forms a basis for proofs-of-security for most cryptographic schemes. However, experimental evidence suggests that most NP-hard problems lack this property: they are probably only worst case hard. Many lattice problems have been conjectured or proven to be average-case hard, making them an attractive class of problems to base cryptographic schemes on. Moreover, worst-case hardness of some lattice problems have been used to create secure cryptographic schemes. The use of worst-case hardness in such schemes makes them among the very few schemes that are very likely secure even against quantum computers.

The above lattice problems are easy to solve if the algorithm is provided with a "good" basis. Lattice reduction algorithms aim, given a basis for a lattice, to output a new basis consisting of relatively short, nearly orthogonal vectors. The Lenstra–Lenstra–Lovász lattice basis reduction algorithm (LLL) was an early efficient algorithm for this problem which could output an almost reduced lattice basis in polynomial time.^[32] This algorithm and its further refinements were used to break several cryptographic schemes, establishing its status as a very important tool in cryptanalysis. The success of LLL on experimental data led to a belief that lattice reduction might be an easy problem in practice; however, this belief was challenged in the late 1990s, when several new results on the hardness of lattice problems were obtained, starting with the result of Ajtai.^[33]

In his seminal papers, Ajtai showed that the SVP problem was NP-hard and discovered some connections between the worst-case complexity and average-case complexity of some lattice problems.^[2] Building on these results, Ajtai and Dwork created a public-key cryptosystem whose security could be proven using only the worst case hardness of a certain version of SVP,^[34] thus making it the first result to have used worst-case hardness to create secure systems.^[35]

See also

• Learning with errors
• Short integer solution problem

Further reading

• Agrell, E. . Eriksson, T. . Vardy, A. . Zeger, K. . 2002 . Closest Point Search in Lattices . IEEE Trans. Inf. Theory . 48 . 8 . 2201–2214 . 10.1109/TIT.2002.800499 .
• Daniele . Micciancio . The Shortest Vector Problem is -hard to approximate to within some constant . SIAM Journal on Computing . 2001 . 30 . 6 . 2008–2035 . 10.1137/S0097539700373039 . 10.1.1.93.6646 . 42794945 .
• Book: Phong Q. . Nguyen . Jacques . Stern . Lattice Reduction in Cryptology: An Update . Proceedings of the 4th International Symposium on Algorithmic Number Theory . Springer-Verlag . 2000 . 85–112 . 978-3-540-67695-9 . http://dl.acm.org/citation.cfm?id=749906 .

Notes and References

1. Subhash Khot . Subhash . Khot . Hardness of approximating the shortest vector problem in lattices . J. ACM . 52 . 5 . 2005 . 789–808 . 10.1145/1089023.1089027 . 13438130 .
2. Book: Ajtai, Miklós . The shortest vector problem in L₂ is NP-hard for randomized reductions . Proceedings of the thirtieth annual ACM symposium on Theory of computing . Dallas, Texas, United States . ACM . 1998 . 10–19 . 10.1145/276698.276705 . 978-0-89791-962-3 . 4503998 . http://portal.acm.org/citation.cfm?id=276705 .
3. Another NP-complete problem and the complexity of computing short vectors in a lattice . Peter . van Emde Boas . 1981 . University of Amsterdam, Department of Mathematics, Netherlands . Technical Report 8104 .
4. Book: Kannan, Ravi. Improved algorithms for integer programming and related lattice problems . Proceedings of the fifteenth annual ACM symposium on Theory of computing - STOC '83. 1983. New York, NY, USA. ACM. 193–206. 10.1145/800061.808749. 978-0-89791-099-6. 18181112.
5. Book: Gama. Nicolas. Nguyen. Phong Q.. Regev. Oded. Advances in Cryptology – EUROCRYPT 2010 . Lattice Enumeration Using Extreme Pruning . 2010-05-30. 6110. en. Springer, Berlin, Heidelberg. 257–278. 10.1007/978-3-642-13190-5_13. Lecture Notes in Computer Science. 978-3-642-13189-9. 1938519 .
6. Book: Schnorr, Claus Peter. Stacs 2003 . 2003-02-27. Lattice Reduction by Random Sampling and Birthday Methods. 2607. en. Springer, Berlin, Heidelberg. 145–156. 10.1007/3-540-36494-3_14. 978-3-540-36494-8. Lecture Notes in Computer Science. 10.1.1.137.4293.
7. Book: Aono. Yoshinori. Nguyen. Phong Q.. Advances in Cryptology – EUROCRYPT 2017 . Random Sampling Revisited: Lattice Enumeration with Discrete Pruning . 2017-04-30. 10211. en. Springer, Cham. 65–102. 10.1007/978-3-319-56614-6_3. Lecture Notes in Computer Science. 978-3-319-56613-9. 39082279 .
8. Micciancio. Daniele. Voulgaris. Panagiotis. 2010. Faster Exponential Time Algorithms for the Shortest Vector Problem. Proceedings of the Twenty-First Annual ACM-SIAM Symposium on Discrete Algorithms. SODA '10. Philadelphia, PA, USA. Society for Industrial and Applied Mathematics. 1468–1480. 10.1137/1.9781611973075.119. 978-0-89871-698-6. 90084. free.
9. Book: Proceedings of the Twenty-Seventh Annual ACM-SIAM Symposium on Discrete Algorithms. Becker. A.. Ducas. L.. Gama. N.. Laarhoven. T.. 2015-12-21. Society for Industrial and Applied Mathematics. 10–24. 10.1137/1.9781611974331.ch2. New directions in nearest neighbor searching with applications to lattice sieving. 978-1-61197-433-1.
10. Book: Micciancio. Daniele. Voulgaris. Panagiotis. Proceedings of the forty-second ACM symposium on Theory of computing . A deterministic single exponential time algorithm for most lattice problems based on voronoi cell computations . 2010. STOC '10. New York, NY, USA. ACM. 351–358. 10.1145/1806689.1806739. 978-1-4503-0050-6. 10.1.1.705.3304. 2449948.
11. Book: Aggarwal. Divesh. Dadush. Daniel. Regev. Oded. Stephens-Davidowitz. Noah. Proceedings of the forty-seventh annual ACM symposium on Theory of Computing . Solving the Shortest Vector Problem in 2 ⁿ Time Using Discrete Gaussian Sampling . 2015. STOC '15. New York, NY, USA. ACM. 733–742. 10.1145/2746539.2746606. 978-1-4503-3536-2. 10214330.
12. Web site: Lattice Cryptography – Shortest Vector Problem. Micciancio. Daniele. 2017-07-01.
13. Schnorr. C. P.. 1987-01-01. A hierarchy of polynomial time lattice basis reduction algorithms. Theoretical Computer Science. 53. 2. 201–224. 10.1016/0304-3975(87)90064-8. free.
14. Schnorr. C. P.. Euchner. M.. 1994-08-01. Lattice basis reduction: Improved practical algorithms and solving subset sum problems. Mathematical Programming. en. 66. 1–3. 181–199. 10.1007/bf01581144. 15386054. 0025-5610.
15. Book: Chen. Yuanmi. Nguyen. Phong Q.. Advances in Cryptology – ASIACRYPT 2011 . BKZ 2.0: Better Lattice Security Estimates . 2011-12-04. 7073. en. Springer, Berlin, Heidelberg. 1–20. 10.1007/978-3-642-25385-0_1. Lecture Notes in Computer Science. 978-3-642-25384-3.
16. Book: Peikert, Chris . Public-key cryptosystems from the worst-case shortest vector problem: extended abstract . Proceedings of the 41st annual ACM symposium on Theory of Computing . Bethesda, MD, USA . ACM . 2009 . 333–342 . 10.1145/1536414.1536461 . 978-1-60558-506-2 . 1864880 . http://portal.acm.org/citation.cfm?id=1536414.1536461 .
17. Book: Daniele . Micciancio . Shafi Goldwasser . Shafi . Goldwasser . Complexity of Lattice Problems . Springer . 2002 .
18. O. . Goldreich . Approximating shortest lattice vectors is not harder than approximating closest lattice vectors . Inf. Process. Lett. . 71 . 2 . 1999 . 55–61 . 10.1016/S0020-0190(99)00083-6 . etal.
19. Sanjeev . Arora . 1993 . Proceedings of 1993 IEEE 34th Annual Foundations of Computer Science . The hardness of approximate optima in lattices, codes, and systems of linear equations . J. Comput. Syst. Sci. . 54 . 2 . 317–331 . 10.1109/SFCS.1993.366815 . etal. 978-0-8186-4370-5 . 44988406 .
20. I. . Dinur . Approximating CVP to Within Almost-Polynomial Factors is NP-Hard . Combinatorica . 23 . 2 . 2003 . 205–243 . 10.1007/s00493-003-0019-y . 45754954 . etal.
21. Fincke . U. . Pohst . M. . Improved Methods for Calculating Vectors of Short Length in a Lattice, Including a Complexity Analysis . Math. Comp. . 44 . 170 . 463–471 . 1985 . 10.1090/S0025-5718-1985-0777278-8 . free .
22. Book: Biglieri . E. . Calderbank . R. . Anthony G. Constantinides . Anthony G. . Constantinides . Goldsmith . A. . Paulraj . A. . Poor . H. V. . MIMO Wireless Communications . Cambridge U. P. . Cambridge . 2007 .
23. Agrell . E. . Eriksson . T. . Vardy . A. . Zeger . K. . Closest Point Search in Lattices . IEEE Trans. Inf. Theory . 48 . 8 . 2201–2214 . 2002 . 10.1109/TIT.2002.800499 .
24. Ping . Wang . Tho . Le-Ngoc . A List Sphere Decoding Algorithm with Improved Radius Setting Strategies . Wireless Personal Communications . 2011 . 61 . 1 . 189–200 . 10.1007/s11277-010-0018-4 . 30919872 .
25. Hassibi . A. . Boyd . S. . Integer Parameter Estimation in Linear Models with Applications to GPS . IEEE Trans. Sig. Proc. . 46 . 11 . 2938–2952 . 1998 . 10.1109/78.726808 . 1998ITSP...46.2938H . 10.1.1.114.7246 .
26. Book: Schnorr, C. P. . Factoring integers and computing discrete logarithms via diophantine approximation . Advances in Cryptology – Proceedings of Eurocrypt '91 .
27. Book: Miklós . Ajtai . Ravi . Kumar . D. . Sivakumar . A sieve algorithm for the shortest lattice vector problem . Proceedings of the thirty-third annual ACM symposium on Theory of computing . Hersonissos, Greece . ACM . 2001 . 601–610 . 10.1145/380752.380857 . 1-58113-349-9 . 14982298 . http://portal.acm.org/citation.cfm?doid=380752.380857 .
28. W. . Banaszczyk . New bounds in some transference theorems in the geometry of numbers . . 296 . 1993 . 1 . 625–635 . 10.1007/BF01445125 . 13921988 .
29. Book: Oded . Goldreich . Shafi . Goldwasser . On the limits of non-approximability of lattice problems . Proceedings of the thirtieth annual ACM symposium on Theory of computing . Dallas, Texas, United States . ACM . 1998 . 1–9 . 10.1145/276698.276704 . 0-89791-962-9 . 3051993 . http://portal.acm.org/citation.cfm?id=276704 .
30. 10.1145/1089023.1089025. 52. 5. 749–765. Aharonov. Dorit. Oded Regev . Lattice problems in NP \cap coNP. J. ACM. 2005. 10.1.1.205.3730. 1669286.
31. Book: I. . Dinur . G. . Kindler . S. . Safra . Approximating-CVP to within Almost-Polynomial Factors is NP-Hard . Proceedings of the 39th Annual Symposium on Foundations of Computer Science . IEEE Computer Society . 1998 . 99 . 978-0-8186-9172-0 . http://portal.acm.org/citation.cfm?id=796466 .
32. A. K. . Lenstra . H. W. Jr. . Lenstra . L. . Lovász . Factoring polynomials with rational coefficients . . 261 . 1982 . 4 . 515–534 . 10.1007/BF01457454 . 5701340 . https://web.archive.org/web/20110717132024/https://www.math.leidenuniv.nl/~hwl/PUBLICATIONS/1982f/art.pdf . 2011-07-17.
33. Book: Ajtai, M. . Generating hard instances of lattice problems . Proceedings of the Twenty-Eighth annual ACM symposium on Theory of computing . Philadelphia, Pennsylvania, United States . ACM . 1996 . 99–108 . 10.1145/237814.237838 . 978-0-89791-785-8 . 6864824 . http://portal.acm.org/citation.cfm?id=237838 .
34. Book: Miklós . Ajtai . Cynthia . Dwork . A public-key cryptosystem with worst-case/average-case equivalence . Proceedings of the Twenty-Ninth annual ACM symposium on Theory of computing . El Paso, Texas, United States . ACM . 1997 . 284–293 . 10.1145/258533.258604 . 0-89791-888-6 . 9918417 . http://portal.acm.org/citation.cfm?id=258604 .
35. Book: Cai, Jin-Yi . The Complexity of Some Lattice Problems . Algorithmic Number Theory . Lecture Notes in Computer Science . 1838 . 2000 . 1–32 . 10.1007/10722028_1 . 978-3-540-67695-9 .