Limits of computation explained

The limits of computation are governed by a number of different factors. In particular, there are several physical and practical limits to the amount of computation or data storage that can be performed with a given amount of mass, volume, or energy.

Hardware limits or physical limits

Processing and memory density

• The Bekenstein bound limits the amount of information that can be stored within a spherical volume to the entropy of a black hole with the same surface area.
• Thermodynamics limit the data storage of a system based on its energy, number of particles and particle modes. In practice, it is a stronger bound than the Bekenstein bound.^[1]

Processing speed

• Bremermann's limit is the maximum computational speed of a self-contained system in the material universe, and is based on mass–energy versus quantum uncertainty constraints.

Communication delays

• The Margolus–Levitin theorem sets a bound on the maximum computational speed per unit of energy: 6 × 10³³ operations per second per joule. This bound, however, can be avoided if there is access to quantum memory. Computational algorithms can then be designed that require arbitrarily small amounts of energy/time per one elementary computation step.^{[2] [3]}

Energy supply

• Landauer's principle defines a lower theoretical limit for energy consumption: consumed per irreversible state change, where k is the Boltzmann constant and T is the operating temperature of the computer.^[4] Reversible computing is not subject to this lower bound. T cannot, even in theory, be made lower than 3 kelvins, the approximate temperature of the cosmic microwave background radiation, without spending more energy on cooling than is saved in computation. However, on a timescale of 10⁹ – 10¹⁰ years, the cosmic microwave background radiation will be decreasing exponentially, which has been argued to eventually enable 10³⁰ as much computations per unit of energy.^[5] Important parts of this argument have been disputed.^[6]

Building devices that approach physical limits

Several methods have been proposed for producing computing devices or data storage devices that approach physical and practical limits:

• A cold degenerate star could conceivably be used as a giant data storage device, by carefully perturbing it to various excited states, in the same manner as an atom or quantum well used for these purposes. Such a star would have to be artificially constructed, as no natural degenerate stars will cool to this temperature for an extremely long time. It is also possible that nucleons on the surface of neutron stars could form complex "molecules",^[7] which some have suggested might be used for computing purposes,^[8] creating a type of computronium based on femtotechnology, which would be faster and denser than computronium based on nanotechnology.
• It may be possible to use a black hole as a data storage or computing device, if a practical mechanism for extraction of contained information can be found. Such extraction may in principle be possible (Stephen Hawking's proposed resolution to the black hole information paradox). This would achieve storage density exactly equal to the Bekenstein bound. Seth Lloyd calculated^[9] the computational abilities of an "ultimate laptop" formed by compressing a kilogram of matter into a black hole of radius 1.485 × 10⁻²⁷ meters, concluding that it would only last about 10⁻¹⁹ seconds before evaporating due to Hawking radiation, but that during this brief time it could compute at a rate of about 5 × 10⁵⁰ operations per second, ultimately performing about 10³² operations on 10¹⁶ bits (~1 PB). Lloyd notes that "Interestingly, although this hypothetical computation is performed at ultra-high densities and speeds, the total number of bits available to be processed is not far from the number available to current computers operating in more familiar surroundings."^[10]
• In The Singularity Is Near, Ray Kurzweil cites the calculations of Seth Lloyd that a universal-scale computer is capable of 10⁹⁰ operations per second. The mass of the universe can be estimated at 3 × 10⁵² kilograms. If all matter in the universe was turned into a black hole, it would have a lifetime of 2.8 × 10¹³⁹ seconds before evaporating due to Hawking radiation. During that lifetime such a universal-scale black hole computer would perform 2.8 × 10²²⁹ operations.^[11]

Abstract limits in computer science

In the field of theoretical computer science the computability and complexity of computational problems are often sought-after. Computability theory describes the degree to which problems are computable, whereas complexity theory describes the asymptotic degree of resource consumption. Computational problems are therefore confined into complexity classes. The arithmetical hierarchy and polynomial hierarchy classify the degree to which problems are respectively computable and computable in polynomial time. For instance, the level

\Sigma ^{0} _{0} of the arithmetical hierarchy classifies computable, partial functions. Moreover, this hierarchy is strict such that at any other class in the arithmetic hierarchy classifies strictly uncomputable functions.

Loose and tight limits

Many limits derived in terms of physical constants and abstract models of computation in computer science are loose.^[12] Very few known limits directly obstruct leading-edge technologies, but many engineering obstacles currently cannot be explained by closed-form limits.

See also

• Digital physics
• Hypercomputation
• Matrioshka brain
• Physics of computation
• Programmable matter
• Quantum computing
• Supertask
• Transcomputational problem

Notes and References

1. Sandberg. Anders. The Physics of Information Processing Superobjects: Daily Life Among the Jupiter Brains. 22 December 1999. 30 May 2014. https://web.archive.org/web/20150305173119/http://www.transhumanist.com/volume5/Brains2.pdf. 5 March 2015. dead. Journal of Evolution and Technology.
2. Jordan. Stephen P.. Fast quantum computation at arbitrarily low energy. Phys. Rev. A . 95 . 3. 032305 . 2017 . 1701.01175. 10.1103/physreva.95.032305. 2017PhRvA..95c2305J. 118953874.
3. Sinitsyn. Nikolai A.. Is there a quantum limit on speed of computation?. Physics Letters A. 382. 7. 477–481. 2018. 1701.05550. 2018PhLA..382..477S. 10.1016/j.physleta.2017.12.042. 55887738.
4. The physics of forgetting: Landauer's erasure principle and information theory. Contemporary Physics. 42. 1. 10.1080/00107510010018916. 25–60. 0010-7514. 1366-5812. Vitelli. M.B.. Plenio. V.. 2001. quant-ph/0103108. 2001ConPh..42...25P. 10044/1/435. 9092795.
5. Sandberg. Anders. Armstrong. Stuart. Cirkovic. Milan M.. 2017-04-27. That is not dead which can eternal lie: the aestivation hypothesis for resolving Fermi's paradox. physics.pop-ph. 1705.03394.
6. Charles H.. Bennett. Robin. Hanson. C. Jess. Riedel. Comment on 'The Aestivation Hypothesis for Resolving Fermi's Paradox'. Foundations of Physics. 1 August 2019. 1572-9516. 820–829. 49. 8. 10.1007/s10701-019-00289-5. 1902.06730. 2019FoPh...49..820B. 119045181.
7. Encyclopedia: Life on neutron stars . The Internet Encyclopedia of Science .
8. Web site: Femtotech? (Sub)Nuclear Scale Engineering and Computation . October 30, 2006 . dead . https://web.archive.org/web/20041025030505/http://www.cs.usu.edu/~degaris/essays/femtotech.html . October 25, 2004 .
9. quant-ph/9908043. 2000Natur.406.1047L. Ultimate physical limits to computation. Nature. 406. 6799. 1047–1054. Lloyd. Seth. 2000. 10.1038/35023282. 10984064. 75923.
10. Lloyd . Seth . 2000 . Ultimate physical limits to computation . . 406 . 6799 . 1047–1054 . 10.1038/35023282 . 10984064 . quant-ph/9908043 . dead . https://web.archive.org/web/20080807173904/http://puhep1.princeton.edu/~mcdonald/examples/QM/lloyd_nature_406_1047_00.pdf . August 7, 2008 . 2000Natur.406.1047L . 75923 .
11. Book: Kurzweil, Ray. The Singularity is Near. New York: Viking. 2005. 911.
12. Markov . Igor . 2014 . Limits on Fundamental Limits to Computation. . 512 . 7513. 147–154. 10.1038/nature13570 . 25119233 . 1408.3821 . 2014Natur.512..147M. 4458968 .