Sensitivity theorem explained
In computational complexity, the sensitivity theorem, proved by Hao Huang in 2019, states that the sensitivity of a Boolean function
f\colon\{0,1\}n\to\{0,1\}
is at least the square root of its
degree, thus settling a conjecture posed by Nisan and Szegedy in 1992. The proof is notably succinct, given that prior progress had been limited.
Background
Several papers in the late 1980s and early 1990s showed that various decision tree complexity measures of Boolean functions are polynomially related, meaning that if
are two such measures then
for some constant
. Nisan and Szegedy showed that degree and approximate degree are also polynomially related to all these measures. Their proof went via yet another complexity measure,
block sensitivity, which had been introduced by Nisan. Block sensitivity generalizes a more natural measure, (critical) sensitivity, which had appeared before.
Nisan and Szegedy asked whether block sensitivity is polynomially bounded by sensitivity (the other direction is immediate since sensitivity is at most block sensitivity). This is equivalent to asking whether sensitivity is polynomially related to the various decision tree complexity measures, as well as to degree, approximate degree, and other complexity measures which have been shown to be polynomially related to these along the years. This became known as the sensitivity conjecture.
Along the years, several special cases of the sensitivity conjecture were proven.The sensitivity theorem was finally proven in its entirety by Huang, using a reduction of Gotsman and Linial.
Statement
Every Boolean function
f\colon\{0,1\}n\to\{0,1\}
can be expressed in a unique way as a
multilinear polynomial. The
degree of
is the degree of this unique polynomial, denoted
.
The sensitivity of the Boolean function
at the point
is the number of indices
such that
, where
is obtained from
by flipping the
'th coordinate. The sensitivity of
is the maximum sensitivity of
at any point
, denoted
.
The sensitivity theorem states that
In the other direction, Tal, improving on an earlier bound of Nisan and Szegedy, showed that
The sensitivity theorem is tight for the AND-of-ORs function:
This function has degree
and sensitivity
.
Proof
Let
f\colon\{0,1\}n\to\{0,1\}
be a Boolean function of degree
. Consider any
maxonomial of
, that is, a monomial of degree
in the unique multilinear polynomial representing
. If we substitute an arbitrary value in the coordinates not mentioned in the monomial then we get a function
on
coordinates which has degree
, and moreover,
. If we prove the sensitivity theorem for
then it follows for
. So from now on, we assume without loss of generality that
has degree
.
Define a new function
g\colon\{0,1\}n\to\{0,1\}
by
g(x1,...,xn)=f ⊕ x1 ⊕ … ⊕ xn.
It can be shown that since
has degree
then
is unbalanced (meaning that
), say
. Consider the subgraph
of the hypercube (the graph on
in which two vertices are connected if they differ by a single coordinate) induced by
. In order to prove the sensitivity theorem, it suffices to show that
has a vertex whose degree is at least
. This reduction is due to Gotsman and Linial.
Huang constructs a signing of the hypercube in which the product of the signs along any square is
. This means that there is a way to assign a sign to every edge of the hypercube so that this property is satisfied. The same signing had been found earlier by Ahmadi et al., which were interested in signings of graphs with few distinct eigenvalues.
Let
be the signed adjacency matrix corresponding to the signing. The property that the product of the signs in every square is
implies that
, and so half of the eigenvalues of
are
and half are
. In particular, the eigenspace of
(which has dimension
) intersects the space of vectors supported by
(which has dimension
), implying that there is an eigenvector
of
with eigenvalue
which is supported on
. (This is a simplification of Huang's original argument due to Shalev Ben-David.)
Consider a point
maximizing
. On the one hand,
.On the other hand,
is at most the sum of absolute values of all neighbors of
in
, which is at most
. Hence
.
Constructing the signing
Huang constructed the signing recursively. When
, we can take an arbitrary signing. Given a signing
of the
-dimensional hypercube
, we constructa signing of
as follows. Partition
into two copies of
. Use
for one of them and
for the other, and assign all edges between the two copies the sign
.
The same signing can also be expressed directly. Let
be an edge of the hypercube. If
is the first coordinate on which
differ, we use the sign
.
Extensions
The sensitivity theorem can be equivalently restated as
Laplante et al. refined this to
where
is the maximum sensitivity of
at a point in
.They showed furthermore that this bound is attained at two neighboring points of the hypercube.
Aaronson, Ben-David, Kothari and Tal defined a new measure, the spectral sensitivity of
, denoted
. This is the largest eigenvalue of the adjacency matrix of the
sensitivity graph of
, which is the subgraph of the hypercube consisting of all sensitive edges (edges connecting two points
such that
). They showed that Huang's proof can be decomposed into two steps:
.
.Using this measure, they proved several tight relations between complexity measures of Boolean functions:
\deg(f)=O(Q(f)2)</matH>and<math>D(f)=O(Q(f)4)
. Here
is the deterministic query complexity and
is the quantum query complexity.
Dafni et al. extended the notions of degree and sensitivity to Boolean functions on the symmetric group and on the perfect matching association scheme, and proved analogs of the sensitivity theorem for such functions. Their proofs use a reduction to Huang's sensitivity theorem.
See also
References
- Aaronson . Scott . Ben-David . Shalev . Kothari . Robin . Rao . Shravas . Tal . Avishay . Degree vs. approximate degree and Quantum implications of Huang's sensitivity theorem . ACM . 2021-06-15 . 1330–1342 . 978-1-4503-8053-9 . 10.1145/3406325.3451047. 2010.12629 .
- Ahmadi . Bahman . Alinaghipour . Fatemeh . Cavers . Michael S. . Fallat . Shaun . Meagher . Karen . Nasserasr . Shahla . Minimum number of distinct eigenvalues of graphs . Electronic Journal of Linear Algebra . 1081-3810 . International Linear Algebra Society . 26 . 673–691 . September 2013. 10.13001/1081-3810.1679 . 1304.1205 .
- Bafna . Mitali . Lokam . Satyanarayana V. . Tavenas . Sébastien . Velingker . Ameya . Faliszewski . Piotr . Muscholl . Anca . Niedermeier . Rolf . On the Sensitivity Conjecture for Read- Formulas . 41st International Symposium on Mathematical Foundations of Computer Science (MFCS 2016) . 2016 . 1868-8969 . 10.4230/LIPICS.MFCS.2016.16 . 14 pages. free .
- Dafni . Neta . Filmus . Yuval . Lifshitz . Noam . Lindzey . Nathan . Vinyals . Marc . Lee . James R. . Complexity Measures on the Symmetric Group and Beyond (Extended Abstract) . 12th Innovations in Theoretical Computer Science (ITCS) conference . 2021 . 1868-8969 . 10.4230/LIPICS.ITCS.2021.87 . 5 pages, 326343 bytes. free .
- Web site: Ben-David . Shalev . Comment #35 to Sensitivity Conjecture resolved . 3 July 2019.
- Blum . Manuel . Impagliazzo . Russell . Generic oracles and oracle classes . 28th Annual Symposium on Foundations of Computer Science (sfcs 1987) . IEEE . 1987 . 10.1109/sfcs.1987.30.
- Buhrman . Harry . de Wolf . Ronald . Complexity measures and decision tree complexity: a survey . Theoretical Computer Science . Elsevier BV . 288 . 1 . 2002 . 0304-3975 . 10.1016/s0304-3975(01)00144-x . 21–43.
- C. S. . Karthik . Tavenas . Sébastien . Lal . Akash . Akshay . S. . Saurabh . Saket . Sen . Sandeep . On the Sensitivity Conjecture for Disjunctive Normal Forms . 36th IARCS Annual Conference on Foundations of Software Technology and Theoretical Computer Science (FSTTCS 2016) . 2016 . 1868-8969 . 10.4230/LIPICS.FSTTCS.2016.15 . 15 pages. free .
- Cook . Stephen . Dwork . Cynthia . Reischuk . Rüdiger . Upper and Lower Time Bounds for Parallel Random Access Machines without Simultaneous Writes . SIAM Journal on Computing . 15 . 1 . 1986 . 0097-5397 . 10.1137/0215006 . 87–97.
- Gotsman . Chaim . Linial . Nati . The equivalence of two problems on the cube . Journal of Combinatorial Theory, Series A . Elsevier BV . 61 . 1 . 1992 . 0097-3165 . 10.1016/0097-3165(92)90060-8 . 142–146. free .
- Hartmanis . Juris . Hemachandra . Lane A. . One-way functions and the nonisomorphism of NP-complete sets . Theoretical Computer Science . 81 . 1 . 1991 . 10.1016/0304-3975(91)90323-T . 155–163. free .
- Hatami . Pooya . Kulkarni . Raghav . Pankratov . Denis . Variations on the Sensitivity Conjecture . Theory of Computing . 1 . 1 . 2011 . 1557-2862 . 10.4086/toc.gs.2011.004 . 1–27. free .
- Huang . Hao . Induced subgraphs of hypercubes and a proof of the Sensitivity Conjecture . Annals of Mathematics . 190 . 3 . 2019-11-01 . 0003-486X . 10.4007/annals.2019.190.3.6. 1907.00847 .
- Klarreich. Erica. Decades-Old Computer Science Conjecture Solved in Two Pages. July 25, 2019. Quanta Magazine.
- Web site: Laplante . Sophie . Naserasr . Reza . Sunny . Anupa . Wang . Zhouningxin . Sensitivity conjecture and signed hypercubes . Archive ouverte HAL . 2023-03-07 . 2024-04-25.
- Nisan . Noam . CREW PRAMs and Decision Trees . SIAM Journal on Computing . 20 . 6 . 1991 . 0097-5397 . 10.1137/0220062 . 999–1007.
- Nisan . Noam . Szegedy . Mario . On the degree of boolean functions as real polynomials . Computational Complexity . 4 . 4 . 1994 . 1016-3328 . 10.1007/BF01263419 . 301–313.
- Book: Simon, Hans-Ulrich . Foundations of Computation Theory . A tight Ω(loglog n)-bound on the time for parallel Ram's to compute nondegenerated boolean functions . Lecture Notes in Computer Science . Springer Berlin Heidelberg . Berlin, Heidelberg . 158 . 1983 . 439–444 . 978-3-540-12689-8 . 10.1007/3-540-12689-9_124.
- Tal . Avishay . Properties and applications of boolean function composition . ITCS '13: Proceedings of the 4th conference on Innovations in Theoretical Computer Science . ACM . 2013-01-09 . 978-1-4503-1859-4 . 10.1145/2422436.2422485.
- Tardos . G. . Query complexity, or why is it difficult to separate
from
by random oracles
? . Combinatorica . 9 . 4 . 1989 . 0209-9683 . 10.1007/BF02125350 . 385–392.
- Book: Wegener, Ingo . The Complexity of Boolean Functions . John Wiley & Sons . Stuttgart Chichester New York Brisbane [etc.] . 1987 . 0-471-91555-6.