Mathematical induction is a method for proving that a statement
P(n)
n
P(0),P(1),P(2),P(3),...
A proof by induction consists of two cases. The first, the base case, proves the statement for
n=0
n=k
n=k+1
n
n=0
n=1
n=N
n\geqN
The method can be extended to prove statements about more general well-founded structures, such as trees; this generalization, known as structural induction, is used in mathematical logic and computer science. Mathematical induction in this extended sense is closely related to recursion. Mathematical induction is an inference rule used in formal proofs, and is the foundation of most correctness proofs for computer programs.[1]
n
In 370 BC, Plato's Parmenides may have contained traces of an early example of an implicit inductive proof, however, the earliest implicit proof by mathematical induction was written by al-Karaji around 1000 AD, who applied it to arithmetic sequences to prove the binomial theorem and properties of Pascal's triangle. Whilst the original work was lost, it was later referenced by Al-Samawal al-Maghribi in his treatise al-Bahir fi'l-jabr (The Brilliant in Algebra) in around 1150 AD.[3]
Katz says in his history of mathematics
In India, early implicit proofs by mathematical induction appear in Bhaskara's "cyclic method".
None of these ancient mathematicians, however, explicitly stated the induction hypothesis. Another similar case (contrary to what Vacca has written, as Freudenthal carefully showed) was that of Francesco Maurolico in his Arithmeticorum libri duo (1575), who used the technique to prove that the sum of the first odd integers is .
The earliest rigorous use of induction was by Gersonides (1288–1344). The first explicit formulation of the principle of induction was given by Pascal in his Traité du triangle arithmétique (1665). Another Frenchman, Fermat, made ample use of a related principle: indirect proof by infinite descent.
The induction hypothesis was also employed by the Swiss Jakob Bernoulli, and from then on it became well known. The modern formal treatment of the principle came only in the 19th century, with George Boole,[4] Augustus De Morgan, Charles Sanders Peirce, Giuseppe Peano, and Richard Dedekind.
The simplest and most common form of mathematical induction infers that a statement involving a natural number (that is, an integer or 1) holds for all values of . The proof consists of two steps:
The hypothesis in the induction step, that the statement holds for a particular, is called the induction hypothesis or inductive hypothesis. To prove the induction step, one assumes the induction hypothesis for and then uses this assumption to prove that the statement holds for .
Authors who prefer to define natural numbers to begin at 0 use that value in the base case; those who define natural numbers to begin at 1 use that value.
Mathematical induction can be used to prove the following statement for all natural numbers .
This states a general formula for the sum of the natural numbers less than or equal to a given number; in fact an infinite sequence of statements:
0=\tfrac{(0)(0+1)}2
0+1=\tfrac{(1)(1+1)}2
0+1+2=\tfrac{(2)(2+1)}2
Proposition. For every
n\inN
0+1+2+ … +n=\tfrac{n(n+1)}{2}.
Proof. Let be the statement
0+1+2+ … +n=\tfrac{n(n+1)}{2}.
Base case: Show that the statement holds for the smallest natural number .
is clearly true:
0=\tfrac{0(0+1)}{2}.
Induction step: Show that for every, if holds, then also holds.
Assume the induction hypothesis that for a particular, the single case holds, meaning is true:It follows that:
Algebraically, the right hand side simplifies as:
Equating the extreme left hand and right hand sides, we deduce that: That is, the statement also holds true, establishing the induction step.
Conclusion: Since both the base case and the induction step have been proved as true, by mathematical induction the statement holds for every natural number . Q.E.D.
Induction is often used to prove inequalities. As an example, we prove that
\left|\sinnx\right|\leqn\left|\sinx\right|
x
n
At first glance, it may appear that a more general version,
\left|\sinnx\right|\leqn\left|\sinx\right|
n,x
n
n
Proposition. For any
x\inR
n\inN
\left|\sinnx\right|\leqn\left|\sinx\right|
Proof. Fix an arbitrary real number
x
P(n)
\left|\sinnx\right|\leqn\left|\sinx\right|
n
Base case: The calculation
\left|\sin0x\right|=0\leq0=0\left|\sinx\right|
P(0)
P(k)\impliesP(k+1)
k
n=k\geq0
P(k)
The inequality between the extreme left-hand and right-hand quantities shows that
P(k+1)
Conclusion: The proposition
P(n)
n.
In practice, proofs by induction are often structured differently, depending on the exact nature of the property to be proven.All variants of induction are special cases of transfinite induction; see below.
If one wishes to prove a statement, not for all natural numbers, but only for all numbers greater than or equal to a certain number, then the proof by induction consists of the following:
This can be used, for example, to show that for .
In this way, one can prove that some statement holds for all, or even for all . This form of mathematical induction is actually a special case of the previous form, because if the statement to be proved is then proving it with these two rules is equivalent with proving for all natural numbers with an induction base case .[5]
Assume an infinite supply of 4- and 5-dollar coins. Induction can be used to prove that any whole amount of dollars greater than or equal to can be formed by a combination of such coins. Let denote the statement " dollars can be formed by a combination of 4- and 5-dollar coins". The proof that is true for all can then be achieved by induction on as follows:
Base case: Showing that holds for is simple: take three 4-dollar coins.
Induction step: Given that holds for some value of (induction hypothesis), prove that holds, too. Assume is true for some arbitrary . If there is a solution for dollars that includes at least one 4-dollar coin, replace it by a 5-dollar coin to make dollars. Otherwise, if only 5-dollar coins are used, must be a multiple of 5 and so at least 15; but then we can replace three 5-dollar coins by four 4-dollar coins to make dollars. In each case, is true.
Therefore, by the principle of induction, holds for all, and the proof is complete.
In this example, although also holds for , the above proof cannot be modified to replace the minimum amount of dollar to any lower value . For, the base case is actually false; for, the second case in the induction step (replacing three 5- by four 4-dollar coins) will not work; let alone for even lower .
It is sometimes desirable to prove a statement involving two natural numbers, and, by iterating the induction process. That is, one proves a base case and an induction step for, and in each of those proves a base case and an induction step for . See, for example, the proof of commutativity accompanying addition of natural numbers. More complicated arguments involving three or more counters are also possible.
See main article: Infinite descent. The method of infinite descent is a variation of mathematical induction which was used by Pierre de Fermat. It is used to show that some statement is false for all natural numbers . Its traditional form consists of showing that if is true for some natural number, it also holds for some strictly smaller natural number . Because there are no infinite decreasing sequences of natural numbers, this situation would be impossible, thereby showing (by contradiction) that cannot be true for any .
The validity of this method can be verified from the usual principle of mathematical induction. Using mathematical induction on the statement defined as " is false for all natural numbers less than or equal to ", it follows that holds for all, which means that is false for every natural number .
If one wishes to prove that a property holds for all natural numbers less than or equal to, proving satisfies the following conditions suffices:[6]
The most common form of proof by mathematical induction requires proving in the induction step that
whereupon the induction principle "automates" applications of this step in getting from to . This could be called "predecessor induction" because each step proves something about a number from something about that number's predecessor.
A variant of interest in computational complexity is "prefix induction", in which one proves the following statement in the induction step:or equivalently
The induction principle then "automates" log2 n applications of this inference in getting from to . In fact, it is called "prefix induction" because each step proves something about a number from something about the "prefix" of that number — as formed by truncating the low bit of its binary representation. It can also be viewed as an application of traditional induction on the length of that binary representation.
If traditional predecessor induction is interpreted computationally as an -step loop, then prefix induction would correspond to a log--step loop. Because of that, proofs using prefix induction are "more feasibly constructive" than proofs using predecessor induction.
Predecessor induction can trivially simulate prefix induction on the same statement. Prefix induction can simulate predecessor induction, but only at the cost of making the statement more syntactically complex (adding a bounded universal quantifier), so the interesting results relating prefix induction to polynomial-time computation depend on excluding unbounded quantifiers entirely, and limiting the alternation of bounded universal and existential quantifiers allowed in the statement.[7]
One can take the idea a step further: one must provewhereupon the induction principle "automates" applications of this inference in getting from to . This form of induction has been used, analogously, to study log-time parallel computation.
Another variant, called complete induction, course of values induction or strong induction (in contrast to which the basic form of induction is sometimes known as weak induction), makes the induction step easier to prove by using a stronger hypothesis: one proves the statement
P(m+1)
P(n)
n
m+1
P(m)
In fact, it can be shown that the two methods are actually equivalent, as explained below. In this form of complete induction, one still has to prove the base case,
P(0)
P(1)
Fn
Although the form just described requires one to prove the base case, this is unnecessary if one can prove
P(m)
P(n)
n
m\geq0
m=0
P(0)
P(n)
m=0
m>0
P(m)
m>0
n<m
Complete induction is equivalent to ordinary mathematical induction as described above, in the sense that a proof by one method can be transformed into a proof by the other. Suppose there is a proof of
P(n)
Q(n)
P(m)
m
0\leqm\leqn
Q(0)
Q(n+1)
n\inN
Q(n)
Q(n)
P(n)
If, on the other hand,
P(n)
P(0)
P(n+1)
P(n)
Complete induction is most useful when several instances of the inductive hypothesis are required for each induction step. For example, complete induction can be used to show thatwhere
Fn
x2-x-1
Fn+2=Fn+1+Fn
n\inN
n=0
Another proof by complete induction uses the hypothesis that the statement holds for all smaller
n
n>1
n>1
m
m=n1n2
m
m
n1
n2
m
We shall look to prove the same example as above, this time with strong induction. The statement remains the same:
However, there will be slight differences in the structure and the assumptions of the proof, starting with the extended base case.
Proof.
Base case: Show that
S(k)
k=12,13,14,15
The base case holds.
Induction step: Given some
j>15
S(m)
m
12\leqm<j
S(j)
Choosing
m=j-4
15<j\implies12\leqj-4<j
S(j-4)
j-4
4
5
4
j
S(j)
See main article: Forward-backward induction. Sometimes, it is more convenient to deduce backwards, proving the statement for
n-1
n
See main article: All horses are the same color. The induction step must be proved for all values of . To illustrate this, Joel E. Cohen proposed the following argument, which purports to prove by mathematical induction that all horses are of the same color:[12]
Base case: in a set of only one horse, there is only one color.
Induction step: assume as induction hypothesis that within any set of
n
n+1
1,2,3,...c,n,n+1
n
n+1
The base case
n=1
n>1
n+1=2
In second-order logic, one can write down the "axiom of induction" as follows:where is a variable for predicates involving one natural number and and are variables for natural numbers.
In words, the base case and the induction step (namely, that the induction hypothesis implies) together imply that for any natural number . The axiom of induction asserts the validity of inferring that holds for any natural number from the base case and the induction step.
The first quantifier in the axiom ranges over predicates rather than over individual numbers. This is a second-order quantifier, which means that this axiom is stated in second-order logic. Axiomatizing arithmetic induction in first-order logic requires an axiom schema containing a separate axiom for each possible predicate. The article Peano axioms contains further discussion of this issue.
The axiom of structural induction for the natural numbers was first formulated by Peano, who used it to specify the natural numbers together with the following four other axioms:
In first-order ZFC set theory, quantification over predicates is not allowed, but one can still express induction by quantification over sets: may be read as a set representing a proposition, and containing natural numbers, for which the proposition holds. This is not an axiom, but a theorem, given that natural numbers are defined in the language of ZFC set theory by axioms, analogous to Peano's. See construction of the natural numbers using the axiom of infinity and axiom schema of specification.
See main article: Transfinite induction. One variation of the principle of complete induction can be generalized for statements about elements of any well-founded set, that is, a set with an irreflexive relation < that contains no infinite descending chains. Every set representing an ordinal number is well-founded, the set of natural numbers is one of them.
Applied to a well-founded set, transfinite induction can be formulated as a single step. To prove that a statement holds for each ordinal number:
This form of induction, when applied to a set of ordinal numbers (which form a well-ordered and hence well-founded class), is called transfinite induction. It is an important proof technique in set theory, topology and other fields.
Proofs by transfinite induction typically distinguish three cases:
Strictly speaking, it is not necessary in transfinite induction to prove a base case, because it is a vacuous special case of the proposition that if is true of all, then is true of . It is vacuously true precisely because there are no values of that could serve as counterexamples. So the special cases are special cases of the general case.
The principle of mathematical induction is usually stated as an axiom of the natural numbers; see Peano axioms. It is strictly stronger than the well-ordering principle in the context of the other Peano axioms. Suppose the following:
It can then be proved that induction, given the above-listed axioms, implies the well-ordering principle. The following proof uses complete induction and the first and fourth axioms.
Proof. Suppose there exists a non-empty set,, of natural numbers that has no least element. Let be the assertion that is not in . Then is true, for if it were false then 0 is the least element of . Furthermore, let be a natural number, and suppose is true for all natural numbers less than . Then if is false is in, thus being a minimal element in, a contradiction. Thus is true. Therefore, by the complete induction principle, holds for all natural numbers ; so is empty, a contradiction. Q.E.D.
On the other hand, the set
\{(0,n):n\inN\}\cup\{(1,n):n\inN\}
x\in\{0,1\}
n\inN
y\in\{0,1\}
m\inN
Peano's axioms with the induction principle uniquely model the natural numbers. Replacing the induction principle with the well-ordering principle allows for more exotic models that fulfill all the axioms.[13]
It is mistakenly printed in several books and sources that the well-ordering principle is equivalent to the induction axiom. In the context of the other Peano axioms, this is not the case, but in the context of other axioms, they are equivalent; specifically, the well-ordering principle implies the induction axiom in the context of the first two above listed axioms and
A common mistake in many erroneous proofs is to assume that is a unique and well-defined natural number, a property which is not implied by the other Peano axioms.