Summation Explained

In mathematics, summation is the addition of a sequence of numbers, called addends or summands; the result is their sum or total. Beside numbers, other types of values can be summed as well: functions, vectors, matrices, polynomials and, in general, elements of any type of mathematical objects on which an operation denoted "+" is defined.

Summations of infinite sequences are called series. They involve the concept of limit, and are not considered in this article.

The summation of an explicit sequence is denoted as a succession of additions. For example, summation of is denoted, and results in 9, that is, . Because addition is associative and commutative, there is no need for parentheses, and the result is the same irrespective of the order of the summands. Summation of a sequence of only one element results in this element itself. Summation of an empty sequence (a sequence with no elements), by convention, results in 0.

Very often, the elements of a sequence are defined, through a regular pattern, as a function of their place in the sequence. For simple patterns, summation of long sequences may be represented with most summands replaced by ellipses. For example, summation of the first 100 natural numbers may be written as . Otherwise, summation is denoted by using Σ notation, where $\backslash sum$ is an enlarged capital Greek letter sigma. For example, the sum of the first natural numbers can be denoted as $\backslash sum\_^n\; i.$

For long summations, and summations of variable length (defined with ellipses or Σ notation), it is a common problem to find closed-form expressions for the result. For example,

\sum ^{n} _{i =1} i = (n(n +1 ))/(2) .

Although such formulas do not always exist, many summation formulas have been discovered—with some of the most common and elementary ones being listed in the remainder of this article.

Notation

Capital-sigma notation

Mathematical notation uses a symbol that compactly represents summation of many similar terms: the summation symbol, $\backslash sum$, an enlarged form of the upright capital Greek letter sigma. This is defined as

\sum ^{n} _{i =m} a _{i} = a _{m} + a _{m+1} + a _{m+2} + … + a _{n-1} + a _{n} where is the index of summation; is an indexed variable representing each term of the sum; is the lower bound of summation, and is the upper bound of summation. The "" under the summation symbol means that the index starts out equal to . The index,, is incremented by one for each successive term, stopping when .

This is read as "sum of, from to ".

Here is an example showing the summation of squares:

\sum ^{6} _{i =3} i ^{2} = 3 ^{2+4} ^{2+5} ^{2+6} ^{2} = 86 .

In general, while any variable can be used as the index of summation (provided that no ambiguity is incurred), some of the most common ones include letters such as

i , j , k , and n ; the latter is also often used for the upper bound of a summation.

Alternatively, index and bounds of summation are sometimes omitted from the definition of summation if the context is sufficiently clear. This applies particularly when the index runs from 1 to n.^[1] For example, one might write that:

\sum a ^{2} _{i} = \sum ^{n} _{i =1} a ^{2 .} _{i}

Generalizations of this notation are often used, in which an arbitrary logical condition is supplied, and the sum is intended to be taken over all values satisfying the condition. For example:

\sum _{0} f(k) is an alternative notation for $\backslash sum\_^\; f(k),$ the sum of f(k) over all (integers) k in the specified range. Similarly,\sum _{x} f(x) is the sum of f(x) over all elements x in the set S , and\sum _{d|n} \mu(d) is the sum of \mu(d) over all positive integers d dividing n .

There are also ways to generalize the use of many sigma signs. For example,

\sum _{i,j} is the same as\sum _{i} \sum _{j} .

A similar notation is used for the product of a sequence, where $\backslash prod$, an enlarged form of the Greek capital letter pi, is used instead of $\backslash sum.$

Special cases

It is possible to sum fewer than 2 numbers:

• If the summation has one summand

x , then the evaluated sum is x .

• If the summation has no summands, then the evaluated sum is zero, because zero is the identity for addition. This is known as the empty sum.

These degenerate cases are usually only used when the summation notation gives a degenerate result in a special case.For example, if

n = m in the definition above, then there is only one term in the sum; if n = m -1 , then there is none.

Algebraic sum

The phrase 'algebraic sum' refers to a sum of terms which may have positive or negative signs. Terms with positive signs are added, while terms with negative signs are subtracted.

Formal definition

Summation may be defined recursively as follows:

\sum ^{b} _{i = a} g(i) =0 , for b<a ;\sum ^{b} _{i = a} g(i) = g(b) + \sum ^{b -1} _{i = a} g(i) , for b \geqslant a .

Measure theory notation

In the notation of measure and integration theory, a sum can be expressed as a definite integral,

\sum ^{b} _{k =a} f(k) = \int _{[a,b]} fd\mu

where

[a, b] is the subset of the integers from a to b , and where \mu is the counting measure over the integers.

Calculus of finite differences

Given a function that is defined over the integers in the interval, the following equation holds:

f(n) - f(m) = \sum ^{n -1} _{i = m} (f(i +1 ) - f(i)).

This is known as a telescoping series and is the analogue of the fundamental theorem of calculus in calculus of finite differences, which states that:

f(n) - f(m) = \int ^{n} _{m} f'(x)dx, wheref'(x) = \lim _{h\to} (f(x + h) - f(x))/(h) is the derivative of .

An example of application of the above equation is the following:

n ^{n -1} _{i =0} \left((i +1 ) ^{k-i} ^{k\right).} Using binomial theorem, this may be rewritten as: n ^{n -1} _{i =0} l (\sum ^{k -1} _{j =0} \binom{k}{j} i ^{jr).} \Delta , defined by:\Delta(f)(n) = f(n +1 ) - f(n), where is a function defined on the nonnegative integers.Thus, given such a function, the problem is to compute the antidifference of, a function F = \Delta ^{-1} f such that \Delta F = f . That is, F(n +1 ) - F(n) = f(n). This function is defined up to the addition of a constant, and may be chosen as^[2] F(n) = \sum ^{n -1} _{i =0} f(i).

There is not always a closed-form expression for such a summation, but Faulhaber's formula provides a closed form in the case where

f(n) = n ^{k} and, by linearity, for every polynomial function of .

Approximation by definite integrals

Many such approximations can be obtained by the following connection between sums and integrals, which holds for any increasing function f:

\int ^{b} _{s = a -1} f(s) ds \le \sum ^{b} _{i = a} f(i) \le \int ^{b +1} _{s = a} f(s) ds.

and for any decreasing function f:

\int ^{b +1} _{s = a} f(s) ds \le \sum ^{b} _{i = a} f(i) \le \int ^{b} _{s = a -1} f(s) ds.

For more general approximations, see the Euler–Maclaurin formula.

For summations in which the summand is given (or can be interpolated) by an integrable function of the index, the summation can be interpreted as a Riemann sum occurring in the definition of the corresponding definite integral. One can therefore expect that for instance

(b - a)/(n) \sum ^{n -1} _{i =0} f\left(a + i (b - a)/(n\right)) ≈ \int ^{b} _{a} f(x) dx,

since the right-hand side is by definition the limit for

n\to inf ty of the left-hand side. However, for a given summation n is fixed, and little can be said about the error in the above approximation without additional assumptions about f: it is clear that for wildly oscillating functions the Riemann sum can be arbitrarily far from the Riemann integral.

Identities

The formulae below involve finite sums; for infinite summations or finite summations of expressions involving trigonometric functions or other transcendental functions, see list of mathematical series.

General identities

\sum ^{t} _{n = s} C ⋅ f(n) = C ⋅ \sum ^{t} _{n = s} f(n) (distributivity)^[3] \sum ^{t} _{n = s} f(n) \pm \sum ^{t} _{n = s} g(n) = \sum ^{t} _{n = s} \left(f(n) \pm g(n)\right) (commutativity and associativity)\sum ^{t} _{n = s} f(n) = \sum ^{t + p} _{n = s + p} f(n - p) (index shift)\sum _{n\in} f(n) = \sum _{m\in} f(\sigma(m)), for a bijection from a finite set onto a set (index change); this generalizes the preceding formula.\sum ^{t} _{n = s} f(n) = \sum ^{j} _{n = s} f(n) + \sum ^{t} _{n = j +1} f(n) (splitting a sum, using associativity)\sum ^{b} _{n = a} f(n) = \sum ^{b} _{n =0} f(n) - \sum ^{a -1} _{n =0} f(n) (a variant of the preceding formula)\sum ^{t} _{n = s} f(n) = \sum ^{t - s} _{n =0} f(t - n) (the sum from the first term up to the last is equal to the sum from the last down to the first)\sum ^{t} _{n =0} f(n) = \sum ^{t} _{n =0} f(t - n) (a particular case of the formula above)\sum ^{k _{1}} _{i = k _{0}} \sum ^{l _{1}} _{j = l _{0}} a _{i,j} = \sum ^{l _{1}} _{j = l _{0}} \sum ^{k _{1}} _{i = k _{0}} a _{i,j} (commutativity and associativity, again)\sum _{k\le} a _{i,j} = \sum ^{i} _{j = k} a _{i,j} = \sum ^{n} _{i = j} a _{i,j} = \sum ^{n - k} _{j =0} \sum ^{n - j} _{i = k} a _{i+j,i} (another application of commutativity and associativity)\sum ^{2 t +1} _{n =2 s} f(n) = \sum ^{t} _{n = s} f( 2 n) + \sum ^{t} _{n = s} f( 2 n +1 ) (splitting a sum into its odd and even parts, for even indexes)\sum ^{2 t} _{n =2 s +1} f(n) = \sum ^{t} _{n = s +1} f( 2 n) + \sum ^{t} _{n = s +1} f( 2 n -1 ) (splitting a sum into its odd and even parts, for odd indexes)l (\sum ^{n} _{i =0} a _{ir)} l (\sum ^{n} _{j =0} b _{jr)=\sum} ^{n} ^{i =0} \sum ^{n} _{j =0} a _{ib} _{j} (distributivity)\sum ^{n} _{j = t} {a _{i}{c} _{j}} = l (\sum ^{m} _{i = s} a _{ir)} l ( \sum ^{n} _{j = t} c _{j} r ) (distributivity allows factorization)\sum ^{t} _{n = s} log _{b} f(n) = log _{b} \prod ^{t} _{n = s} f(n) (the logarithm of a product is the sum of the logarithms of the factors)C ^{\sum\limits ^{t} _{n = s} f(n)} = \prod ^{t} _{n = s} C ^{f(n)} (the exponential of a sum is the product of the exponential of the summands)\sum ^{k} _{m =0} \sum ^{m} _{n =0} f(m,n) = \sum ^{k} _{m =0} \sum ^{k} _{n = m} f(n,m), for any function $f$ from $\backslash mathbb\backslash times\backslash mathbb$.

Powers and logarithm of arithmetic progressions

\sum ^{n} _{i =1} c = nc for every that does not depend on \sum ^{n} _{i =0} i = \sum ^{n} _{i =1} i = (n(n +1 ))/(2) (Sum of the simplest arithmetic progression, consisting of the first n natural numbers.)\sum ^{n} _{i =1} ( 2 i -1 ) = n ^{2} (Sum of first odd natural numbers)\sum ^{n} _{i =0} 2 i = n(n +1 ) (Sum of first even natural numbers)\sum ^{n} _{i =1} log i = log n! (A sum of logarithms is the logarithm of the product)\sum ^{n} _{i =0} i ^{2} = \sum ^{n} _{i =1} i ^{2} = (n(n +1 )( 2 n +1 ))/(6) = (n ^{3})/(3) + (n ^{2})/(2) + (n)/(6) (Sum of the first squares, see square pyramidal number.) \sum ^{n} _{i =0} i ^{3} = l (\sum ^{n} _{i =0} i r ) ^{2} = \left( (n(n +1 ))/(2) \right) ^{2} = (n ^{4})/(4) + (n ^{3})/(2) + (n ^{2})/(4) (Nicomachus's theorem)

More generally, one has Faulhaber's formula for

p> 1 \sum ^{n} _{k =1} k ^{p} = (n ^{p+1})/(p +1) + (1)/(2) n ^{p} + \sum ^{p} _{k =2} \binom p k (B _{k})/(p - k +1) n ^{p-k+1} , where B _{k} denotes a Bernoulli number, and \binom p k is a binomial coefficient.

Summation index in exponents

In the following summations, is assumed to be different from 1.

\sum ^{n -1} _{i =0} a ^{i} = (1- a ^{n})/(1- a) (sum of a geometric progression)\sum ^{n -1} _{i =0} (1)/(2 ^{i}) =2- (1)/(2 ^{n-1}) (special case for)\sum ^{n -1} _{i =0} i a ^{i} = (a - na ^{n+(n-1)a} ^{n+1})/(( 1- a) ^{2}) (times the derivative with respect to of the geometric progression)\begin {align} \sum ^{n -1} _{i =0} \left(b + i d\right) a ^{i} & = b \sum ^{n -1} _{i =0} a ^{i} + d \sum ^{n -1} _{i =0} i a ^{i\\} & = b \left( (1- a ^{n})/(1- a) \right) + d \left( (a - na ^{n+(n-1)a} ^{n+1})/(( 1- a) ^{2}) \right)\\ & = (b( 1- a ^{n)} - (n -1 )d a ^{n})/(+ 1- a) (da( 1- a ^{n} ))/(( 1- a) ^{2}) \end {align}

(sum of an arithmetico–geometric sequence)

Binomial coefficients and factorials

There exist very many summation identities involving binomial coefficients (a whole chapter of Concrete Mathematics is devoted to just the basic techniques). Some of the most basic ones are the following.

Involving the binomial theorem

\sum ^{n} _{i =0} {n \choose i}a ^{n-i} b ^{i=(a} + b) ^{n,} the binomial theorem\sum ^{n} _{i =0} {n \choose i} = 2 ^{n,} the special case where \sum ^{n} _{i =0} {n \choose i}p ^{i} ( 1- p) ^{n-i} =1 , the special case where, which, for 0 \le p \le 1 , expresses the sum of the binomial distribution\sum ^{n} _{i =0} i{n \choose i} = n( 2 ^{n-1} ), the value at of the derivative with respect to of the binomial theorem\sum ^{n} _{i =0} (n \choose i)/(i +1) = (2 ^{n+1} -1)/(n +1) , the value at of the antiderivative with respect to of the binomial theorem

Involving permutation numbers

In the following summations,

{} _{n} P _{k} is the number of -permutations of .\sum ^{n} _{i =0} {} _{i} P _{k} {n \choose i} = {} _{n} P _{k} ( 2 ^{n-k} ) \sum ^{n} _{i =1} {} _{i+k} P _{k+1} = \sum ^{n} _{i =1} \prod ^{k} _{j =0} (i + j) = ((n + k +1 )!)/((n -1 )!(k +2 )) \sum ^{n} _{i =0} i! ⋅ {n \choose i} = \sum ^{n} _{i =0} {} _{n} P _{i} = \lfloor n! ⋅ e \rfloor, n \in Z ^{+} , where and \lfloor x\rfloor denotes the floor function.

Others

\sum ^{m} _{k =0} \binom{n + k}{n} = \binom{n + m +1 }{n +1 } \sum ^{n} _{i = k} {i \choose k} = {n +1 \choose k +1 } \sum ^{n} _{i =0} i ⋅ i! = (n +1 )! - 1 \sum ^{n} _{i =0} {m + i -1 \choose i} = {m + n \choose n} \sum ^{n} _{i =0} {n \choose i} ^{2} = { 2 n \choose n} \sum ^{n} _{i =0} (1)/(i!) = (\lfloor n! e \rfloor)/(n!)

Harmonic numbers

\sum ^{n} _{i =1} (1)/(i) = H _{n} (the th harmonic number)\sum ^{n} _{i =1} (1)/(i ^{k}) = H ^{k} _{n} (a generalized harmonic number)

Growth rates

The following are useful approximations (using theta notation):

\sum ^{n} _{i =1} i ^{c} \in \Theta(n ^{c+1} ) for real c greater than −1\sum ^{n} _{i =1} (1)/(i) \in \Theta( log _{e} n) (See Harmonic number)\sum ^{n} _{i =1} c ^{i} \in \Theta(c ^{n)} for real c greater than 1\sum ^{n} _{i =1} log (i) ^{c} \in \Theta(n ⋅ log (n) ^{c} ) for non-negative real c\sum ^{n} _{i =1} log (i) ^{c} ⋅ i ^{d} \in \Theta(n ^{d+1} ⋅ log (n) ^{c} ) for non-negative real c, d\sum ^{n} _{i =1} log (i) ^{c} ⋅ i ^{d} ⋅ b ^{i} \in \Theta (n ^{d} ⋅ log (n) ^{c} ⋅ b ^{n)} for non-negative real b > 1, c, d

History

• In 1675, Gottfried Wilhelm Leibniz, in a letter to Henry Oldenburg, suggests the symbol ∫ to mark the sum of differentials (Latin: calculus summatorius), hence the S-shape.^{[4] [5]} The renaming of this symbol to integral arose later in exchanges with Johann Bernoulli.
• In 1755, the summation symbol Σ is attested in Leonhard Euler's Institutiones calculi differentialis.^[6] Euler uses the symbol in expressions like:

\Sigma ( 2 wx + w ^{2)} = x ^{2}

• In 1772, usage of Σ and Σⁿ is attested by Lagrange.^[7]
• In 1823, the capital letter S is attested as a summation symbol for series. This usage was apparently widespread.
• In 1829, the summation symbol Σ is attested by Fourier and C. G. J. Jacobi. Fourier's use includes lower and upper bounds, for example:^{[8] [9]}

\sum ^{inf ty} _{i =1} e ^{- i ^{2t}} \ldots

See also

• Capital-pi notation
• Einstein notation
• Iverson bracket
• Iterated binary operation
• Kahan summation algorithm
• Product (mathematics)
• Summation by parts

Bibliography

• Book: Cajori , Florian . Florian Cajori . A History Of Mathematical Notations Volume II . 1929 . Open Court Publishing . 978-0-486-67766-8.

Notes and References

1. Web site: Summation Notation. 2020-08-16. www.columbia.edu.
2. Handbook of Discrete and Combinatorial Mathematics, Kenneth H. Rosen, John G. Michaels, CRC Press, 1999, .
3. Web site: Calculus I - Summation Notation. 2020-08-16. tutorial.math.lamar.edu.
4. Book: Burton , David M. . The History of Mathematics: An Introduction . 2011 . 7th . McGraw-Hill . 978-0-07-338315-6 . 414.
5. Book: Leibniz , Gottfried Wilhelm . Gottfried Wilhelm Leibniz . Der Briefwechsel von Gottfried Wilhelm Leibniz mit Mathematikern. Erster Band . 1899 . Karl Immanuel . Gerhardt . Berlin . Mayer & Müller . 154.
6. Book: Euler . Leonhard . Leonhard Euler . Institutiones Calculi differentialis . 1755 . Petropolis . 27 . Latin.
7. Book: Lagrange . Joseph-Louis . Joseph-Louis Lagrange . Oeuvres de Lagrange. Tome 3 . 1867–1892 . Paris . 451 . French.
8. Book: Mémoires de l'Académie royale des sciences de l'Institut de France pour l'année 1825, tome VIII . 1829 . Didot . Paris . 581-622 . French.
9. Book: Fourier . Jean-Baptiste Joseph . Joseph Fourier . Oeuvres de Fourier. Tome 2 . 1888–1890 . Gauthier-Villars . Paris . 149 . French.