Orthogonal polynomials explained

In mathematics, an orthogonal polynomial sequence is a family of polynomials such that any two different polynomials in the sequence are orthogonal to each other under some inner product.

The most widely used orthogonal polynomials are the classical orthogonal polynomials, consisting of the Hermite polynomials, the Laguerre polynomials and the Jacobi polynomials. The Gegenbauer polynomials form the most important class of Jacobi polynomials; they include the Chebyshev polynomials, and the Legendre polynomials as special cases.

The field of orthogonal polynomials developed in the late 19th century from a study of continued fractions by P. L. Chebyshev and was pursued by A. A. Markov and T. J. Stieltjes. They appear in a wide variety of fields: numerical analysis (quadrature rules), probability theory, representation theory (of Lie groups, quantum groups, and related objects), enumerative combinatorics, algebraic combinatorics, mathematical physics (the theory of random matrices, integrable systems, etc.), and number theory. Some of the mathematicians who have worked on orthogonal polynomials include Gábor Szegő, Sergei Bernstein, Naum Akhiezer, Arthur Erdélyi, Yakov Geronimus, Wolfgang Hahn, Theodore Seio Chihara, Mourad Ismail, Waleed Al-Salam, Richard Askey, and Rehuel Lobatto.

Definition for 1-variable case for a real measure

Given any non-decreasing function on the real numbers, we can define the Lebesgue–Stieltjes integral $$\backslash int\; f(x)\; \backslash ,\; d\backslash alpha(x)$$of a function f. If this integral is finite for all polynomials f, we can define an inner product on pairs of polynomials f and g by$$\backslash langle\; f,\; g\; \backslash rangle\; =\; \backslash int\; f(x)\; g(x)\; \backslash ,\; d\backslash alpha(x).$$

This operation is a positive semidefinite inner product on the vector space of all polynomials, and is positive definite if the function α has an infinite number of points of growth. It induces a notion of orthogonality in the usual way, namely that two polynomials are orthogonal if their inner product is zero.

Then the sequence of orthogonal polynomials is defined by the relations$$\backslash deg\; P\_n\; =\; n~,\; \backslash quad\; \backslash langle\; P\_m,\; \backslash ,\; P\_n\; \backslash rangle\; =\; 0\; \backslash quad\; \backslash text\; \backslash quad\; m\; \backslash neq\; n~.$$

In other words, the sequence is obtained from the sequence of monomials 1, x, x², … by the Gram–Schmidt process with respect to this inner product.

Usually the sequence is required to be orthonormal, namely,$$\backslash langle\; P\_n,\; P\_n\; \backslash rangle\; =\; 1,$$however, other normalisations are sometimes used.

Absolutely continuous case

Sometimes we have $$d\backslash alpha(x)\; =\; W(x)\; \backslash ,\; dx$$where $$W\; :\; [x\_1,\; x\_2]\; \backslash to\; \backslash R$$is a non-negative function with support on some interval in the real line (where and are allowed). Such a is called a weight function.^[1] Then the inner product is given by$$\backslash langle\; f,\; g\; \backslash rangle\; =\; \backslash int\_^\; f(x)\; g(x)\; W(x)\; \backslash ,\; dx.$$However, there are many examples of orthogonal polynomials where the measure has points with non-zero measure where the function is discontinuous, so cannot be given by a weight function as above.

Examples of orthogonal polynomials

The most commonly used orthogonal polynomials are orthogonal for a measure with support in a real interval. This includes:

• The classical orthogonal polynomials (Jacobi polynomials, Laguerre polynomials, Hermite polynomials, and their special cases Gegenbauer polynomials, Chebyshev polynomials and Legendre polynomials).
• The Wilson polynomials, which generalize the Jacobi polynomials. They include many orthogonal polynomials as special cases, such as the Meixner–Pollaczek polynomials, the continuous Hahn polynomials, the continuous dual Hahn polynomials, and the classical polynomials, described by the Askey scheme
• The Askey–Wilson polynomials introduce an extra parameter q into the Wilson polynomials.

Discrete orthogonal polynomials are orthogonal with respect to some discrete measure. Sometimes the measure has finite support, in which case the family of orthogonal polynomials is finite, rather than an infinite sequence. The Racah polynomials are examples of discrete orthogonal polynomials, and include as special cases the Hahn polynomials and dual Hahn polynomials, which in turn include as special cases the Meixner polynomials, Krawtchouk polynomials, and Charlier polynomials.

Meixner classified all the orthogonal Sheffer sequences: there are only Hermite, Laguerre, Charlier, Meixner, and Meixner–Pollaczek. In some sense Krawtchouk should be on this list too, but they are a finite sequence. These six families correspond to the NEF-QVFs and are martingale polynomials for certain Lévy processes.

Sieved orthogonal polynomials, such as the sieved ultraspherical polynomials, sieved Jacobi polynomials, and sieved Pollaczek polynomials, have modified recurrence relations.

One can also consider orthogonal polynomials for some curve in the complex plane. The most important case (other than real intervals) is when the curve is the unit circle, giving orthogonal polynomials on the unit circle, such as the Rogers–Szegő polynomials.

There are some families of orthogonal polynomials that are orthogonal on plane regions such as triangles or disks. They can sometimes be written in terms of Jacobi polynomials. For example, Zernike polynomials are orthogonal on the unit disk.

The advantage of orthogonality between different orders of Hermite polynomials is applied to Generalized frequency division multiplexing (GFDM) structure. More than one symbol can be carried in each grid of time-frequency lattice.^[2]

Properties

Orthogonal polynomials of one variable defined by a non-negative measure on the real line have the following properties.

Relation to moments

The orthogonal polynomials P_n can be expressed in terms of the moments

m _{n} = \int x ^{n} d\alpha(x)

as follows:

P _{n(x)} = c _{n} \det \begin{bmatrix} m _{0} & m _{1} & m _{2} & … & m _{n} \\ m _{1} & m _{2} & m _{3} & … & m _{n+1} \\ \vdots&\vdots&\vdots&\ddots& \vdots \\ m _{n-1} &m _{n&} m _{n+1} & … &m _{2n-1} \\ 1 & x & x ^{2} & … & x ^{n \end{bmatrix}~,}

where the constants c_n are arbitrary (depend on the normalization of P_n).

This comes directly from applying the Gram–Schmidt process to the monomials, imposing each polynomial to be orthogonal with respect to the previous ones. For example, orthogonality with

P _{0} prescribes that P _{1} must have the form$$P\_1(x)\; =\; c\_1\; \backslash left(x-\; \backslash frac\; \backslash right)=\; c\_1\; (x\; -\; m\_1),$$which can be seen to be consistent with the previously given expression with the determinant.

Recurrence relation

The polynomials P_n satisfy a recurrence relation of the form

P _{n(x)} = (A _{n} x + B _{n)} P _{n-1} (x) + C _{n} P _{n-2} (x) where A_n is not 0. The converse is also true; see Favard's theorem.

Christoffel–Darboux formula

See main article: Christoffel–Darboux formula.

Zeros

If the measure dα is supported on an interval [''a'',&nbsp;''b''], all the zeros of P_n lie in [''a'',&nbsp;''b'']. Moreover, the zeros have the following interlacing property: if m < n, there is a zero of P_n between any two zeros of P_m. Electrostatic interpretations of the zeros can be given.

Combinatorial interpretation

From the 1980s, with the work of X. G. Viennot, J. Labelle, Y.-N. Yeh, D. Foata, and others, combinatorial interpretations were found for all the classical orthogonal polynomials. ^[3]

Other types of orthogonal polynomials

Multivariate orthogonal polynomials

The Macdonald polynomials are orthogonal polynomials in several variables, depending on the choice of an affine root system. They include many other families of multivariable orthogonal polynomials as special cases, including the Jack polynomials, the Hall–Littlewood polynomials, the Heckman–Opdam polynomials, and the Koornwinder polynomials. The Askey–Wilson polynomials are the special case of Macdonald polynomials for a certain non-reduced root system of rank 1.

Multiple orthogonal polynomials

See main article: Multiple orthogonal polynomials. Multiple orthogonal polynomials are polynomials in one variable that are orthogonal with respect to a finite family of measures.

Sobolev orthogonal polynomials

See main article: Sobolev orthogonal polynomials. These are orthogonal polynomials with respect to a Sobolev inner product, i.e. an inner product with derivatives. Including derivatives has big consequences for the polynomials, in general they no longer share some of the nice features of the classical orthogonal polynomials.

Orthogonal polynomials with matrices

Orthogonal polynomials with matrices have either coefficients that are matrices or the indeterminate is a matrix.

There are two popular examples: either the coefficients

\{a _{i\}} are matrices or x :

• Variante 1:

P(x) = A ^{n + A} _{n -1} x ^{n-1} + … + A _{1x} + A _{0} , where \{A _{i} \} are p x p matrices.

• Variante 2:

P(X) = a ^{n + a} _{n -1} X ^{n-1} + … + a _{1X} + a _{0I} _{p} where X is a p x p -matrix and I _{p} is the identiy matrix.

Quantum polynomials

Quantum polynomials or q-polynomials are the q-analogs of orthogonal polynomials.

See also

• Appell sequence
• Askey scheme of hypergeometric orthogonal polynomials
• Favard's theorem
• Polynomial sequences of binomial type
• Biorthogonal polynomials
• Generalized Fourier series
• Secondary measure
• Sheffer sequence
• Sturm–Liouville theory
• Umbral calculus
• Plancherel–Rotach asymptotics

References

• • Book: Chihara, Theodore Seio. An Introduction to Orthogonal Polynomials . Gordon and Breach, New York . 1978 . 0-677-04150-0.
• Chihara . Theodore Seio . Proceedings of the Fifth International Symposium on Orthogonal Polynomials, Special Functions and their Applications (Patras, 1999) . 10.1016/S0377-0427(00)00632-4 . 1858267 . 2001 . Journal of Computational and Applied Mathematics . 0377-0427 . 133 . 1 . 45 years of orthogonal polynomials: a view from the wings . 13–21. 2001JCoAM.133...13C . free .
• Foncannon . J. J. . Review of Classical and quantum orthogonal polynomials in one variable by Mourad Ismail . Springer New York . 10.1007/BF02985757 . 2008 . . 0343-6993 . 30 . 54–60 . Foncannon . J. J. . Pekonen . Osmo. 118133026 .
• Book: Ismail, Mourad E. H. . Classical and Quantum Orthogonal Polynomials in One Variable . 2005 . 0-521-78201-5 . Cambridge Univ. Press . Cambridge.
• Book: Jackson, Dunham . Fourier Series and Orthogonal Polynomials . New York . Dover . 1941. 2004 . 0-486-43808-2.
  • • Book: Szegő . Gábor . Orthogonal Polynomials . American Mathematical Society . Colloquium Publications . 978-0-8218-1023-1 . 0372517 . 1939 . XXIII .
• Vilmos. Totik . Vilmos Totik . 2005 . Orthogonal Polynomials . Surveys in Approximation Theory . 1 . 70–125 . math.CA/0512424.
• C. Chan, A. Mironov, A. Morozov, A. Sleptsov, .

Notes and References

1. https://demonstrations.wolfram.com/OrthonormalPolynomialsUnderDifferentInnerProductMeasures/ Demo of orthonormal polynomials obtained for different weight functions
2. Book: Catak . E. . Durak-Ata . L. . 2017 IEEE International Black Sea Conference on Communications and Networking (BlackSeaCom) . An efficient transceiver design for superimposed waveforms with orthogonal polynomials . 2017 . 1–5 . 10.1109/BlackSeaCom.2017.8277657 . 978-1-5090-5049-9 . 22592277 .
3. Web site: Viennot . Xavier . The Art of Bijective Combinatorics, Part IV, Combinatorial theory of orthogonal polynomials and continued fractions. . 2017 . IMSc . Chennai .