Linear map explained
between two
vector spaces that preserves the operations of vector addition and
scalar multiplication. The same names and the same definition are also used for the more general case of
modules over a
ring; see
Module homomorphism.
If a linear map is a bijection then it is called a . In the case where
, a linear map is called a
linear endomorphism. Sometimes the term
refers to this case,
[1] but the term "linear operator" can have different meanings for different conventions: for example, it can be used to emphasize that
and
are
real vector spaces (not necessarily with
), or it can be used to emphasize that
is a
function space, which is a common convention in
functional analysis.
[2] Sometimes the term
linear function has the same meaning as
linear map, while in
analysis it does not.
A linear map from
to
always maps the origin of
to the origin of
. Moreover, it maps
linear subspaces in
onto linear subspaces in
(possibly of a lower
dimension);
[3] for example, it maps a
plane through the
origin in
to either a plane through the origin in
, a
line through the origin in
, or just the origin in
. Linear maps can often be represented as
matrices, and simple examples include
rotation and reflection linear transformations.
In the language of category theory, linear maps are the morphisms of vector spaces, and they form a category equivalent to the one of matrices.
Definition and first consequences
Let
and
be vector spaces over the same
field
. A function
is said to be a
linear map if for any two vectors
and any scalar
the following two conditions are satisfied:
- Additivity / operation of addition
- Homogeneity of degree 1 / operation of scalar multiplication
Thus, a linear map is said to be operation preserving. In other words, it does not matter whether the linear map is applied before (the right hand sides of the above examples) or after (the left hand sides of the examples) the operations of addition and scalar multiplication.
By the associativity of the addition operation denoted as +, for any vectors and scalars the following equality holds:[4] [5] Thus a linear map is one which preserves linear combinations.
Denoting the zero elements of the vector spaces
and
by
and
respectively, it follows that
Let
and
in the equation for homogeneity of degree 1:
A linear map
with
viewed as a one-dimensional vector space over itself is called a
linear functional.
[6] These statements generalize to any left-module over a ring
without modification, and to any right-module upon reversing of the scalar multiplication.
Examples
- A prototypical example that gives linear maps their name is a function
, of which the
graph is a line through the origin.
[7] - More generally, any homothety centered in the origin of a vector space is a linear map (here is a scalar).
- The zero map between two vector spaces (over the same field) is linear.
- The identity map on any module is a linear operator.
- For real numbers, the map is not linear.
- For real numbers, the map is not linear (but is an affine transformation).
- If
is a
real matrix, then
defines a linear map from
to
by sending a
column vector
to the column vector
. Conversely, any linear map between
finite-dimensional vector spaces can be represented in this manner; see the, below.
is a linear map. This result is not necessarily true for complex normed space.
. Indeed,
- An indefinite integral (or antiderivative) with a fixed integration starting point defines a linear map from the space of all real-valued integrable functions on
to the space of all real-valued, differentiable functions on
. Without a fixed starting point, the antiderivative maps to the
quotient space of the differentiable functions by the linear space of constant functions.
and
are finite-dimensional vector spaces over a field, of respective dimensions and, then the function that maps linear maps
to matrices in the way described in (below) is a linear map, and even a
linear isomorphism.
- The expected value of a random variable (which is in fact a function, and as such an element of a vector space) is linear, as for random variables
and
we have
and
, but the
variance of a random variable is not linear.
Linear extensions
Often, a linear map is constructed by defining it on a subset of a vector space and then to the linear span of the domain. Suppose
and
are vector spaces and
is a
function defined on some subset
Then a
of
to
if it exists, is a linear map
defined on
that extends
[8] (meaning that
for all
) and takes its values from the codomain of
When the subset
is a vector subspace of
then a (
-valued) linear extension of
to all of
is guaranteed to exist if (and only if)
is a linear map. In particular, if
has a linear extension to
then it has a linear extension to all of
The map
can be extended to a linear map
F:\operatorname{span}S\toY
if and only if whenever
is an integer,
are scalars, and
are vectors such that
then necessarily
0=c1f\left(s1\right)+ … +cnf\left(sn\right).
If a linear extension of
exists then the linear extension
F:\operatorname{span}S\toY
is unique and
holds for all
and
as above. If
is linearly independent then every function
into any vector space has a linear extension to a (linear) map
(the converse is also true).
For example, if
and
then the assignment
and
can be linearly extended from the linearly independent set of vectors
to a linear map on
\operatorname{span}\{(1,0),(0,1)\}=\R2.
The unique linear extension
is the map that sends
(x,y)=x(1,0)+y(0,1)\in\R2
to
defined on a vector subspace of a real or complex vector space
has a linear extension to all of
Indeed, the
Hahn–Banach dominated extension theorem even guarantees that when this linear functional
is dominated by some given
seminorm
(meaning that
holds for all
in the domain of
) then there exists a linear extension to
that is also dominated by
Matrices
See main article: Transformation matrix.
If
and
are
finite-dimensional vector spaces and a
basis is defined for each vector space, then every linear map from
to
can be represented by a
matrix.
[9] This is useful because it allows concrete calculations. Matrices yield examples of linear maps: if
is a real
matrix, then
describes a linear map
(see
Euclidean space).
Let
be a basis for
. Then every vector
is uniquely determined by the coefficients
in the field
:
If is a linear map,
which implies that the function f is entirely determined by the vectors
. Now let
be a basis for
. Then we can represent each vector
as
Thus, the function
is entirely determined by the values of
. If we put these values into an
matrix
, then we can conveniently use it to compute the vector output of
for any vector in
. To get
, every column
of
is a vector
corresponding to
as defined above. To define it more clearly, for some column
that corresponds to the mapping
,
where
is the matrix of
. In other words, every column
has a corresponding vector
whose coordinates
are the elements of column
. A single linear map may be represented by many matrices. This is because the values of the elements of a matrix depend on the bases chosen.
The matrices of a linear transformation can be represented visually:
- Matrix for relative to :
- Matrix for relative to :
- Transition matrix from to :
- Transition matrix from to :
Such that starting in the bottom left corner and looking for the bottom right corner , one would left-multiply—that is, . The equivalent method would be the "longer" method going clockwise from the same point such that is left-multiplied with , or .
Examples in two dimensions
In two-dimensional space R2 linear maps are described by 2 × 2 matrices. These are some examples:
- rotation
- by 90 degrees counterclockwise:
- by an angle θ counterclockwise:
- reflection
- through the x axis:
- through the y axis:
- through a line making an angle θ with the origin:
- scaling by 2 in all directions:
- horizontal shear mapping:
- skew of the y axis by an angle θ:
- squeeze mapping:
- projection onto the y axis:
If a linear map is only composed of rotation, reflection, and/or uniform scaling, then the linear map is a conformal linear transformation.
Vector space of linear maps
The composition of linear maps is linear: if
and
are linear, then so is their
composition . It follows from this that the
class of all vector spaces over a given field
K, together with
K-linear maps as
morphisms, forms a
category.
The inverse of a linear map, when defined, is again a linear map.
If and are linear, then so is their pointwise sum
, which is defined by
.
If is linear and is an element of the ground field , then the map , defined by , is also linear.
Thus the set of linear maps from to itself forms a vector space over ,[10] sometimes denoted .[11] Furthermore, in the case that , this vector space, denoted , is an associative algebra under composition of maps, since the composition of two linear maps is again a linear map, and the composition of maps is always associative. This case is discussed in more detail below.
Given again the finite-dimensional case, if bases have been chosen, then the composition of linear maps corresponds to the matrix multiplication, the addition of linear maps corresponds to the matrix addition, and the multiplication of linear maps with scalars corresponds to the multiplication of matrices with scalars.
Endomorphisms and automorphisms
See main article: Endomorphism and Automorphism. A linear transformation is an endomorphism of ; the set of all such endomorphisms together with addition, composition and scalar multiplication as defined above forms an associative algebra with identity element over the field (and in particular a ring). The multiplicative identity element of this algebra is the identity map .
An endomorphism of that is also an isomorphism is called an automorphism of . The composition of two automorphisms is again an automorphism, and the set of all automorphisms of forms a group, the automorphism group of which is denoted by or . Since the automorphisms are precisely those endomorphisms which possess inverses under composition, is the group of units in the ring .
If has finite dimension , then is isomorphic to the associative algebra of all matrices with entries in . The automorphism group of is isomorphic to the general linear group of all invertible matrices with entries in .
Kernel, image and the rank–nullity theorem
See main article: Kernel (linear algebra), Image (mathematics) and Rank of a matrix. If is linear, we define the kernel and the image or range of by
is a subspace of and is a subspace of . The following dimension formula is known as the rank–nullity theorem:
The number is also called the rank of and written as , or sometimes, ;[12] [13] the number is called the nullity of and written as or . If and are finite-dimensional, bases have been chosen and is represented by the matrix , then the rank and nullity of are equal to the rank and nullity of the matrix , respectively.
Cokernel
See main article: Cokernel.
A subtler invariant of a linear transformation is the cokernel, which is defined as
This is the dual notion to the kernel: just as the kernel is a subspace of the domain, the co-kernel is a quotient space of the target. Formally, one has the exact sequence
These can be interpreted thus: given a linear equation f(v) = w to solve,
- the kernel is the space of solutions to the homogeneous equation f(v) = 0, and its dimension is the number of degrees of freedom in the space of solutions, if it is not empty;
- the co-kernel is the space of constraints that the solutions must satisfy, and its dimension is the maximal number of independent constraints.
The dimension of the co-kernel and the dimension of the image (the rank) add up to the dimension of the target space. For finite dimensions, this means that the dimension of the quotient space W/f(V) is the dimension of the target space minus the dimension of the image.
As a simple example, consider the map f: R2 → R2, given by f(x, y) = (0, y). Then for an equation f(x, y) = (a, b) to have a solution, we must have a = 0 (one constraint), and in that case the solution space is (x, b) or equivalently stated, (0, b) + (x, 0), (one degree of freedom). The kernel may be expressed as the subspace (x, 0) < V: the value of x is the freedom in a solution – while the cokernel may be expressed via the map W → R, : given a vector (a, b), the value of a is the obstruction to there being a solution.
An example illustrating the infinite-dimensional case is afforded by the map f: R∞ → R∞, with b1 = 0 and bn + 1 = an for n > 0. Its image consists of all sequences with first element 0, and thus its cokernel consists of the classes of sequences with identical first element. Thus, whereas its kernel has dimension 0 (it maps only the zero sequence to the zero sequence), its co-kernel has dimension 1. Since the domain and the target space are the same, the rank and the dimension of the kernel add up to the same sum as the rank and the dimension of the co-kernel (), but in the infinite-dimensional case it cannot be inferred that the kernel and the co-kernel of an endomorphism have the same dimension (0 ≠ 1). The reverse situation obtains for the map h: R∞ → R∞, with cn = an + 1. Its image is the entire target space, and hence its co-kernel has dimension 0, but since it maps all sequences in which only the first element is non-zero to the zero sequence, its kernel has dimension 1.
Index
For a linear operator with finite-dimensional kernel and co-kernel, one may define index as:namely the degrees of freedom minus the number of constraints.
For a transformation between finite-dimensional vector spaces, this is just the difference dim(V) − dim(W), by rank–nullity. This gives an indication of how many solutions or how many constraints one has: if mapping from a larger space to a smaller one, the map may be onto, and thus will have degrees of freedom even without constraints. Conversely, if mapping from a smaller space to a larger one, the map cannot be onto, and thus one will have constraints even without degrees of freedom.
The index of an operator is precisely the Euler characteristic of the 2-term complex 0 → V → W → 0. In operator theory, the index of Fredholm operators is an object of study, with a major result being the Atiyah–Singer index theorem.[14]
Algebraic classifications of linear transformations
No classification of linear maps could be exhaustive. The following incomplete list enumerates some important classifications that do not require any additional structure on the vector space.
Let and denote vector spaces over a field and let be a linear map.
Monomorphism
is said to be injective or a monomorphism if any of the following equivalent conditions are true:
- is one-to-one as a map of sets.
- is monic or left-cancellable, which is to say, for any vector space and any pair of linear maps and, the equation implies .
- is left-invertible, which is to say there exists a linear map such that is the identity map on .
Epimorphism
is said to be surjective or an epimorphism if any of the following equivalent conditions are true:
- is onto as a map of sets.
- is epic or right-cancellable, which is to say, for any vector space and any pair of linear maps and, the equation implies .
- is right-invertible, which is to say there exists a linear map such that is the identity map on .
Isomorphism
is said to be an isomorphism if it is both left- and right-invertible. This is equivalent to being both one-to-one and onto (a bijection of sets) or also to being both epic and monic, and so being a bimorphism.If is an endomorphism, then:
- If, for some positive integer, the -th iterate of,, is identically zero, then is said to be nilpotent.
- If, then is said to be idempotent
- If, where is some scalar, then is said to be a scaling transformation or scalar multiplication map; see scalar matrix.
Change of basis
See main article: Basis (linear algebra) and Change of basis. Given a linear map which is an endomorphism whose matrix is A, in the basis B of the space it transforms vector coordinates [u] as [v] = A[u]. As vectors change with the inverse of B (vectors coordinates are contravariant) its inverse transformation is [v] = B[v'].
Substituting this in the first expressionhence
Therefore, the matrix in the new basis is A′ = B−1AB, being B the matrix of the given basis.
Therefore, linear maps are said to be 1-co- 1-contra-variant objects, or type (1, 1) tensors.
Continuity
See main article: Continuous linear operator and Discontinuous linear map.
A linear transformation between topological vector spaces, for example normed spaces, may be continuous. If its domain and codomain are the same, it will then be a continuous linear operator. A linear operator on a normed linear space is continuous if and only if it is bounded, for example, when the domain is finite-dimensional.[15] An infinite-dimensional domain may have discontinuous linear operators.
An example of an unbounded, hence discontinuous, linear transformation is differentiation on the space of smooth functions equipped with the supremum norm (a function with small values can have a derivative with large values, while the derivative of 0 is 0). For a specific example, converges to 0, but its derivative does not, so differentiation is not continuous at 0 (and by a variation of this argument, it is not continuous anywhere).
Applications
A specific application of linear maps is for geometric transformations, such as those performed in computer graphics, where the translation, rotation and scaling of 2D or 3D objects is performed by the use of a transformation matrix. Linear mappings also are used as a mechanism for describing change: for example in calculus correspond to derivatives; or in relativity, used as a device to keep track of the local transformations of reference frames.
Another application of these transformations is in compiler optimizations of nested-loop code, and in parallelizing compiler techniques.
See also
Bibliography
- Book: Axler, Sheldon Jay. Linear Algebra Done Right. Springer. 2015. 978-3-319-11079-0. 3rd. Sheldon Axler.
- Book: Bronshtein . I. N. . Semendyayev . K. A. . 2004 . . 4th . New York . Springer-Verlag . 3-540-43491-7.
- Book: Halmos, Paul Richard. Finite-Dimensional Vector Spaces. Springer. 1974. 0-387-90093-4. 2nd. Paul Halmos. 1958.
- Book: Horn . Roger A. . Johnson . Charles R. . Matrix Analysis . Second . . 978-0-521-83940-2 . 2013 .
- Book: Katznelson, Yitzhak. A (Terse) Introduction to Linear Algebra. Katznelson. Yonatan R.. American Mathematical Society. 2008. 978-0-8218-4419-9. Yitzhak Katznelson.
- Book: Kubrusly, Carlos. Elements of operator theory. Birkhäuser. Boston. 2001. 978-1-4757-3328-0. 754555941.
- Book: Rudin, Walter. Walter Rudin. 1976. 3rd. Walter Rudin Student Series in Advanced Mathematics. New York. Principles of Mathematical Analysis. McGraw–Hill. 978-0-07-054235-8.
- Book: Tu, Loring W.. An Introduction to Manifolds. Springer. 2011. 978-0-8218-4419-9. 2nd. Loring W. Tu.
Notes and References
- "Linear transformations of into are often called linear operators on ."
- Let and be two real vector spaces. A mapping a from into Is called a 'linear mapping' or 'linear transformation' or 'linear operator' [...] from into, if
for all ,
for all
and all real .
Here are some properties of linear mappings whose proofs are so easy that we omit them; it is assumed that and :
- . Suppose now that and are vector spaces over the same scalar field. A mapping is said to be linear if for all and all scalars and . Note that one often writes , rather than , when is linear.
- . A mapping of a vector space into a vector space is said to be a linear transformation if: for all and all scalars . Note that one often writes instead of if is linear.
- . Linear mappings of onto its scalar field are called linear functionals.
- Web site: terminology - What does 'linear' mean in Linear Algebra?. 2021-02-17. Mathematics Stack Exchange.
- One map
is said to another map
if when
is defined at a point
then so is
and
Suppose and are bases of vector spaces and, respectively. Then every determines a set of numbers such that
It is convenient to represent these numbers in a rectangular array of rows and columns, called an by matrix:
Observe that the coordinates of the vector (with respect to the basis ) appear in the jth column of . The vectors are therefore sometimes called the column vectors of . With this terminology, the range of is spanned by the column vectors of .
- p. 52, § 3.3
- , p. 19, § 3.1
- p. 52, § 2.5.1
- p. 90, § 50
"The main question in index theory is to provide index formulas for classes of Fredholm operators ... Index theory has become a subject on its own only after M. F. Atiyah and I. Singer published their index theorems"
1.18 Theorem Let be a linear functional on a topological vector space . Assume for some . Then each of the following four properties implies the other three: