Calculus on Euclidean space explained

R ^{n} as well as a finite-dimensional real vector space. This calculus is also known as advanced calculus, especially in the United States. It is similar to multivariable calculus but is somewhat more sophisticated in that it uses linear algebra (or some functional analysis) more extensively and covers some concepts from differential geometry such as differential forms and Stokes' formula in terms of differential forms. This extensive use of linear algebra also allows a natural generalization of multivariable calculus to calculus on Banach spaces or topological vector spaces.

Calculus on Euclidean space is also a local model of calculus on manifolds, a theory of functions on manifolds.

Basic notions

See also: Function of a real variable and Multivariable calculus.

Functions in one real variable

This section is a brief review of function theory in one-variable calculus.

A real-valued function

f : R \to R is continuous at a if it is approximately constant near a ; i.e.,\lim _{h} (f(a + h) - f(a)) = 0 . In contrast, the function f is differentiable at a if it is approximately linear near a ; i.e., there is some real number λ such that\lim _{h} (f(a + h) - f(a) -λ h)/(h) = 0 . (For simplicity, suppose f(a) = 0 . Then the above means that f(a + h) = λ h + g(a, h) where g(a, h) goes to 0 faster than h going to 0 and, in that sense, f(a + h) behaves like λ h .)

The number

λ depends on a and thus is denoted as f'(a) . If f is differentiable on an open interval U and if f' is a continuous function on U , then f is called a C¹ function. More generally, f is called a C^k function if its derivative f' is C^k-1 function. Taylor's theorem states that a C^k function is precisely a function that can be approximated by a polynomial of degree k.

If

f : R \to R is a C¹ function and f'(a) \ne 0 for some a , then either f'(a) > 0 or f'(a) < 0 ; i.e., either f is strictly increasing or strictly decreasing in some open interval containing a. In particular, f : f ^{-1} (U) \to U is bijective for some open interval U containing f(a) . The inverse function theorem then says that the inverse function f ^{-1} is differentiable on U with the derivatives: for y \in U (f ^{-1} )'(y) = { 1 \over f'(f ^{-1} (y))}.

Derivative of a map and chain rule

For functions

f defined in the plane or more generally on an Euclidean space R ^{n} , it is necessary to consider functions that are vector-valued or matrix-valued. It is also conceptually helpful to do this in an invariant manner (i.e., a coordinate-free way). Derivatives of such maps at a point are then vectors or linear maps, not real numbers.

Let

f : X \to Y be a map from an open subset X of R ^{n} to an open subset Y of R ^{m} . Then the map f is said to be differentiable at a point x in X if there exists a (necessarily unique) linear transformation f'(x) : R ^{n} \to R ^{m} , called the derivative of f at x , such that\lim (1)/(|h|) |f(x + h) - f(x) - f'(x)h| = 0 where f'(x)h is the application of the linear transformation f'(x) to h . If f is differentiable at x , then it is continuous at x since|f(x + h) - f(x)| \le (|h| ^{-1} |f(x + h) - f(x) - f'(x)h|) |h| + |f'(x)h| \to 0 as h \to 0 .

As in the one-variable case, there is

This is proved exactly as for functions in one variable. Indeed, with the notation

\widetilde{h} = f(x + h) - f(x) , we have:\begin{align} & (1)/(|h|) |g(f(x + h)) - g(y) - g'(y) f'(x) h| \\ & \le (1)/(|h|) |g(y + \widetilde{h}) - g(y) - g'(y)\widetilde{h}| + (1)/(|h|) |g'(y)(f(x + h) - f(x) - f'(x) h)|. \end{align} Here, since f is differentiable at x , the second term on the right goes to zero as h \to 0 . As for the first term, it can be written as:\begin{cases} (|\widetilde{h)/(|}{|h|}) |g(y + \widetilde{h}) - g(y) - g'(y)\widetilde{h}|/|\widetilde{h}|, & \widetilde{h} ≠ 0 , \\ 0 , & \widetilde{h} = 0 . \end{cases} Now, by the argument showing the continuity of f at x , we see (|\widetilde{h)/(|}{|h|}) is bounded. Also, \widetilde{h} \to 0 as h \to 0 since f is continuous at x . Hence, the first term also goes to zero as h \to 0 by the differentiability of g at y . \square

The map

f as above is called continuously differentiable or C ^{1} if it is differentiable on the domain and also the derivatives vary continuously; i.e., x \mapsto f'(x) is continuous.

As a linear transformation,

f'(x) is represented by an m x n -matrix, called the Jacobian matrix Jf(x) of f at x and we write it as:(Jf)(x) = \begin{bmatrix} (\partial f _{1})/(\partial x _{1}) (x) & … & (\partial f _{1})/(\partial x _{n}) (x) \\ \vdots & \ddots & \vdots \\ (\partial f _{m})/(\partial x _{1}) (x) & … & (\partial f _{m})/(\partial x _{n}) (x) \end{bmatrix}.

Taking

h to be h e _{j} , h a real number and e _{j} = ( 0 , … , 1 , … , 0 ) the j-th standard basis element, we see that the differentiability of f at x implies:\lim _{h} (f _{i(x} + h e _{j)} - f _{i(x)})/(h) = (\partial f _{i})/(\partial x _{j}) (x) where f _{i} denotes the i-th component of f . That is, each component of f is differentiable at x in each variable with the derivative (\partial f _{i})/(\partial x _{j}) (x) . In terms of Jacobian matrices, the chain rule says J(g \circ f)(x) = Jg(y) Jf(x) ; i.e., as (g \circ f) _{i} = g _{i} \circ f ,(\partial (g _{i} \circ f))/(\partial x _{j}) (x) = (\partial g _{i})/(\partial y _{1}) (y) (\partial f _{1})/(\partial x _{j}) (x) + … + (\partial g _{i})/(\partial y _{m}) (y) (\partial f _{m})/(\partial x _{j}) (x), which is the form of the chain rule that is often stated.

A partial converse to the above holds. Namely, if the partial derivatives

{\partial f _{i}/{\partial} x _{j}} are all defined and continuous, then f is continuously differentiable. This is a consequence of the mean value inequality:

(This version of mean value inequality follows from mean value inequality in applied to the function

[ 0 , 1 ] \to R ^{m,} t \mapsto f(x + ty) - tv , where the proof on mean value inequality is given.)

Indeed, let

g(x) = (Jf)(x) . We note that, if y = y _{i} e _{i} , then(d)/(dt) f(x + ty) = (\partial f)/(\partial x _{i}) (x + ty)y = g(x + ty)(y _{i} e _{i).} For simplicity, assume n = 2 (the argument for the general case is similar). Then, by mean value inequality, with the operator norm \| ⋅ \| ,\begin{align} &|\Delta _{y} f (x) - g(x)y| \\ &\le |\Delta _{y _{1} e _{1}} f(x _{1,} x _{2} + y _{2)} - g(x)(y _{1} e _{1)|} + |\Delta _{y _{2} e _{2}} f(x _{1,} x _{2)} - g(x)(y _{2} e _{2)|} \\ &\le |y _{1|} \sup _{0} \|g(x _{1} + t y _{1,} x _{2} + y _{2)} - g(x)\| + |y _{2|} \sup _{0} \|g(x _{1,} x _{2} + ty _{2)} - g(x)\|, \end{align} which implies |\Delta _{y} f (x) - g(x)y|/|y| \to 0 as required. \square

Example: Let

U be the set of all invertible real square matrices of size n. Note U can be identified as an open subset of R ^{n ^{2}} with coordinates x _{ij} , 0 \le i, j \ne n . Consider the function f(g) = g ^{-1} = the inverse matrix of g defined on U . To guess its derivatives, assume f is differentiable and consider the curve c(t) = ge ^{tg ^{-1} h} where e ^{A} means the matrix exponential of A . By the chain rule applied to f(c(t)) = e ^{- t g ^{-1} h} g ^{-1} , we have:f'(c(t)) \circ c'(t) = - g ^{-1} h e ^{- t g ^{-1} h} g ^{-1} .Taking t = 0 , we get:f'(g) h = - g ^{-1} h g ^{-1} .Now, we then have:\|(g + h) ^{-1} - g ^{-1} + g ^{-1} h g ^{-1} \| \le \| (g + h) ^{-1} \| \|h\| \|g ^{-1} h g ^{-1} \|. Since the operator norm is equivalent to the Euclidean norm on R ^{n ^{2}} (any norms are equivalent to each other), this implies f is differentiable. Finally, from the formula for f' , we see the partial derivatives of f are smooth (infinitely differentiable); whence, f is smooth too.

Higher derivatives and Taylor formula

If

f : X \to R ^{m} is differentiable where X \subset R ^{n} is an open subset, then the derivatives determine the map f' : X \to \operatorname{Hom}( R ^{n,} R ^{m)} , where \operatorname{Hom} stands for homomorphisms between vector spaces; i.e., linear maps. If f' is differentiable, then f'' : X \to \operatorname{Hom}( R ^{n,} \operatorname{Hom}( R ^{n,} R ^{m))} . Here, the codomain of f'' can be identified with the space of bilinear maps by:\operatorname{Hom}( R ^{n,} \operatorname{Hom}( R ^{n,} R ^{m))} \overset{\varphi}\underset{\sim}\to \{ ( R ^{n)} ^{2} \to R ^{m} bilinear \} where \varphi(g)(x, y) = g(x)y and \varphi is bijective with the inverse \psi given by (\psi(g)x)y = g(x, y) . In general, f ^{(k)} = (f ^{(k-1)} )' is a map from X to the space of k -multilinear maps ( R ^{n)} ^{k} \to R ^{m} .

Just as

f'(x) is represented by a matrix (Jacobian matrix), when m = 1 (a bilinear map is a bilinear form), the bilinear form f''(x) is represented by a matrix called the Hessian matrix of f at x ; namely, the square matrix H of size n such that f''(x)(y, z) = (Hy, z) , where the paring refers to an inner product of R ^{n} , and H is none other than the Jacobian matrix of f' : X \to ( R ^{n)} ^{*} \simeq R ^{n} . The (i, j) -th entry of H is thus given explicitly as H _{ij} = (\partial ^{2} f)/(\partial x _{i} \partial x _{j}) (x) .

Moreover, if

f'' exists and is continuous, then the matrix H is symmetric, the fact known as the symmetry of second derivatives. This is seen using the mean value inequality. For vectors u, v in R ^{n} , using mean value inequality twice, we have:|\Delta _{v} \Delta _{u} f(x) - f''(x)(u, v)| \le \sup _{0 < t _{1,} t _{2} < 1} | f''(x + t _{1} u + t _{2} v)(u, v) - f''(x)(u, v) |, which saysf''(x)(u, v) = \lim _{s,} (\Delta _{tv} \Delta _{su} f(x) - f(x))/(st). Since the right-hand side is symmetric in u, v , so is the left-hand side: f''(x)(u, v) = f''(x)(v, u) . By induction, if f is C ^{k} , then the k-multilinear map f ^{(k)} (x) is symmetric; i.e., the order of taking partial derivatives does not matter.

As in the case of one variable, the Taylor series expansion can then be proved by integration by parts:

f(z + (h,k)) = \sum _{a+b<n} \partial ^{b} _{y} f(z){h ^{a} k ^{b\over} a! b!} + n\int ^{1} _{0} ( 1- t) ^{n-1} \sum _{a+b=n} \partial ^{b} _{y} f(z + t(h,k)){h ^{a} k ^{b\over} a! b!} dt.

Taylor's formula has an effect of dividing a function by variables, which can be illustrated by the next typical theoretical use of the formula.

Example: Let

T : l{S} \to l{S} be a linear map between the vector space l{S} of smooth functions on R ^{n} with rapidly decreasing derivatives; i.e., \sup |x ^{\beta} \partial ^{\alpha} \varphi| < inf ty for any multi-index \alpha, \beta . (The space l{S} is called a Schwartz space.) For each \varphi in l{S} , Taylor's formula implies we can write:\varphi - \psi \varphi(y) = \sum ^{n} _{j =1} (x _{j} - y _{j)} \varphi _{j} with \varphi _{j} \in l{S} , where \psi is a smooth function with compact support and \psi(y) = 1 . Now, assume T commutes with coordinates; i.e., T (x _{j} \varphi) = x _{j} T\varphi . ThenT\varphi - \varphi(y) T\psi = \sum ^{n} _{j =1} (x _{j} - y _{j)} T\varphi _{j} .Evaluating the above at y , we get T\varphi(y) = \varphi(y) T\psi(y). In other words, T is a multiplication by some function m ; i.e., T\varphi = m \varphi . Now, assume further that T commutes with partial differentiations. We then easily see that m is a constant; T is a multiplication by a constant.

(Aside: the above discussion almost proves the Fourier inversion formula. Indeed, let

F, R : l{S} \to l{S} be the Fourier transform and the reflection; i.e., (R \varphi)(x) = \varphi( - x) . Then, dealing directly with the integral that is involved, one can see T = RF ^{2} commutes with coordinates and partial differentiations; hence, T is a multiplication by a constant. This is almost a proof since one still has to compute this constant.)

A partial converse to the Taylor formula also holds; see Borel's lemma and Whitney extension theorem.

Inverse function theorem and submersion theorem

A

C ^{k} -map with the C ^{k} -inverse is called a C ^{k} -diffeomorphism. Thus, the theorem says that, for a map f satisfying the hypothesis at a point x , f is a diffeomorphism near x, f(x). For a proof, see .

The implicit function theorem says: given a map

f : R ^{n} x R ^{m} \to R ^{m} , if f(a, b) = 0 , f is C ^{k} in a neighborhood of (a, b) and the derivative of y \mapsto f(a, y) at b is invertible, then there exists a differentiable map g : U \to V for some neighborhoods U, V of a, b such that f(x, g(x)) = 0 . The theorem follows from the inverse function theorem; see .

Another consequence is the submersion theorem.

Integrable functions on Euclidean spaces

A partition of an interval

[a, b] is a finite sequence a = t _{0} \le t _{1} \le … \le t _{k} = b . A partition P of a rectangle D (product of intervals) in R ^{n} then consists of partitions of the sides of D ; i.e., if D = \prod ^{n} _{1} [a _{i,} b _{i]} , then P consists of P _{1,} ... , P _{n} such that P _{i} is a partition of [a _{i,} b _{i]} .

Given a function

f on D , we then define the upper Riemann sum of it as:U(f, P) = \sum _{Q} (\sup _{Q} f) \operatorname{vol}(Q) whereQ is a partition element of P ; i.e., Q = \prod ^{n} _{i =1} [t _{i, j _{i}} , t _{i, j _{i+1}} ] when P _{i} : a _{i} = t _{i,} \le ... … \le t _{i, k _{i}} = b _{i} is a partition of [a _{i,} b _{i]} .

• The volume

\operatorname{vol}(Q) of Q is the usual Euclidean volume; i.e., \operatorname{vol}(Q) = \prod ^{n} _{1} (t _{i, j _{i+1}} - t _{i, j _{i}} ) .The lower Riemann sum L(f, P) of f is then defined by replacing \sup by inf . Finally, the function f is called integrable if it is bounded and \sup \{ L(f, P) \mid P \} = inf \{ U(f, P) \mid P \} . In that case, the common value is denoted as \int _{D} f dx .

A subset of

R ^{n} is said to have measure zero if for each \epsilon > 0 , there are some possibly infinitely many rectangles D _{1,} D _{2,} ... , whose union contains the set and \sum _{i} \operatorname{vol}(D _{i)} < \epsilon.

A key theorem is

The next theorem allows us to compute the integral of a function as the iteration of the integrals of the function in one-variables:

In particular, the order of integrations can be changed.

Finally, if

M \subset R ^{n} is a bounded open subset and f a function on M , then we define \int _{M} f dx : = \int _{D} \chi _{M} f dx where D is a closed rectangle containing M and \chi _{M} is the characteristic function on M ; i.e., \chi _{M(x)} = 1 if x \in M and =0 if x \not\in M, provided \chi _{M} f is integrable.

Surface integral

If a bounded surface

M in R ^{3} is parametrized by bf{r} = bf{r}(u, v) with domain D , then the surface integral of a measurable function F on M is defined and denoted as:\int _{M} F dS : = \int \int _{D} (F \circ bf{r}) | bf{r} _{u} x bf{r} _{v} | du dv If F : M \to R ^{3} is vector-valued, then we define\int _{M} F ⋅ dS : = \int _{M} (F ⋅ bf{n}) dS where bf{n} is an outward unit normal vector to M . Since bf{n} = (bf{r)/(_{u}) x bf{r} _{v}{|bf{r}} _{u} x bf{r} _{v|}} , we have:\int _{M} F ⋅ dS = \int \int _{D} (F \circ bf{r}) ⋅ ( bf{r} _{u} x bf{r} _{v)} du dv = \int \int _{D} \det(F \circ bf{r}, bf{r} _{u,} bf{r} _{v)} dudv.

Vector analysis

Tangent vectors and vector fields

Let

c : [ 0 , 1 ] \to R ^{n} be a differentiable curve. Then the tangent vector to the curve c at t is a vector v at the point c(t) whose components are given as:v = (c _{1'(t),} ... , c _{n'(t))} .

For example, if

c(t) = (a \cos(t), a \sin(t), bt), a > 0 , b > 0 is a helix, then the tangent vector at t is:c'(t) = ( - a \sin(t), a \cos(t), b). It corresponds to the intuition that the a point on the helix moves up in a constant speed.

If

M \subset R ^{n} is a differentiable curve or surface, then the tangent space to M at a point p is the set of all tangent vectors to the differentiable curves c: [ 0 , 1 ] \to M with c( 0 ) = p .

A vector field X is an assignment to each point p in M a tangent vector

X _{p} to M at p such that the assignment varies smoothly.

Differential forms

The dual notion of a vector field is a differential form. Given an open subset

M in R ^{n} , by definition, a differential 1-form (often just 1-form) \omega is an assignment to a point p in M a linear functional \omega _{p} on the tangent space T _{p} M to M at p such that the assignment varies smoothly. For a (real or complex-valued) smooth function f , define the 1-form df by: for a tangent vector v at p ,df _{p(v)} = v(f) where v(f) denotes the directional derivative of f in the direction v at p . For example, if x _{i} is the i -th coordinate function, then dx _{i,} (v) = v _{i} ; i.e., dx _{i,p} are the dual basis to the standard basis on T _{p} M . Then every differential 1-form \omega can be written uniquely as\omega = f _{1} dx _{1} + … + f _{n} dx _{n} for some smooth functions f _{1,} ... , f _{n} on M (since, for every point p , the linear functional \omega _{p} is a unique linear combination of dx _{i} over real numbers). More generally, a differential k-form is an assignment to a point p in M a vector \omega _{p} in the k -th exterior power w edge ^{k} T ^{*} _{p} M of the dual space T ^{*} _{p} M of T _{p} M such that the assignment varies smoothly. In particular, a 0-form is the same as a smooth function. Also, any k -form \omega can be written uniquely as:\omega = \sum _{i _{1} < … < i _{k}} f _{i _{1} ... i _{k}} dx _{i _{1}} \wedge … \wedge dx _{i _{k}} for some smooth functions f _{i _{1} ... i _{k}} .

Like a smooth function, we can differentiate and integrate differential forms. If

f is a smooth function, then df can be written as:df = \sum ^{n} _{i =1} (\partial f)/(\partial x _{i}) dx _{i} since, for v = \partial / \partial x _{j} | _{p} , we have: df _{p(v)} = (\partial f)/(\partial x _{j}) (p) = \sum ^{n} _{i =1} (\partial f)/(\partial x _{i}) (p) dx _{i(v)} . Note that, in the above expression, the left-hand side (whence the right-hand side) is independent of coordinates x _{1,} ... , x _{n} ; this property is called the invariance of differential.

The operation

d is called the exterior derivative and it extends to any differential forms inductively by the requirement (Leibniz rule)d(\alpha \wedge \beta) = d \alpha \wedge \beta + ( -1 ) ^{p} \alpha \wedge d \beta. where \alpha, \beta are a p-form and a q-form.

The exterior derivative has the important property that

d \circ d = 0 ; that is, the exterior derivative d of a differential form d \omega is zero. This property is a consequence of the symmetry of second derivatives (mixed partials are equal).

Boundary and orientation

A circle can be oriented clockwise or counterclockwise. Mathematically, we say that a subset

M of R ^{n} is oriented if there is a consistent choice of normal vectors to M that varies continuously. For example, a circle or, more generally, an n-sphere can be oriented; i.e., orientable. On the other hand, a Möbius strip (a surface obtained by identified by two opposite sides of the rectangle in a twisted way) cannot oriented: if we start with a normal vector and travel around the strip, the normal vector at end will point to the opposite direction.

The proposition is useful because it allows us to give an orientation by giving a volume form.

Integration of differential forms

If

\omega = f dx _{1} \wedge … \wedge dx _{n} is a differential n-form on an open subset M in R ^{n} (any n-form is that form), then the integration of it over M with the standard orientation is defined as:\int _{M} \omega = \int _{M} f dx _{1} … dx _{n.} If M is given the orientation opposite to the standard one, then \int _{M} \omega is defined as the negative of the right-hand side.

Then we have the fundamental formula relating exterior derivative and integration:

Here is a sketch of proof of the formula. If

f is a smooth function on R ^{n} with compact support, then we have:\int d(f \omega) = 0 (since, by the fundamental theorem of calculus, the above can be evaluated on boundaries of the set containing the support.) On the other hand,\int d(f \omega) = \int df \wedge \omega + \int f d\omega. Let f approach the characteristic function on M . Then the second term on the right goes to \int _{M} d \omega while the first goes to - \int _{\partial} \omega , by the argument similar to proving the fundamental theorem of calculus. \square

The formula generalizes the fundamental theorem of calculus as well as Stokes' theorem in multivariable calculus. Indeed, if

M = [a, b] is an interval and \omega = f , then d\omega = f' dx and the formula says:\int _{M} f' dx = f(b) - f(a) .Similarly, if M is an oriented bounded surface in R ^{3} and \omega = fdx + gdy + hdz , then d(fdx) = df \wedge dx = (\partial f)/(\partial y) dy \wedge dx + (\partial f)/(\partial z) dz \wedge dx and similarly for d(gdy) and d(gdy) . Collecting the terms, we thus get:d\omega = \left( (\partial h)/(\partial y) - (\partial g)/(\partial z) \right) dy \wedge dz + \left( (\partial f)/(\partial z) - (\partial h)/(\partial x) \right) dz \wedge dx + \left( (\partial g)/(\partial x) - (\partial f)/(\partial y) \right) dx \wedge dy. Then, from the definition of the integration of \omega , we have \int _{M} d \omega = \int _{M} (\nabla x F) ⋅ dS where F = (f, g, h) is the vector-valued function and \nabla = \left( (\partial)/(\partial x) , (\partial)/(\partial y) , (\partial)/(\partial z) \right) . Hence, Stokes’ formula becomes\int _{M} (\nabla x F) ⋅ dS = \int _{\partial} (fdx + gdy + hdz), which is the usual form of the Stokes' theorem on surfaces. Green’s theorem is also a special case of Stokes’ formula.

Stokes' formula also yields a general version of Cauchy's integral formula. To state and prove it, for the complex variable

z = x + iy and the conjugate \bar z , let us introduce the operators(\partial)/(\partial z) = (1)/(2) \left( (\partial)/(\partial x) - i (\partial)/(\partial y) \right), (\partial)/(\partial \bar{z) } = \frac\left(\frac + i \frac \right).In these notations, a function f is holomorphic (complex-analytic) if and only if (\partial f)/(\partial \bar z) = 0 (the Cauchy–Riemann equations).Also, we have:df = (\partial f)/(\partial z) dz + (\partial f)/(\partial \bar{z) }d \bar.Let D _{\epsilon} = \{ z \in C \mid \epsilon < |z - z _{0|} < r \} be a punctured disk with center z _{0} .Since 1 /(z - z _{0)} is holomorphic on D _{\epsilon} , We have:d \left( (f)/(z - z _{0}) dz \right) = (\partial f)/(\partial \bar z) (d \bar{z)/(\wedge) dz}{z - z _{0}} .

By Stokes’ formula,

\int _{D _{\epsilon}} (\partial f)/(\partial \bar z) (d \bar{z)/(\wedge) dz}{z - z _{0}} = \left( \int _{|z - z _{0|} = r} - \int _{|z - z _{0|} = \epsilon} \right) (f)/(z - z _{0}) dz. Letting \epsilon \to 0 we then get:^[1] 2 \pi i f(z _{0)} = \int _{|z - z _{0|} = r} (f)/(z - z _{0}) dz + \int _{|z - z _{0|} \le r} (\partial f)/(\partial \bar z) (dz \wedge d \bar z)/(z - z _{0}) .

Winding numbers and Poincaré lemma

A differential form

\omega is called closed if d\omega = 0 and is called exact if \omega = d η for some differential form η (often called a potential). Since d \circ d = 0 , an exact form is closed. But the converse does not hold in general; there might be a non-exact closed form. A classic example of such a form is:\omega = (- y)/(x ^{2} + y ^{2}) + (x)/(x ^{2} + y ^{2}) ,which is a differential form on R ^{2} - 0 . Suppose we switch to polar coordinates: x = r \cos \theta, y = r \sin \theta where r = \sqrt{x ^{2} + y ^{2}} . Then\omega = r ^{-2} ( - r \sin \theta dx + r \cos \theta dy) = d \theta. This does not show that \omega is exact: the trouble is that \theta is not a well-defined continuous function on R ^{2} - 0 . Since any function f on R ^{2} - 0 with df = \omega differ from \theta by constant, this means that \omega is not exact. The calculation, however, shows that \omega is exact, for example, on R ^{2} - \{ x = 0 \} since we can take \theta = \arctan(y/x) there.

There is a result (Poincaré lemma) that gives a condition that guarantees closed forms are exact. To state it, we need some notions from topology. Given two continuous maps

f, g : X \to Y between subsets of R ^{m,} R ^{n} (or more generally topological spaces), a homotopy from f to g is a continuous function H : X x [ 0 , 1 ] \to Y such that f(x) = H(x, 0 ) and g(x) = H(x, 1 ) . Intuitively, a homotopy is a continuous variation of one function to another. A loop in a set X is a curve whose starting point coincides with the end point; i.e., c : [ 0 , 1 ] \to X such that c( 0 ) = c( 1 ) . Then a subset of R ^{n} is called simply connected if every loop is homotopic to a constant function. A typical example of a simply connected set is a disk D = \{ (x, y) \mid \sqrt{x ^{2} + y ^{2}} \le r \} \subset R ^{2} . Indeed, given a loop c : [ 0 , 1 ] \to D , we have the homotopy H : [ 0 , 1 ] ^{2} \to D, H(x, t) = ( 1- t) c(x) + t c( 0 ) from c to the constant function c( 0 ) . A punctured disk, on the other hand, is not simply connected.

Geometry of curves and surfaces

Moving frame

Vector fields

E _{1,} ... , E _{3} on R ^{3} are called a frame field if they are orthogonal to each other at each point; i.e., E _{i} ⋅ E _{j} = \delta _{ij} at each point. The basic example is the standard frame U _{i} ; i.e., U _{i(x)} is a standard basis for each point x in R ^{3} . Another example is the cylindrical frameE _{1} = \cos \theta U _{1} + \sin \theta U _{2,} E _{2} = - \sin \theta U _{1} + \cos \theta U _{2,} E _{3} = U _{3.} T, N, B on a unit-speed curve \beta : I \to R ^{3} given as:

The Gauss–Bonnet theorem

The Gauss–Bonnet theorem relates the topology of a surface and its geometry.

Calculus of variations

Method of Lagrange multiplier

The set

g ^{-1} ( 0 ) is usually called a constraint.

Example: Suppose we want to find the minimum distance between the circle

x ^{2} + y ^{2} = 1 and the line x + y = 4 . That means that we want to minimize the function f(x, y, u, v) = (x - u) ^{2} + (y - v) ^{2} , the square distance between a point (x, y) on the circle and a point (u, v) on the line, under the constraint g = (x ^{2} + y ^{2} - 1 , u + v - 4 ) . We have:\nabla f = ( 2 (x - u), 2 (y - v), -2 (x - u), -2 (y - v)). \nabla g _{1} = ( 2 x, 2 y, 0 , 0 ), \nabla g _{2} = ( 0 , 0 , 1 , 1 ). Since the Jacobian matrix of g has rank 2 everywhere on g ^{-1} ( 0 ) , the Lagrange multiplier gives:x - u = λ _{1} x, y - v = λ _{1} y, 2 (x - u) = -λ _{2,} 2 (y - v) = -λ _{2.} If λ _{1} = 0 , then x = u, y = v , not possible. Thus, λ _{1} \ne 0 andx = (x - u)/(λ _{1}) , y = (y - v)/(λ _{1}) . From this, it easily follows that x = y = 1 /\sqrt{ 2 } and u = v = 2 . Hence, the minimum distance is 2 \sqrt{ 2 } - 1 (as a minimum distance clearly exists).

Here is an application to linear algebra. Let

V be a finite-dimensional real vector space and T : V \to V a self-adjoint operator. We shall show V has a basis consisting of eigenvectors of T (i.e., T is diagonalizable) by induction on the dimension of V . Choosing a basis on V we can identify V = R ^{n} and T is represented by the matrix [a _{ij} ] . Consider the function f(x) = (Tx, x) , where the bracket means the inner product. Then \nabla f = 2 (\sum a _{1i} x _{i,} ... , \sum a _{ni} x _{i)} . On the other hand, for g = \sum x ^{2} _{i} - 1 , since g ^{-1} ( 0 ) is compact, f attains a maximum or minimum at a point u in g ^{-1} ( 0 ) . Since \nabla g = 2 (x _{1,} ... , x _{n)} , by Lagrange multiplier, we find a real number λ such that 2 \sum _{i} a _{ji} u _{i} = 2 λ u _{j,} 1 \le j \le n. But that means Tu = λ u . By inductive hypothesis, the self-adjoint operator T : W \to W , W the orthogonal complement to u , has a basis consisting of eigenvectors. Hence, we are done. \square .

Weak derivatives

Up to measure-zero sets, two functions can be determined to be equal or not by means of integration against other functions (called test functions). Namely, the following sometimes called the fundamental lemma of calculus of variations:

Given a continuous function

f , by the lemma, a continuously differentiable function u is such that (\partial u)/(\partial x _{i}) = f if and only if\int (\partial u)/(\partial x _{i}) \varphi dx = \int f \varphi dx for every \varphi \in C ^{inf ty} _{c} (M) . But, by integration by parts, the partial derivative on the left-hand side of u can be moved to that of \varphi ; i.e., - \int u (\partial \varphi)/(\partial x _{i}) dx = \int f \varphi dx where there is no boundary term since \varphi has compact support. Now the key point is that this expression makes sense even if u is not necessarily differentiable and thus can be used to give sense to a derivative of such a function.

Note each locally integrable function

u defines the linear functional \varphi \mapsto \int u \varphi dx on C ^{inf ty} _{c} (M) and, moreover, each locally integrable function can be identified with such linear functional, because of the early lemma. Hence, quite generally, if u is a linear functional on C ^{inf ty} _{c} (M) , then we define (\partial u)/(\partial x _{i}) to be the linear functional \varphi \mapsto - \left \langle u, (\partial \varphi)/(\partial x _{i}) \right\rangle where the bracket means \langle \alpha, \varphi \rangle = \alpha(\varphi) . It is then called the weak derivative of u with respect to x _{i} . If u is continuously differentiable, then the weak derivate of it coincides with the usual one; i.e., the linear functional (\partial u)/(\partial x _{i}) is the same as the linear functional determined by the usual partial derivative of u with respect to x _{i} . A usual derivative is often then called a classical derivative. When a linear functional on C ^{inf ty} _{c} (M) is continuous with respect to a certain topology on C ^{inf ty} _{c} (M) , such a linear functional is called a distribution, an example of a generalized function.H , the characteristic function on the interval ( 0 , inf ty) . For every test function \varphi , we have:\langle H', \varphi \rangle = - \int ^{inf ty} _{0} \varphi' dx = \varphi( 0 ). Let \delta _{a} denote the linear functional \varphi \mapsto \varphi(a) , called the Dirac delta function (although not exactly a function). Then the above can be written as:H' = \delta _{0.}

Cauchy's integral formula has a similar interpretation in terms of weak derivatives. For the complex variable

z = x + iy , let E _{z _{0}} (z) = (1)/(\pi (z - z _{0)}) . For a test function \varphi , if the disk | z - z _{0} | \le r contains the support of \varphi , by Cauchy's integral formula, we have:\varphi(z _{0)} = { 1 \over 2 \pi i} \int (\partial \varphi)/(\partial \bar z) (dz \wedge d \bar z)/(z - z _{0}) . Since dz \wedge d \bar z = -2 i dx \wedge dy , this means:\varphi(z _{0)} = - \int E _{z _{0}} (\partial \varphi)/(\partial \bar z) dxdy = \left\langle (\partial E _{z _{0}})/(\partial \bar z) , \varphi \right \rangle, or(\partial E _{z _{0}})/(\partial \bar z) = \delta _{z _{0}} . In general, a generalized function is called a fundamental solution for a linear partial differential operator if the application of the operator to it is the Dirac delta. Hence, the above says E _{z _{0}} is the fundamental solution for the differential operator \partial/\partial \bar z .

See also: Limit of distributions.

Hamilton–Jacobi theory

See main article: Hamilton–Jacobi equation.

Calculus on manifolds

Definition of a manifold

This section requires some background in general topology.

A manifold is a Hausdorff topological space that is locally modeled by an Euclidean space. By definition, an atlas of a topological space

M is a set of maps \varphi _{i} : U _{i} \to R ^{n} , called charts, such thatU _{i} are an open cover of M ; i.e., each U _{i} is open and M = \cup _{i} U _{i} ,\varphi _{i} : U _{i} \to \varphi _{i(U} _{i)} is a homeomorphism and\varphi _{j} \circ \varphi ^{-1} _{i} : \varphi _{i(U} _{i} \cap U _{j)} \to \varphi _{j(U} _{i} \cap U _{j)} is smooth; thus a diffeomorphism.By definition, a manifold is a second-countable Hausdorff topological space with a maximal atlas (called a differentiable structure); "maximal" means that it is not contained in strictly larger atlas. The dimension of the manifold M is the dimension of the model Euclidean space R ^{n} ; namely, n and a manifold is called an n-manifold when it has dimension n. A function on a manifold M is said to be smooth if f| _{U} \circ \varphi ^{-1} is smooth on \varphi(U) for each chart \varphi : U \to R ^{n} in the differentiable structure.

A manifold is paracompact; this has an implication that it admits a partition of unity subordinate to a given open cover.

If

R ^{n} is replaced by an upper half-space H ^{n} , then we get the notion of a manifold-with-boundary. The set of points that map to the boundary of H ^{n} under charts is denoted by \partial M and is called the boundary of M . This boundary may not be the topological boundary of M . Since the interior of H ^{n} is diffeomorphic to R ^{n} , a manifold is a manifold-with-boundary with empty boundary.

The next theorem furnishes many examples of manifolds.

For example, for

g(x) = x ^{2} _{1} + … + x ^{2} _{n +1} - 1 , the derivative g'(x) = \begin{bmatrix} 2 x _{1} & 2 x _{2} & … & 2 x _{n+1} \end{bmatrix} has rank one at every point p in g ^{-1} ( 0 ) . Hence, the n-sphere g ^{-1} ( 0 ) is an n-manifold.

The theorem is proved as a corollary of the inverse function theorem.

Many familiar manifolds are subsets of

R ^{n} . The next theoretically important result says that there is no other kind of manifolds. An immersion is a smooth map whose differential is injective. An embedding is an immersion that is homeomorphic (thus diffeomorphic) to the image.

The proof that a manifold can be embedded into

R ^{N} for some N is considerably easier and can be readily given here. It is known that a manifold has a finite atlas \{ \varphi _{i} : U _{i} \to R ^{n} \mid 1 \le i \le r \} . Let λ _{i} be smooth functions such that \operatorname{Supp}( λ _{i)} \subset U _{i} and \{ λ _{i} = 1 \} cover M (e.g., a partition of unity). Consider the mapf = ( λ _{1} \varphi _{1,} ... , λ _{r} \varphi _{r,} λ _{1,} ... , λ _{r)} : M \to R ^{(k+1)r} It is easy to see that f is an injective immersion. It may not be an embedding. To fix that, we shall use:(f, g) : M \to R ^{(k+1)r+1} where g is a smooth proper map. The existence of a smooth proper map is a consequence of a partition of unity. See http://math.uchicago.edu/~may/REU2019/REUPapers/Smith,Zoe.pdf for the rest of the proof in the case of an immersion. \square

Nash's embedding theorem says that, if

M is equipped with a Riemannian metric, then the embedding can be taken to be isometric with an expense of increasing 2 k ; for this, see this T. Tao's blog.

Tubular neighborhood and transversality

A technically important result is:

This can be proved by putting a Riemannian metric on the manifold

M . Indeed, the choice of metric makes the normal bundle \nu _{i} a complementary bundle to TN ; i.e., TM| _{N} is the direct sum of TN and \nu _{N} . Then, using the metric, we have the exponential map \exp : U \to V for some neighborhood U of N in the normal bundle \nu _{N} to some neighborhood V of N in M . The exponential map here may not be injective but it is possible to make it injective (thus diffeomorphic) by shrinking U (for now, see see https://amathew.wordpress.com/2009/11/05/the-tubular-neighborhood-theorem/#more-636).

Integration on manifolds and distribution densities

The starting point for the topic of integration on manifolds is that there is no invariant way to integrate functions on manifolds. This may be obvious if we asked: what is an integration of functions on a finite-dimensional real vector space? (In contrast, there is an invariant way to do differentiation since, by definition, a manifold comes with a differentiable structure). There are several ways to introduce integration theory to manifolds:

• Integrate differential forms.
• Do integration against some measure.
• Equip a manifold with a Riemannian metric and do integration against such a metric.

For example, if a manifold is embedded into an Euclidean space

R ^{n} , then it acquires the Lebesgue measure restricting from the ambient Euclidean space and then the second approach works. The first approach is fine in many situations but it requires the manifold to be oriented (and there is a non-orientable manifold that is not pathological). The third approach generalizes and that gives rise to the notion of a density.

Generalizations

Extensions to infinite-dimensional normed spaces

The notions like differentiability extend to normed spaces.

See also

• Differential geometry of surfaces
• Integration along fibers
• Lusin's theorem
• Density on a manifold

References

• • • • • • • (revised 1990, Jones and Bartlett; reprinted 2014, World Scientific) [this text in particular discusses density]
    • Book: Calculus on Manifolds: A Modern Approach to Classical Theorems of Advanced Calculus . Spivak. Michael. Calculus on Manifolds (book). Benjamin Cummings . 1965 . 0-8053-9021-9 . San Francisco . Michael Spivak .

Notes and References

1. Theorem 1.2.1. in Book: Hörmander, Lars. Lars Hörmander. An Introduction to Complex Analysis in Several Variables. North Holland. Third. 1990. .