Microcanonical ensemble explained

In statistical mechanics, the microcanonical ensemble is a statistical ensemble that represents the possible states of a mechanical system whose total energy is exactly specified.^[1] The system is assumed to be isolated in the sense that it cannot exchange energy or particles with its environment, so that (by conservation of energy) the energy of the system does not change with time.

The primary macroscopic variables of the microcanonical ensemble are the total number of particles in the system (symbol:), the system's volume (symbol:), as well as the total energy in the system (symbol:). Each of these is assumed to be constant in the ensemble. For this reason, the microcanonical ensemble is sometimes called the ensemble.

In simple terms, the microcanonical ensemble is defined by assigning an equal probability to every microstate whose energy falls within a range centered at . All other microstates are given a probability of zero. Since the probabilities must add up to 1, the probability is the inverse of the number of microstates within the range of energy,

P = 1 /W, The range of energy is then reduced in width until it is infinitesimally narrow, still centered at . In the limit of this process, the microcanonical ensemble is obtained.^[1]

Applicability

Because of its connection with the elementary assumptions of equilibrium statistical mechanics (particularly the postulate of a priori equal probabilities), the microcanonical ensemble is an important conceptual building block in the theory. It is sometimes considered to be the fundamental distribution of equilibrium statistical mechanics. It is also useful in some numerical applications, such as molecular dynamics.^{[2] [3]} On the other hand, most nontrivial systems are mathematically cumbersome to describe in the microcanonical ensemble, and there are also ambiguities regarding the definitions of entropy and temperature. For these reasons, other ensembles are often preferred for theoretical calculations.^{[4] [5]}

The applicability of the microcanonical ensemble to real-world systems depends on the importance of energy fluctuations, which may result from interactions between the system and its environment as well as uncontrolled factors in preparing the system. Generally, fluctuations are negligible if a system is macroscopically large, or if it is manufactured with precisely known energy and thereafter maintained in near isolation from its environment.^[6] In such cases the microcanonical ensemble is applicable. Otherwise, different ensembles are more appropriate – such as the canonical ensemble (fluctuating energy) or the grand canonical ensemble (fluctuating energy and particle number).

Properties

Thermodynamic quantities

The fundamental thermodynamic potential of the microcanonical ensemble is entropy. There are at least three possible definitions, each given in terms of the phase volume function . In classical mechanics this is the volume of the region of phase space where the energy is less than . In quantum mechanics is roughly the number of energy eigenstates with energy less than ; however this must be smoothed so that we can take its derivative (see the Precise expressions section for details on how this is done). The definitions of microcanonical entropy are:

In the microcanonical ensemble, the temperature is a derived quantity rather than an external control parameter. It is defined as the derivative of the chosen entropy with respect to energy.^[7] For example, one can define the "temperatures" and as follows:

1 /T _{v} = dS _{v/dE,} 1 /T _{s} = dS _{s/dE} = dS _{B/dE.} Like entropy, there are multiple ways to understand temperature in the microcanonical ensemble. More generally, the correspondence between these ensemble-based definitions and their thermodynamic counterparts is not perfect, particularly for finite systems.

The microcanonical pressure and chemical potential are given by:^[8]

(p)/(= T) (\partial S)/(\partial V) ; (\mu)/(=- T) (\partial S)/(\partial N)

Phase transitions

Under their strict definition, phase transitions correspond to nonanalytic behavior in the thermodynamic potential or its derivatives.^[9] Using this definition, phase transitions in the microcanonical ensemble can occur in systems of any size. This contrasts with the canonical and grand canonical ensembles, for which phase transitions can occur only in the thermodynamic limit – i.e., in systems with infinitely many degrees of freedom.^{[9] [10]} Roughly speaking, the reservoirs defining the canonical or grand canonical ensembles introduce fluctuations that "smooth out" any nonanalytic behavior in the free energy of finite systems. This smoothing effect is usually negligible in macroscopic systems, which are sufficiently large that the free energy can approximate nonanalytic behavior exceedingly well. However, the technical difference in ensembles may be important in the theoretical analysis of small systems.^[10]

Information entropy

For a given mechanical system (fixed,) and a given range of energy, the uniform distribution of probability over microstates (as in the microcanonical ensemble) maximizes the ensemble average .^[1]

Thermodynamic analogies

Early work in statistical mechanics by Ludwig Boltzmann led to his eponymous entropy equation for a system of a given total energy,, where is the number of distinct states accessible by the system at that energy. Boltzmann did not elaborate too deeply on what exactly constitutes the set of distinct states of a system, besides the special case of an ideal gas. This topic was investigated to completion by Josiah Willard Gibbs who developed the generalized statistical mechanics for arbitrary mechanical systems, and defined the microcanonical ensemble described in this article.^[1] Gibbs investigated carefully the analogies between the microcanonical ensemble and thermodynamics, especially how they break down in the case of systems of few degrees of freedom. He introduced two further definitions of microcanonical entropy that do not depend on – the volume and surface entropy described above. (Note that the surface entropy differs from the Boltzmann entropy only by an -dependent offset.)

The volume entropy

S _{v} and associated temperature T _{v} are closely analogous to thermodynamic entropy and temperature. It is possible to show exactly thatdE = T _{v} dS _{v} - \langle P\rangle dV, (is the ensemble average pressure) as expected for the first law of thermodynamics. A similar equation can be found for the surface entropy S _{s} (or Boltzmann entropy S _{B} ) and its associated temperature, however the "pressure" in this equation is a complicated quantity unrelated to the average pressure.^[1]

The microcanonical temperatures

T _{v} and T _{s} are not entirely satisfactory in their analogy to temperature as defined using a canonical ensemble. Outside of the thermodynamic limit, a number of artefacts occur.

• Nontrivial result of combining two systems: Two systems, each described by an independent microcanonical ensemble, can be brought into thermal contact and be allowed to equilibriate into a combined system also described by a microcanonical ensemble. Unfortunately, the energy flow between the two systems cannot be predicted based on the initial s. Even when the initial s are equal, there may be energy transferred. Moreover, the of the combination is different from the initial values. This contradicts the intuition that temperature should be an intensive quantity, and that two equal-temperature systems should be unaffected by being brought into thermal contact.^[1]
• Strange behavior for few-particle systems: Many results such as the microcanonical Equipartition theorem acquire a one- or two-degree of freedom offset when written in terms of . For a small systems this offset is significant, and so if we make the analogue of entropy, several exceptions need to be made for systems with only one or two degrees of freedom.^[1]
• Spurious negative temperatures: A negative occurs whenever the density of states is decreasing with energy. In some systems the density of states is not monotonic in energy, and so can change sign multiple times as the energy is increased.^{[11] [12]}

The preferred solution to these problems is avoid use of the microcanonical ensemble. In many realistic cases a system is thermostatted to a heat bath so that the energy is not precisely known. Then, a more accurate description is the canonical ensemble or grand canonical ensemble, both of which have complete correspondence to thermodynamics.^[13]

Precise expressions for the ensemble

The precise mathematical expression for a statistical ensemble depends on the kind of mechanics under consideration – quantum or classical – since the notion of a "microstate" is considerably different in these two cases. In quantum mechanics, diagonalization provides a discrete set of microstates with specific energies. The classical mechanical case involves instead an integral over canonical phase space, and the size of microstates in phase space can be chosen somewhat arbitrarily.

To construct the microcanonical ensemble, it is necessary in both types of mechanics to first specify a range of energy. In the expressions below the function

f\left(\tfrac{H - E}{\omega}\right) (a function of, peaking at with width) will be used to represent the range of energy in which to include states. An example of this function would be^[1] f(x) = \begin{cases} 1 , & if ~|x| < \tfrac 12 , \ 0 , & otherwise. \end{cases} or, more smoothly,f(x) = e ^{- \pi x ^{2}} .

Quantum mechanical

A statistical ensemble in quantum mechanics is represented by a density matrix, denoted by

\hat\rho . The microcanonical ensemble can be written using bra–ket notation, in terms of the system's energy eigenstates and energy eigenvalues. Given a complete basis of energy eigenstates, indexed by, the microcanonical ensemble is\hat\rho = (1)/(W) \sum _{i} f\left(\tfrac{H _{i} - E}{\omega}\right) |\psi _{i\rangle} \langle \psi _{i} |, where the are the energy eigenvalues determined by \hat H |\psi _{i\rangle} = H _{i} |\psi _{i\rangle} (here is the system's total energy operator, i. e., Hamiltonian operator). The value of is determined by demanding that \hat\rho is a normalized density matrix, and soW = \sum _{i} f\left(\tfrac{H _{i} - E}{\omega}\right). The state volume function (used to calculate entropy) is given byv(E) = \sum _{H _{i} < E} 1 .

The microcanonical ensemble is defined by taking the limit of the density matrix as the energy width goes to zero, however a problematic situation occurs once the energy width becomes smaller than the spacing between energy levels. For very small energy width, the ensemble does not exist at all for most values of, since no states fall within the range. When the ensemble does exist, it typically only contains one (or two) states, since in a complex system the energy levels are only ever equal by accident (see random matrix theory for more discussion on this point). Moreover, the state-volume function also increases only in discrete increments, and so its derivative is only ever infinite or zero, making it difficult to define the density of states. This problem can be solved by not taking the energy range completely to zero and smoothing the state-volume function, however this makes the definition of the ensemble more complicated, since it becomes then necessary to specify the energy range in addition to other variables (together, an ensemble).

Classical mechanical

In classical mechanics, an ensemble is represented by a joint probability density function defined over the system's phase space.^[1] The phase space has generalized coordinates called, and associated canonical momenta called .

The probability density function for the microcanonical ensemble is:

\rho = (1)/(h ^{n} C) (1)/(W) f\left(\tfrac{H - E}{\omega}\right), where

• is the total energy (Hamiltonian) of the system, a function of the phase,
• is an arbitrary but predetermined constant with the units of, setting the extent of one microstate and providing correct dimensions to .^[14]
• is an overcounting correction factor, often used for particle systems where identical particles are able to change place with each other.^[15]

Again, the value of is determined by demanding that is a normalized probability density function:

W = \int \ldots \int (1)/(h ^{n} C) f\left(\tfrac{H - E}{\omega}\right) dp _{1} \ldots dq _{n} This integral is taken over the entire phase space. The state volume function (used to calculate entropy) is defined byv(E) = \int \ldots \int _{H} (1)/(h ^{n} C) dp _{1} \ldots dq _{n} .

As the energy width is taken to zero, the value of decreases in proportion to as .

Based on the above definition, the microcanonical ensemble can be visualized as an infinitesimally thin shell in phase space, centered on a constant-energy surface. Although the microcanonical ensemble is confined to this surface, it is not necessarily uniformly distributed over that surface: if the gradient of energy in phase space varies, then the microcanonical ensemble is "thicker" (more concentrated) in some parts of the surface than others. This feature is an unavoidable consequence of requiring that the microcanonical ensemble is a steady-state ensemble.

Examples

Ideal gas

The fundamental quantity in the microcanonical ensemble is

W(E, V, N) , which is equal to the phase space volume compatible with given (E, V, N) . From W , all thermodynamic quantities can be calculated. For an ideal gas, the energy is independent of the particle positions, which therefore contribute a factor of V ^{N} to W . The momenta, by contrast, are constrained to a 3 N -dimensional (hyper-)spherical shell of radius \sqrt{ 2 mE} ; their contribution is equal to the surface volume of this shell. The resulting expression for W is:^[16] W = (V ^{N})/(N!) (2 \pi ^{3N/2})/(\Gamma( 3 N/ 2 )) \left( 2 mE\right) ^{(3N-1)/2} where \Gamma(.) is the gamma function, and the factor N! has been included to account for the indistinguishability of particles (see Gibbs paradox). In the large N limit, the Boltzmann entropy S = k _{B} log W isS = k _{\rm} N log \left[ (VN)/(\left( (4 \pi m)/(3)) (EN\right))/(\right] + { ^{3/2}) (52 })/(k) _{\rm} N + O\left( log N \right) This is also known as the Sackur–Tetrode equation.

The temperature is given by

(1)/(T) \equiv (\partial S)/(\partial E) = (3)/(2) (N k _{B})/(E) which agrees with analogous result from the kinetic theory of gases. Calculating the pressure gives the ideal gas law:(p)/(T) \equiv (\partial S)/(\partial V) = (N k _{B})/(V) → pV = N k _{B} T Finally, the chemical potential \mu is\mu \equiv - T (\partial S)/(\partial N) = k _{\rm} T log \left[ (V)/(N) \left( (4 \pi m E)/(3 N) \right) ^{3/2} \right]

Ideal gas in a uniform gravitational field

The microcanonical phase volume can also be calculated explicitly for an ideal gas in a uniform gravitational field.^[17]

The results are stated below for a 3-dimensional ideal gas of

N particles, each with mass m , confined in a thermally isolated container that is infinitely long in the z-direction and has constant cross-sectional area A . The gravitational field is assumed to act in the minus z direction with strength g . The phase volume W(E, N) isW(E, N) = (( 2 \pi) ^{3N/2} A ^{N} m ^{N/2})/(g ^{N} \Gamma( 5 N/ 2 )) E ^{(5 N)/(-1 2)} where E is the total energy, kinetic plus gravitational.

The gas density

\rho(z) as a function of height z can be obtained by integrating over the phase volume coordinates. The result is:\rho(z) = \left( (5 N)/(2) - 1 \right) (mg)/(E) \left( 1 - (mgz)/(E) \right) ^{(5 N)/(-2 2)} Similarly, the distribution of the velocity magnitude |\vec{v}| (averaged over all heights) isf(|\vec{v}|) = (\Gamma( 5 N/ 2 ))/(\Gamma( 3 / 2 )\Gamma( 5 N/ 2-3 / 2 )) x (m ^{3/2} |\vec{v)/(|) ^{2} } \times \left(1 - \frac \right)^The analogues of these equations in the canonical ensemble are the barometric formula and the Maxwell–Boltzmann distribution, respectively. In the limit N → inf ty , the microcanonical and canonical expressions coincide; however, they differ for finite N . In particular, in the microcanonical ensemble, the positions and velocities are not statistically independent. As a result, the kinetic temperature, defined as the average kinetic energy in a given volume A dz , is nonuniform throughout the container:T _{kinetic} = (3 E)/(5 N -2) \left( 1 - (mgz)/(E) \right) By contrast, the temperature is uniform in the canonical ensemble, for any N .^[18]

See also

• Isolated system
• Ergodic hypothesis
• Loschmidt's paradox
• Canonical ensemble
• Grand canonical ensemble

Notes and References

1. Book: Gibbs, Josiah Willard . Josiah Willard Gibbs . Elementary Principles in Statistical Mechanics . 1902 . . New York. Elementary Principles in Statistical Mechanics .
2. Pearson. Eric M.. Halicioglu. Timur. Tiller. William A.. Laplace-transform technique for deriving thermodynamic equations from the classical microcanonical ensemble. Physical Review A. 32. 5. 1985. 3030–3039. 0556-2791. 10.1103/PhysRevA.32.3030. 9896445 . 1985PhRvA..32.3030P .
3. Lustig. Rolf. Statistical thermodynamics in the classical molecular dynamics ensemble. I. Fundamentals. The Journal of Chemical Physics. 100. 4. 1994. 3048–3059. 0021-9606. 10.1063/1.466446. 1994JChPh.100.3048L . free.
4. Book: Hill, Terrell L.. An Introduction to Statistical Thermodynamics. Dover Publications. 1986. 978-0-486-65242-9.
5. Book: Huang, Kerson. Statistical Mechanics. John Wiley & Sons. 1967.
6. Hilbert. Stefan. Hänggi. Peter. Dunkel. Jörn. Thermodynamic laws in isolated systems. Physical Review E. 90. 6. 2014. 062116 . 1539-3755. 10.1103/PhysRevE.90.062116. 25615053 . 1408.5382 . 2014PhRvE..90f2116H . 1721.1/92269. 5365820 . free.
7. Web site: The Microcanonical Ensemble . chem.libretexts. 3 May 2020.
8. Book: Hill, Terrell L.. An Introduction to Statistical Thermodynamics. Dover Publications. 1986. 978-0-486-65242-9.
9. [Nigel Goldenfeld]
10. Dunkel. Jörn. Hilbert. Stefan. Phase transitions in small systems: Microcanonical vs. canonical ensembles. Physica A: Statistical Mechanics and Its Applications. 370. 2. 2006. 390–406. 0378-4371. 10.1016/j.physa.2006.05.018. cond-mat/0511501. 2006PhyA..370..390D . 13900006 .
11. 1304.2066. Jörn Dunkel. Stefan Hilbert. Inconsistent thermostatistics and negative absolute temperatures. 2013. 10.1038/nphys2815. 10. 1. Nature Physics. 67–72. 2014NatPh..10...67D. 16757018 .
12. See further references at https://sites.google.com/site/entropysurfaceorvolume/
13. Book: Tolman, R. C. . 1938 . The Principles of Statistical Mechanics . Oxford University Press.
14. (Historical note) Gibbs' original ensemble effectively set, leading to unit-dependence in the values of some thermodynamic quantities like entropy and chemical potential. Since the advent of quantum mechanics, is often taken to be equal to the Planck constant in order to obtain a semiclassical correspondence with quantum mechanics.
15. In a system of identical particles, (factorial of). This factor corrects the overcounting in phase space due to identical physical states being found in multiple locations. See the statistical ensemble article for more information on this overcounting.
16. Book: Kardar, Mehran. Statistical Physics of Particles. Mehran Kardar. Cambridge University Press. 2007. 978-0-521-87342-0. 105–109.
17. Roman. F L. White. J A. Velasco. S. Microcanonical single-particle distributions for an ideal gas in a gravitational field. European Journal of Physics. 16. 2. 1995. 83–90. 0143-0807. 10.1088/0143-0807/16/2/008. 1995EJPh...16...83R . 250840083 .
18. Velasco. S. Román. F L. White. J A. On a paradox concerning the temperature distribution of an ideal gas in a gravitational field. European Journal of Physics. 17. 1. 1996. 43–44. 0143-0807. 10.1088/0143-0807/17/1/008. 250885860.