Symplectic integrator explained

In mathematics, a symplectic integrator (SI) is a numerical integration scheme for Hamiltonian systems. Symplectic integrators form the subclass of geometric integrators which, by definition, are canonical transformations. They are widely used in nonlinear dynamics, molecular dynamics, discrete element methods, accelerator physics, plasma physics, quantum physics, and celestial mechanics.

Introduction

Symplectic integrators are designed for the numerical solution of Hamilton's equations, which read

p

=-

\partialH
\partialq

and

q

=

\partialH
\partialp

,

where

q

denotes the position coordinates,

p

the momentum coordinates, and

H

is the Hamiltonian. The set of position and momentum coordinates

(q,p)

are called canonical coordinates.(See Hamiltonian mechanics for more background.)

dp\wedgedq

. A numerical scheme is a symplectic integrator if it also conserves this 2-form.

Symplectic integrators possess, as a conserved quantity, a Hamiltonian which is slightly perturbed from the original one.[1] By virtue of these advantages, the SI scheme has been widely applied to the calculations of long-term evolution of chaotic Hamiltonian systems ranging from the Kepler problem to the classical and semi-classical simulations in molecular dynamics.

Most of the usual numerical methods, such as the primitive Euler scheme and the classical Runge–Kutta scheme, are not symplectic integrators.

Methods for constructing symplectic algorithms

Splitting methods for separable Hamiltonians

A widely used class of symplectic integrators is formed by the splitting methods.

Assume that the Hamiltonian is separable, meaning that it can be written in the form

This happens frequently in Hamiltonian mechanics, with T being the kinetic energy and V the potential energy.

For the notational simplicity, let us introduce the symbol

z=(q,p)

to denote the canonical coordinates including both the position and momentum coordinates. Then, the set of the Hamilton's equations given in the introduction can be expressed in a single expression as

where

\{,\}

is a Poisson bracket. Furthermore, by introducing an operator

DH=\{,H\}

, which returns a Poisson bracket of the operand with the Hamiltonian, the expression of the Hamilton's equation can be further simplified to
z

=DHz.

The formal solution of this set of equations is given as a matrix exponential:

Note the positivity of

\tauDH

in the matrix exponential.

When the Hamiltonian has the form of equation, the solution is equivalent to

The SI scheme approximates the time-evolution operator

\exp[\tau(DT+DV)]

in the formal solution by a product of operators as

where

ci

and

di

are real numbers,

k

is an integer, which is called the order of the integrator, and where \sum_^k c_i = \sum_^k d_i = 1. Note that each of the operators

\exp(ci\tauDT)

and

\exp(di\tauDV)

provides a symplectic map, so their product appearing in the right-hand side of also constitutes a symplectic map.

Since

2
D
T

z=\{\{z,T\},T\}=\{(

q

,0),T\}=(0,0)

for all

z

, we can conclude that

By using a Taylor series,

\exp(aDT)

can be expressed as

where

a

is an arbitrary real number. Combining and, and by using the same reasoning for

DV

as we have used for

DT

, we get

In concrete terms,

\exp(ci\tauDT)

gives the mapping

\begin{pmatrix}q\p\end{pmatrix} \mapsto \begin{pmatrix} q+\tauci

\partialT
\partialp

(p)\\ p \end{pmatrix},

and

\exp(di\tauDV)

gives

\begin{pmatrix}q\p\end{pmatrix} \mapsto \begin{pmatrix} q\\ p-\taudi

\partialV
\partialq

(q)\\ \end{pmatrix}.

Note that both of these maps are practically computable.

Examples

The simplified form of the equations (in executed order) are:

qi+1=qi+ci

pi+1
m

t

pi+1=pi+diF(qi)t

Note that due to the definitions adopted above (in the operator version of the explanation), the index

i

is traversed in decreasing order when going through the steps (

i=4,3,2,1

for a fourth-order scheme).

After converting into Lagrangian coordinates:

xi+1=xi+civi+1t

vi+1=vi+dia(xi)t

Where

F(x)

is the force vector at

x

,

a(x)

is the acceleration vector at

x

, and

m

is the scalar quantity of mass.

Several symplectic integrators are given below. An illustrative way to use them is to consider a particle with position

q

and momentum

p

.

To apply a timestep with values

c1,2,3,d1,2,3

to the particle, carry out the following steps (again, as noted above, with the index

i=3,2,1

in decreasing order):

Iteratively:

i

of the particle by adding to it its (previously updated) velocity

i

multiplied by

ci

i

of the particle by adding to it its acceleration (at updated position) multiplied by

di

A first-order example

The symplectic Euler method is the first-order integrator with

k=1

and coefficients

c1=d1=1.

Note that the algorithm above does not work if time-reversibility is needed. The algorithm has to be implemented in two parts, one for positive time steps, one for negative time steps.

A second-order example

The Verlet method is the second-order integrator with

k=2

and coefficients

c1=0,    c2=1,    d1=d2=\tfrac12.

Since

c1=0

, the algorithm above is symmetric in time. There are 3 steps to the algorithm, and step 1 and 3 are exactly the same, so the positive time version can be used for negative time.

A third-order example

A third-order symplectic integrator (with

k=3

) was discovered by Ronald Ruth in 1983.[2] One of the many solutions is given by

\begin{align} c1&=1,&c2&=-\tfrac{2}{3},&c3&=\tfrac{2}{3},\\ d1&=-\tfrac{1}{24},&d2&=\tfrac{3}{4},&d3&=\tfrac{7}{24}. \end{align}

A fourth-order example

A fourth-order integrator (with

k=4

) was also discovered by Ruth in 1983 and distributed privately to the particle-accelerator community at that time. This was described in a lively review article by Forest.[3] This fourth-order integrator was published in 1990 by Forest and Ruth and also independently discovered by two other groups around that same time.[4] [5] [6]

\begin{align} c1&=c4=

1
2(2-21/3)

,&c2&=c3=

1-21/3
2(2-21/3)

,\\ d1&=d3=

1
2-21/3

,&d2&=-

21/3
2-21/3

,d4=0. \end{align}

To determine these coefficients, the Baker–Campbell–Hausdorff formula can be used. Yoshida, in particular, gives an elegant derivation of coefficients for higher-order integrators. Later on, Blanes and Moan[7] further developed partitioned Runge–Kutta methods for the integration of systems with separable Hamiltonians with very small error constants.

Splitting methods for general nonseparable Hamiltonians

General nonseparable Hamiltonians can also be explicitly and symplectically integrated.

To do so, Tao introduced a restraint that binds two copies of phase space together to enable an explicit splitting of such systems.[8] The idea is, instead of

H(Q,P)

, one simulates

\bar{H}(q,p,x,y)=H(q,y)+H(x,p)+\omega

2/2
\left(\left\|q-x\right\|
2

+

2/2\right)
\left\|p-y\right\|
2
, whose solution agrees with that of

H(Q,P)

in the sense that

q(t)=x(t)=Q(t),p(t)=y(t)=P(t)

.

The new Hamiltonian is advantageous for explicit symplectic integration, because it can be split into the sum of three sub-Hamiltonians,

HA=H(q,y)

,

HB=H(x,p)

, and

HC=\omega

2/2
\left(\left\|q-x\right\|
2

+

2/2\right)
\left\|p-y\right\|
2
. Exact solutions of all three sub-Hamiltonians can be explicitly obtained: both

HA,HB

solutions correspond to shifts of mismatched position and momentum, and

HC

corresponds to a linear transformation. To symplectically simulate the system, one simply composes these solution maps.

Applications

In plasma physics

In recent decades symplectic integrator in plasma physics has become an active research topic,[9] because straightforward applications of the standard symplectic methods do not suit the need of large-scale plasma simulations enabled by the peta- to exa-scale computing hardware. Special symplectic algorithms need to be customarily designed, tapping into the special structures of the physics problem under investigation. One such example is the charged particle dynamics in an electromagnetic field. With the canonical symplectic structure, the Hamiltonian of the dynamics is H(\boldsymbol,\boldsymbol)=\frac\left(\boldsymbol-\boldsymbol\right)^+\phi, whose \boldsymbol-dependence and \boldsymbol-dependence are not separable, and standard explicit symplectic methods do not apply. For large-scale simulations on massively parallel clusters, however, explicit methods are preferred. To overcome this difficulty, we can explore the specific way that the \boldsymbol-dependence and \boldsymbol-dependence are entangled in this Hamiltonian, and try to design a symplectic algorithm just for this or this type of problem. First, we note that the \boldsymbol-dependence is quadratic, therefore the first order symplectic Euler method implicit in \boldsymbol is actually explicit. This is what is used in the canonical symplectic particle-in-cell (PIC) algorithm.[10] To build high order explicit methods, we further note that the \boldsymbol-dependence and \boldsymbol-dependence in this H(\boldsymbol,\boldsymbol) are product-separable, 2nd and 3rd order explicit symplectic algorithms can be constructed using generating functions,[11] and arbitrarily high-order explicit symplectic integrators for time-dependent electromagnetic fields can also be constructed using Runge-Kutta techniques.[12]

A more elegant and versatile alternative is to look at the following non-canonical symplectic structure of the problem, i_\Omega=-dH,\ \ \ \Omega=d(\boldsymbol+\boldsymbol)\wedge d\boldsymbol,\ \ \ H=\frac\boldsymbol^+\phi. Here \Omega is a non-constant non-canonical symplectic form. General symplectic integrator for non-constant non-canonical symplectic structure, explicit or implicit, is not known to exist. However, for this specific problem, a family of high-order explicit non-canonical symplectic integrators can be constructed using the He splitting method.[13] Splitting H into 4 parts, \beginH & = H_ + H_ + H_ + H_,\\H_ &= \fracv_^,\ \ H_ = \fracv_^,\ \ H_ = \fracv_^,\ \ H_ = \phi,\end we find serendipitously that for each subsystem, e.g., i_\Omega=-dH_ and i_\Omega=-dH_, the solution map can be written down explicitly and calculated exactly. Then explicit high-order non-canonical symplectic algorithms can be constructed using different compositions. Let \Theta_,\Theta_,\Theta_ and \Theta_ denote the exact solution maps for the 4 subsystems. A 1st-order symplectic scheme is \begin\Theta_\left(\Delta\tau\right)=\Theta_\left(\Delta\tau\right)\Theta_\left(\Delta\tau\right)\Theta_\left(\Delta\tau\right)\Theta_\left(\Delta\tau\right)~.\end A symmetric 2nd-order symplectic scheme is, \begin\Theta_\left(\Delta\tau\right) & =\Theta_\left(\Delta\tau/2\right)\Theta_\left(\Delta\tau/2\right)\Theta_\left(\Delta\tau/2\right)\Theta_\left(\Delta\tau\right)\\ & \Theta_\left(\Delta t/2\right)\Theta_\left(\Delta t/2\right)\Theta_\left(\Delta t/2\right)\!,\end which is a customarily modified Strang splitting. A 2(l+1)-th order scheme can be constructed from a 2l-th order scheme using the method of triple jump, \begin\Theta_(\Delta\tau) & =\Theta_(\alpha_\Delta\tau)\Theta_(\beta_\Delta\tau)\Theta_(\alpha_\Delta\tau)~,\\\alpha_ & =1/(2-2^)~,\\\beta_ & =1-2\alpha_~.\end The He splitting method is one of key techniques used in the structure-preserving geometric particle-in-cell (PIC) algorithms.[14] [15] [16] [17]

See also

References

Notes and References

  1. Book: Tuckerman . Mark E. . Statistical Mechanics: Theory and Molecular Simulation . 2010 . Oxford University Press . 9780198525264 . 121-124 . 1.
  2. Ruth. Ronald D.. A Canonical Integration Technique. IEEE Transactions on Nuclear Science. August 1983. NS-30. 2669–2671. 10.1109/TNS.1983.4332919. 1983ITNS...30.2669R. 4 . 5911358.
  3. Forest. Etienne. Geometric Integration for Particle Accelerators. J. Phys. A: Math. Gen.. 2006. 39. 5321–5377. 10.1088/0305-4470/39/19/S03. 2006JPhA...39.5321F. 19 .
  4. Forest. E.. Fourth-order symplectic integration. Physica D. 1990. 43. 105–117. 10.1016/0167-2789(90)90019-L. 1990PhyD...43..105F. Ruth. Ronald D. .
  5. Yoshida. H.. Construction of higher order symplectic integrators. Phys. Lett. A. 1990. 150. 262–268. 10.1016/0375-9601(90)90092-3. 1990PhLA..150..262Y. 5–7 .
  6. Candy. J.. A Symplectic Integration Algorithm for Separable Hamiltonian Functions. J. Comput. Phys.. 1991. 92. 230–256. 10.1016/0021-9991(91)90299-Z. 1991JCoPh..92..230C. Rozmus. W . 1.
  7. Blanes. S.. Moan, P. C. . Practical symplectic partitioned Runge–Kutta and Runge–Kutta–Nyström methods. Journal of Computational and Applied Mathematics. May 2002. 142. 2. 313–330. 10.1016/S0377-0427(01)00492-7. 2002JCoAM.142..313B . free.
  8. Tao. Molei. Explicit symplectic approximation of nonseparable Hamiltonians: Algorithm and long time performance. Phys. Rev. E. 2016. 94. 4. 043303. 10.1103/PhysRevE.94.043303. 27841574. 1609.02212. 2016PhRvE..94d3303T. 41468935.
  9. Qin. H.. Guan, X.. Physical Review Letters. 2008. 100. 035006. A Variational Symplectic Integrator for the Guiding Center Motion of Charged Particles for Long Time Simulations in General Magnetic Fields. 3. 10.1103/PhysRevLett.100.035006. 18232993.
  10. Qin. H.. Liu, J.. Xiao, J.. Nuclear Fusion. 2016. 56. 014001. Canonical symplectic particle-in-cell method for long-term large-scale simulations of the Vlasov–Maxwell equations. 1. 10.1088/0029-5515/56/1/014001. 1503.08334. 2016NucFu..56a4001Q. 29190330 .
  11. Zhang. R.. Qin, H.. Tang, Y.. Physical Review E. 2016. 94. Explicit symplectic algorithms based on generating functions for charged particle dynamics. 1. 013205. 10.1103/PhysRevE.94.013205. 27575228. 1604.02787. 2016PhRvE..94a3205Z . 2166879 .
  12. Tao. M.. Journal of Computational Physics. 2016. 327. Explicit high-order symplectic integrators for charged particles in general electromagnetic fields. 245. 10.1016/j.jcp.2016.09.047. 1605.01458. 2016JCoPh.327..245T . 31262651 .
  13. He. Y.. Qin, H.. Sun, Y.. Physics of Plasmas. 2015. 22. Hamiltonian integration methods for Vlasov-Maxwell equations. 124503. 10.1063/1.4938034 . 1505.06076 . 118560512 .
  14. Xiao. J.. Qin, H.. Liu, J.. Physics of Plasmas. 2015. 22. Explicit high-order non-canonical symplectic particle-in-cell algorithms for Vlasov-Maxwell systems. 11. 112504. 10.1063/1.4935904. 1510.06972. 2015PhPl...22k2504X . 12893515 .
  15. Kraus. M. Kormann, K. Morrison, P.. Sonnendrucker, E. Journal of Plasma Physics . 2017. 83. GEMPIC: geometric electromagnetic particle-in-cell methods. 4. 905830401. 10.1017/S002237781700040X. 1609.03053. 2017JPlPh..83d9001K. 8207132.
  16. Xiao. J.. Qin, H.. Liu, J.. Plasma Science and Technology . 2018. 20. Structure-preserving geometric particle-in-cell methods for Vlasov-Maxwell systems. 11. 110501. 10.1088/2058-6272/aac3d1. 1804.08823. 2018PlST...20k0501X . 250801157 .
  17. Glasser. A.. Qin, H.. Journal of Plasma Physics . 2022. 88. A gauge-compatible Hamiltonian splitting algorithm for particle-in-cell simulations using finite element exterior calculus. 2. 835880202. 10.1017/S0022377822000290. 2110.10346. 2022JPlPh..88b8302G. 239049433.