Explicit and implicit methods explained

Explicit and implicit methods are approaches used in numerical analysis for obtaining numerical approximations to the solutions of time-dependent ordinary and partial differential equations, as is required in computer simulations of physical processes. Explicit methods calculate the state of a system at a later time from the state of the system at the current time, while implicit methods find a solution by solving an equation involving both the current state of the system and the later one. Mathematically, if

Y(t)

is the current system state and

Y(t+\Deltat)

is the state at the later time (

\Deltat

is a small time step), then, for an explicit method

Y(t+\Deltat)=F(Y(t))

while for an implicit method one solves an equation

G(Y(t),Y(t+\Deltat))=0 (1)

to find

Y(t+\Deltat).

Computation

Implicit methods require an extra computation (solving the above equation), and they can be much harder to implement. Implicit methods are used because many problems arising in practice are stiff, for which the use of an explicit method requires impractically small time steps

\Deltat

to keep the error in the result bounded (see numerical stability). For such problems, to achieve given accuracy, it takes much less computational time to use an implicit method with larger time steps, even taking into account that one needs to solve an equation of the form (1) at each time step. That said, whether one should use an explicit or implicit method depends upon the problem to be solved.

Since the implicit method cannot be carried out for each kind of differential operator, it is sometimes advisable to make use of the so called operator splitting method, which means that the differential operator is rewritten as the sum of two complementary operators

Y(t+\Deltat)=F(Y(t+\Deltat))+G(Y(t)),

while one is treated explicitly and the other implicitly.For usual applications the implicit term is chosen to be linear while the explicit term can be nonlinear. This combination of the former method is called Implicit-Explicit Method (short IMEX,^[1] ^[2]).

Illustration using the forward and backward Euler methods

Consider the ordinary differential equation

	dy
	dt

=-y^2, t\in[0,a] (2)

with the initial condition

y(0)=1.

Consider a grid

k=a	k
	n

for 0 ≤ k ≤ n, that is, the time step is

\Deltat=a/n,

and denote

y_k=y(t_k)

for each

. Discretize this equation using the simplest explicit and implicit methods, which are the forward Euler and backward Euler methods (see numerical ordinary differential equations) and compare the obtained schemes.

Forward Euler method:The forward Euler method

\left(	dy
	dt

\right)_k ≈

	y_k+1-y_k
	\Deltat

	2
y
	k

yields

y_k+1=y_k-\Deltat

	2
y
	k

(3)

for each

k=0,1,...,n.

This is an explicit formula for

y_k+1

Backward Euler method:With the backward Euler method

	y_k+1-y_k
	\Deltat

	2
y
	k+1

one finds the implicit equation

y_k+1+\Deltat

	2=y
y
	k

for

y_k+1

(compare this with formula (3) where

y_k+1

was given explicitly rather than as an unknown in an equation).

This is a quadratic equation, having one negative and one positive root. The positive root is picked because in the original equation the initial condition is positive, and then

at the next time step is given by

y_k+1=

	-1+\sqrt{1+4\Deltaty_k

}. \quad \quad (4)

In the vast majority of cases, the equation to be solved when using an implicit scheme is much more complicated than a quadratic equation, and no analytical solution exists. Then one uses root-finding algorithms, such as Newton's method, to find the numerical solution.

Crank-Nicolson method:With the Crank-Nicolson method

	y_k+1-y_k
	\Deltat

	1
	2

	2
y		-
	k+1

	1
	2

	2
y
	k

one finds the implicit equation

y_k+1+

	1
	2

\Deltat

	2=y
y
	k

	1
	2

\Deltat

	2
y
	k

for

y_k+1

(compare this with formula (3) where

y_k+1

was given explicitly rather than as an unknown in an equation). This can be numerically solved using root-finding algorithms, such as Newton's method, to obtain

y_k+1

Crank-Nicolson can be viewed as a form of more general IMEX (Implicit-Explicit) schemes.

Forward-Backward Euler method:In order to apply the IMEX-scheme, consider a slightly different differential equation:

	dy
	dt

=y-y^2, t\in[0,a] (5)

It follows that

\left(	dy
	dt

\right)_k ≈ y_k+1

	2,
-y
	k

t\in[0,a]

and therefore

y_k+1=

	y_k(1-y_k\Deltat)
	1-\Deltat

(6)

for each

k=0,1,...,n.

Notes and References

U.M. Ascher, S.J. Ruuth, R.J. Spiteri: Implicit-Explicit Runge-Kutta Methods for Time-Dependent Partial Differential Equations, Appl Numer Math, vol. 25(2-3), 1997
L.Pareschi, G.Russo: Implicit-Explicit Runge-Kutta schemes for stiff systems of differential equations, Recent Trends in Numerical Analysis, Vol. 3, 269-289, 2000

Explicit and implicit methods explained

Computation

Illustration using the forward and backward Euler methods

See also

Notes and References