Backward Euler method explained

In numerical analysis and scientific computing, the backward Euler method (or implicit Euler method) is one of the most basic numerical methods for the solution of ordinary differential equations. It is similar to the (standard) Euler method, but differs in that it is an implicit method. The backward Euler method has error of order one in time.

Description

dy
dt

=f(t,y)

with initial value

y(t0)=y0.

Here the function

f

and the initial data

t0

and

y0

are known; the function

y

depends on the real variable

t

and is unknown. A numerical method produces a sequence

y0,y1,y2,\ldots

such that

yk

approximates

y(t0+kh)

, where

h

is called the step size.

The backward Euler method computes the approximations using

yk+1=yk+hf(tk+1,yk+1).

This differs from the (forward) Euler method in that the forward method uses

f(tk,yk)

in place of

f(tk+1,yk+1)

.

The backward Euler method is an implicit method: the new approximation

yk+1

appears on both sides of the equation, and thus the method needs to solve an algebraic equation for the unknown

yk+1

. For non-stiff problems, this can be done with fixed-point iteration:
[0]
y
k+1

=yk,

[i+1]
y
k+1

=yk+hf(tk+1,

[i]
y
k+1

).

If this sequence converges (within a given tolerance), then the method takes its limit as the new approximation

yk+1

.

Alternatively, one can use (some modification of) the Newton–Raphson method to solve the algebraic equation.

Derivation

Integrating the differential equation

dy
dt

=f(t,y)

from

tn

to

tn+1=tn+h

yields

y(tn+1)-y(tn)=

tn+1
\int
tn

f(t,y(t))dt.

Now approximate the integral on the right by the right-hand rectangle method (with one rectangle):

y(tn+1)-y(tn)hf(tn+1,y(tn+1)).

Finally, use that

yn

is supposed to approximate

y(tn)

and the formula for the backward Euler method follows.

The same reasoning leads to the (standard) Euler method if the left-hand rectangle rule is used instead of the right-hand one.

Analysis

The local truncation error (defined as the error made in one step) of the backward Euler Method is

O(h2)

, using the big O notation. The error at a specific time

t

is

O(h2)

. It means that this method has order one. In general, a method with

O(hk+1)

LTE (local truncation error) is said to be of kth order.

The region of absolute stability for the backward Euler method is the complement in the complex plane of the disk with radius 1 centered at 1, depicted in the figure. This includes the whole left half of the complex plane, making it suitable for the solution of stiff equations. In fact, the backward Euler method is even L-stable.

The region for a discrete stable system by Backward Euler Method is a circle with radius 0.5 which is located at (0.5, 0) in the z-plane.[1]

Extensions and modifications

The backward Euler method is a variant of the (forward) Euler method. Other variants are the semi-implicit Euler method and the exponential Euler method.

The backward Euler method can be seen as a Runge–Kutta method with one stage, described by the Butcher tableau:

\begin{array}{c|c} 1&1\\ \hline &1\\ \end{array}

The method can also be seen as a linear multistep method with one step. It is the first method of the family of Adams–Moulton methods, and also of the family of backward differentiation formulas.

See also

References

Notes and References

  1. Wai-Kai Chen, Ed., Analog and VLSI Circuits The Circuits and Filters Handbook, 3rd ed. Chicago, USA: CRC Press, 2009.