Generalized Pareto distribution explained

In statistics, the generalized Pareto distribution (GPD) is a family of continuous probability distributions. It is often used to model the tails of another distribution. It is specified by three parameters: location

\mu , scale \sigma , and shape \xi .^{[1] [2]} Sometimes it is specified by only scale and shape^[3] and sometimes only by its shape parameter. Some references give the shape parameter as \kappa = - \xi .^[4]

Definition

The standard cumulative distribution function (cdf) of the GPD is defined by^[5]

F _{\xi} (z) = \begin{cases} 1 - \left( 1 + \xi z\right) ^{-1/\xi} & for \xi ≠ 0 , \\ 1 - e ^{-z} & for \xi = 0 . \end{cases}

where the support is

z \geq 0 for \xi \geq 0 and 0 \leq z \leq - 1 /\xi for \xi < 0 . The corresponding probability density function (pdf) isf _{\xi} (z) = \begin{cases} ( 1 + \xi z) ^{- (\xi +1)/(\xi)} & for \xi ≠ 0 , \\ e ^{-z} & for \xi = 0 . \end{cases}

Characterization

The related location-scale family of distributions is obtained by replacing the argument z by

(x - \mu)/(\sigma) and adjusting the support accordingly.

The cumulative distribution function of

X \sim GPD(\mu, \sigma, \xi) (\mu\in R , \sigma> 0 , and \xi\in R ) isF _{(\mu,\sigma,\xi)} (x) = \begin{cases} 1 - \left( 1+ (\xi(x - \mu))/(\sigma) \right) ^{-1/\xi} & for \xi ≠ 0 , \\ 1 - \exp \left( - (x - \mu)/(\sigma) \right) & for \xi = 0 , \end{cases} where the support of X is x \geqslant \mu when \xi \geqslant 0 , and \mu \leqslant x \leqslant \mu - \sigma /\xi when \xi < 0 .

The probability density function (pdf) of

X \sim GPD(\mu, \sigma, \xi) isf _{(\mu,\sigma,\xi)} (x) = (1)/(\sigma) \left( 1 + (\xi (x - \mu))/(\sigma) \right) ^{\left( - (1)/(- 1 \right) \xi)} ,

again, for

x \geqslant \mu when \xi \geqslant 0 , and \mu \leqslant x \leqslant \mu - \sigma /\xi when \xi < 0 .

The pdf is a solution of the following differential equation:

\left\{\begin{array}{l} f'(x) ( - \mu \xi + \sigma + \xi x) + (\xi +1 ) f(x) =0 , \\ f( 0 ) = (\left( 1- (\mu \xi)/(\right) ^{- (1)/(-1 \xi)} \sigma))/(\sigma) \end{array}\right\}

Special cases

• If the shape

\xi and location \mu are both zero, the GPD is equivalent to the exponential distribution.

• With shape

\xi = -1 , the GPD is equivalent to the continuous uniform distribution U( 0 , \sigma) .^[6]

• With shape

\xi > 0 and location \mu = \sigma , the GPD is equivalent to the Pareto distribution with scale x _{m=\sigma/\xi} and shape \alpha =1 /\xi .

• If

X \sim GPD ( \mu = 0 , \sigma , \xi ) , then Y = log (X) \sim exGPD(\sigma, \xi) https://www.tandfonline.com/doi/abs/10.1080/03610926.2018.1441418. (exGPD stands for the exponentiated generalized Pareto distribution.)

• GPD is similar to the Burr distribution.

Generating generalized Pareto random variables

Generating GPD random variables

If U is uniformly distributed on(0, 1], then

X = \mu + (\sigma (U ^{-\xi} -1 ))/(\xi) \sim GPD(\mu, \sigma, \xi ≠ 0 ) andX = \mu - \sigma ln (U) \sim GPD(\mu,\sigma,\xi =0 ).

Both formulas are obtained by inversion of the cdf.

In Matlab Statistics Toolbox, you can easily use "gprnd" command to generate generalized Pareto random numbers.

GPD as an Exponential-Gamma Mixture

A GPD random variable can also be expressed as an exponential random variable, with a Gamma distributed rate parameter.

X| Λ \sim \operatorname{Exp}( Λ ) andΛ \sim \operatorname{Gamma}(\alpha, \beta) thenX \sim \operatorname{GPD}(\xi = 1 /\alpha, \sigma = \beta/\alpha)

Notice however, that since the parameters for the Gamma distribution must be greater than zero, we obtain the additional restrictions that:

\xi must be positive.

In addition to this mixture (or compound) expression, the generalized Pareto distribution can also be expressed as a simple ratio. Concretely, for

Y \sim Exponential ( 1 ) and Z \sim Gamma ( 1 /\xi, 1 ) , we have \mu + \sigma (Y)/(\xi Z) \sim GPD (\mu,\sigma,\xi) . This is a consequence of the mixture after setting \beta = \alpha and taking into account that the rate parameters of the exponential and gamma distribution are simply inverse multiplicative constants.

Exponentiated generalized Pareto distribution

The exponentiated generalized Pareto distribution (exGPD)

If

X \sim GPD ( \mu = 0 , \sigma , \xi ) , then Y = log (X) is distributed according to the exponentiated generalized Pareto distribution, denoted by Y \sim exGPD ( \sigma , \xi ) .

The probability density function(pdf) of

Y \sim exGPD ( \sigma , \xi ) (\sigma > 0 ) isg _{(\sigma,} (y) = \begin{cases} (e ^{y})/(\sigma) ( 1 + (\xi e ^{y})/(\sigma) ) ^{-1/\xi} for \xi ≠ 0 , \ (1)/(\sigma) e ^{y - e ^{y} /\sigma} for \xi = 0 ,\end{cases} where the support is -inf ty < y < inf ty for \xi \geq 0 , and -inf ty < y \leq log ( - \sigma/\xi) for \xi < 0 .

For all

\xi , the log \sigma becomes the location parameter. See the right panel for the pdf when the shape \xi is positive.

The exGPD has finite moments of all orders for all

\sigma> 0 and -inf ty< \xi < inf ty .

The moment-generating function of

Y \sim exGPD(\sigma,\xi) is M _{Y(s)} = E[e ^{sY} ] = \begin{cases} - (1)/(( - \xi) (\sigma)/(\xi) ) ^{s} B(s +1 , -1 /\xi) for s \in ( -1 , inf ty), \xi < 0 , \ (1)/(( \xi) (\sigma)/(\xi) ) ^{s} B(s +1 , 1 /\xi - s) for s \in ( -1 , 1 /\xi), \xi > 0 , \ \sigma ^{s} \Gamma( 1+ s) for s \in ( -1 , inf ty), \xi = 0 , \end{cases} where B(a,b) and \Gamma (a) denote the beta function and gamma function, respectively.

The expected value of

Y \sim exGPD ( \sigma , \xi ) depends on the scale \sigma and shape \xi parameters, while the \xi participates through the digamma function:E[Y] = \begin{cases} log ( - (\sigma)/(\xi) ) + \psi( 1 ) - \psi( -1 /\xi +1 ) for \xi < 0 , \ log ( (\sigma)/(\xi) ) + \psi( 1 ) - \psi( 1 /\xi) for \xi > 0 , \ log \sigma + \psi( 1 ) for \xi = 0 . \end{cases} Note that for a fixed value for the \xi \in ( -inf ty, inf ty) , the log \sigma plays as the location parameter under the exponentiated generalized Pareto distribution.

The variance of

Y \sim exGPD ( \sigma , \xi ) depends on the shape parameter \xi only through the polygamma function of order 1 (also called the trigamma function):Var[Y] = \begin{cases} \psi'( 1 ) - \psi'( -1 /\xi +1 ) for \xi < 0 , \ \psi'( 1 ) + \psi'( 1 /\xi) for \xi > 0 , \ \psi'( 1 ) for \xi = 0 . \end{cases} See the right panel for the variance as a function of \xi . Note that \psi'( 1 ) = \pi ^{2/6} ≈ 1 . 644934 .

Note that the roles of the scale parameter

\sigma and the shape parameter \xi under Y \sim exGPD(\sigma, \xi) are separably interpretable, which may lead to a robust efficient estimation for the \xi than using the X \sim GPD(\sigma, \xi) https://www.tandfonline.com/doi/abs/10.1080/03610926.2018.1441418. The roles of the two parameters are associated each other under X \sim GPD(\mu =0 ,\sigma, \xi) (at least up to the second central moment); see the formula of variance Var(X) wherein both parameters are participated.

The Hill's estimator

Assume that

X _{1:n} = (X _{1,} … , X _{n)} are n observations (need not be i.i.d.) from an unknown heavy-tailed distribution F such that its tail distribution is regularly varying with the tail-index 1 /\xi (hence, the corresponding shape parameter is \xi ). To be specific, the tail distribution is described as \bar{F}(x) = 1 - F(x) = L(x) ⋅ x ^{-1/\xi} , forsome \xi> 0 , where L isaslowlyvaryingfunction. It is of a particular interest in the extreme value theory to estimate the shape parameter \xi , especially when \xi is positive (so called the heavy-tailed distribution).

Let

F _{u} be their conditional excess distribution function. Pickands–Balkema–de Haan theorem (Pickands, 1975; Balkema and de Haan, 1974) states that for a large class of underlying distribution functions F , and large u , F _{u} is well approximated by the generalized Pareto distribution (GPD), which motivated Peak Over Threshold (POT) methods to estimate \xi : the GPD plays the key role in POT approach.

A renowned estimator using the POT methodology is the Hill's estimator. Technical formulation of the Hill's estimator is as follows. For

1 \leq i \leq n , write X _{(i)} for the i -th largest value of X _{1,} … , X _{n} . Then, with this notation, the Hill's estimator (see page 190 of Reference 5 by Embrechts et al https://books.google.com/books?id=o-clBQAAQBAJ&amp;dq=modeeling+extreme+events+for+insurance&amp;pg=PA1) based on the k upper order statistics is defined as\widehat{\xi} ^{Hill} _{k} = \widehat{\xi} ^{Hill} _{k} (X _{1:n} ) = (1)/(k -1) \sum ^{k -1} _{j =1} log ( (X _{(j)})/(X _{(k)}) ) , for 2 \leq k \leq n. In practice, the Hill estimator is used as follows. First, calculate the estimator \widehat{\xi} ^{Hill} _{k} at each integer k \in \{ 2 , … , n\} , and then plot the ordered pairs \{(k,\widehat{\xi} ^{Hill} _{k} )\} ^{n} _{k =2} . Then, select from the set of Hill estimators \{\widehat{\xi} ^{Hill} _{k} \} ^{n} _{k =2} which are roughly constant with respect to k : these stable values are regarded as reasonable estimates for the shape parameter \xi . If X _{1,} … , X _{n} are i.i.d., then the Hill's estimator is a consistent estimator for the shape parameter \xi https://www.jstor.org/stable/1427870.

Note that the Hill estimator

\widehat{\xi} ^{Hill} _{k} makes a use of the log-transformation for the observations X _{1:n} = (X _{1,} … , X _{n)} . (The Pickand's estimator \widehat{\xi} ^{Pickand} _{k} also employed the log-transformation, but in a slightly different wayhttps://www.jstor.org/stable/2242785.)

See also

• Burr distribution
• Pareto distribution
• Generalized extreme value distribution
• Exponentiated generalized Pareto distribution
• Pickands–Balkema–de Haan theorem

Further reading

• Pickands. James. Statistical inference using extreme order statistics. Annals of Statistics. 3 s. 1975. 119–131. 10.1214/aos/1176343003. free.
• Balkema . A. . Residual life time at great age . Annals of Probability . 2 . 1974 . 792–804 . 10.1214/aop/1176996548 . Laurens . De Haan . 5 . Laurens de Haan . free .
• Lee. Seyoon . Exponentiated generalized Pareto distribution:Properties and applications towards extreme value theory . Communications in Statistics - Theory and Methods. 2018. 1–25 . 10.1080/03610926.2018.1441418 . J.H.K. . Kim. 48 . 8 . 1708.01686 . 88514574 .
• Book: Continuous Univariate Distributions Volume 1, second edition. N. L. Johnson . S. Kotz . N. Balakrishnan . Wiley. New York. 1994. 978-0-471-58495-7. Chapter 20, Section 12: Generalized Pareto Distributions.
• Book: Duangkamon Chotikapanich. 2011. Modeling Distributions and Lorenz Curves. Springer. New York. Barry C. Arnold. Chapter 7: Pareto and Generalized Pareto Distributions. https://books.google.com/books?id=fUJZZLj1kbwC&pg=PA119. 9780387727967.
• Book: Arnold, B. C. . Laguna, L.. 1977. On generalized Pareto distributions with applications to income data. Ames, Iowa. Iowa State University, Department of Economics.

External links

• Mathworks: Generalized Pareto distribution

Notes and References

1. Book: Coles, Stuart . An Introduction to Statistical Modeling of Extreme Values . Springer . 75 . 9781852334598 . 2001-12-12.
2. Dargahi-Noubary . G. R. . On tail estimation: An improved method . 10.1007/BF00894450 . Mathematical Geology . 21 . 8 . 829–842 . 1989 . 1989MatGe..21..829D . 122710961 .
3. Hosking . J. R. M. . Wallis . J. R. . Parameter and Quantile Estimation for the Generalized Pareto Distribution . Technometrics . 29 . 3 . 339–349 . 10.2307/1269343 . 1987 . 1269343 .
4. Book: Davison, A. C. . Statistical Extremes and Applications . de Oliveira . J. Tiago . Kluwer . Modelling Excesses over High Thresholds, with an Application . 462 . https://books.google.com/books?id=6M03_6rm8-oC&pg=PA462 . 9789027718044 . 1984-09-30.
5. Book: Embrechts . Paul . Klüppelberg . Claudia. Claudia Klüppelberg . Mikosch . Thomas . Modelling extremal events for insurance and finance . 162 . 9783540609315 . 1997-01-01. Springer .
6. Castillo, Enrique, and Ali S. Hadi. "Fitting the generalized Pareto distribution to data." Journal of the American Statistical Association 92.440 (1997): 1609-1620.