Generalized extreme value distribution explained

In probability theory and statistics, the generalized extreme value (GEV) distribution^[1] is a family of continuous probability distributions developed within extreme value theory to combine the Gumbel, Fréchet and Weibull families also known as type I, II and III extreme value distributions. By the extreme value theorem the GEV distribution is the only possible limit distribution of properly normalized maxima of a sequence of independent and identically distributed random variables.^[2] Note that a limit distribution needs to exist, which requires regularity conditions on the tail of the distribution. Despite this, the GEV distribution is often used as an approximation to model the maxima of long (finite) sequences of random variables.

In some fields of application the generalized extreme value distribution is known as the Fisher–Tippett distribution, named after Ronald Fisher and L. H. C. Tippett who recognised three different forms outlined below. However usage of this name is sometimes restricted to mean the special case of the Gumbel distribution. The origin of the common functional form for all 3 distributions dates back to at least Jenkinson, A. F. (1955),^[3] though allegedly^[4] it could also have been given by von Mises, R. (1936).^[5]

Specification

Using the standardized variable

s \equiv (x - \mu)/(\sigma) , where \mu , the location parameter, can be any real number, and \sigma > 0 is the scale parameter; the cumulative distribution function of the GEV distribution is then

where

\xi , the shape parameter, can be any real number. Thus, for \xi > 0 , the expression is valid for s > - \tfrac{ 1 }{\xi} , while for \xi < 0 it is valid for s < - \tfrac{ 1 }{\xi} ~. In the first case, - \tfrac{ 1 }{\xi} is the negative, lower end-point, where F is in the second case, - \tfrac{ 1 }{\xi} is the positive, upper end-point, where F is 1. For \xi = 0 the second expression is formally undefined and is replaced with the first expression, which is the result of taking the limit of the second, as \xi \to 0 in which case s can be any real number.

In the special case of

x = \mu , so s = 0 and F( 0 ; \xi ) = e ^{-1} ≈ 0 . 368 for whatever values \xi and \sigma might have.

The probability density function of the standardized distribution is

again valid for

s > - \tfrac{ 1 }{\xi} in the case \xi > 0 , and for s < - \tfrac{ 1 }{\xi} in the case \xi < 0 ~. The density is zero outside of the relevant range. In the case \xi = 0 the density is positive on the whole real line.

Since the cumulative distribution function is invertible, the quantile function for the GEV distribution has an explicit expression, namely

and therefore the quantile density function,

q \equiv (d Q)/(d p) , isq( p; \sigma, \xi ) = (\sigma)/(l ( -ln (p) r ) ^{\xi} p) for ~~ p \in ( 0 , 1 ) ,

valid for

\sigma > 0 and for any real \xi ~.

^[6]

Summary statistics

Some simple statistics of the distribution are:

\operatorname{ E}(X) = \mu + (g _{1-1 ) (\sigma)/(\xi)} for \xi < 1 \operatorname{Var}(X) = (g _{2-g} ^{2 ) (\sigma ^{2})/(\xi ^{2})} ^{1} , \operatorname{Mode}(X) = \mu + (\sigma)/(\xi) [( 1+ \xi) ^{-\xi} -1 ] .

The skewness is for ξ>0

\operatorname{skewness}(X) = (g _{3-3 g} _{2g} _{1+2g} ^{3} ^{1})/((g _{2- g} ^{2 )} ^{1} ^{3/2})

For ξ < 0, the sign of the numerator is reversed.

The excess kurtosis is:

\operatorname{kurtosis excess}(X) = (g _{4-4 g} _{3g} _{1+6g} _{2g} ^{4} ^{1})/((g _{2- g} ^{2 )} ^{1} ^{2}) -3 ~.

where

g _{k} = \Gamma( 1 - k \xi) , k =1 , 2 , 3 , 4 , and \Gamma(t) is the gamma function.

Link to Fréchet, Weibull, and Gumbel families

The shape parameter

\xi governs the tail behavior of the distribution. The sub-families defined by three cases: \xi = 0 , \xi > 0 , and \xi < 0 ; these correspond, respectively, to the Gumbel, Fréchet, and Weibull families, whose cumulative distribution functions are displayed below.

• Type I or Gumbel extreme value distribution, case

~ \xi = 0 , for all x \in l ( -inf ty , +inf ty r ) : F( x; \mu, \sigma, 0 ) = \exp \left( - \exp \left( - (x - \mu)/(\sigma) \right) \right) ~.

• Type II or Fréchet extreme value distribution, case

~ \xi > 0 , for all x \in \left( \mu - \tfrac{\sigma}{ \xi } , +inf ty \right) :

Let

\alpha \equiv \tfrac{ 1 }{ \xi } > 0 and y \equiv 1 + \tfrac{\xi}{\sigma} (x - \mu) ; F( x; \mu, \sigma, \xi ) = \begin{cases} 0 & y \leq 0 ~or equiv.~ x \leq \mu - \tfrac{\sigma}{ \xi } \ \exp\left( - (1)/(~ y ^{\alpha}) \right) & y > 0 ~or equiv.~ x > \mu - \tfrac{\sigma}{ \xi } ~. \end{cases}

• Type III or reversed Weibull extreme value distribution, case

~ \xi < 0 , for all x \in \left( -inf ty , \mu + \tfrac{ \sigma }{ | \xi | } \right) :

Let

\alpha \equiv - \tfrac{ 1 }{ \xi } > 0 and y \equiv 1 - \tfrac{ | \xi | }{\sigma} (x - \mu) ; F( x; \mu, \sigma, \xi ) = \begin{cases} \exp\left( - y ^{\alpha} \right) & y > 0 ~or equiv.~ x < \mu + \tfrac{ \sigma }{ | \xi | } \ 1 & y \leq 0 ~or equiv.~ x \geq \mu + \tfrac{ \sigma }{ | \xi | } ~. \end{cases}

The subsections below remark on properties of these distributions.

Modification for minima rather than maxima

The theory here relates to data maxima and the distribution being discussed is an extreme value distribution for maxima. A generalised extreme value distribution for data minima can be obtained, for example by substituting

- x for x in the distribution function, and subtracting the cumulative distribution from one: That is, replace F(x) with Doing so yields yet another family of distributions.

Alternative convention for the Weibull distribution

The ordinary Weibull distribution arises in reliability applications and is obtained from the distribution here by using the variable

t = \mu - x , which gives a strictly positive support, in contrast to the use in the formulation of extreme value theory here. This arises because the ordinary Weibull distribution is used for cases that deal with data minima rather than data maxima. The distribution here has an addition parameter compared to the usual form of the Weibull distribution and, in addition, is reversed so that the distribution has an upper bound rather than a lower bound. Importantly, in applications of the GEV, the upper bound is unknown and so must be estimated, whereas when applying the ordinary Weibull distribution in reliability applications the lower bound is usually known to be zero.

Ranges of the distributions

Note the differences in the ranges of interest for the three extreme value distributions: Gumbel is unlimited, Fréchet has a lower limit, while the reversed Weibull has an upper limit.More precisely, Extreme Value Theory (Univariate Theory) describes which of the three is the limiting law according to the initial law and in particular depending on its tail.

Distribution of log variables

One can link the type I to types II and III in the following way: If the cumulative distribution function of some random variable

X is of type II, and with the positive numbers as support, i.e. F( x; 0 , \sigma, \alpha ) , then the cumulative distribution function of ln X is of type I, namely F( x; ln \sigma, \tfrac{ 1 }{ \alpha }, 0 ) ~. Similarly, if the cumulative distribution function of X is of type III, and with the negative numbers as support, i.e. F( x; 0 , \sigma, - \alpha ) , then the cumulative distribution function of ln ( - X) is of type I, namely F( x; -ln \sigma, \tfrac{ 1 }{\alpha}, 0 ) ~.

Link to logit models (logistic regression)

Multinomial logit models, and certain other types of logistic regression, can be phrased as latent variable models with error variables distributed as Gumbel distributions (type I generalized extreme value distributions). This phrasing is common in the theory of discrete choice models, which include logit models, probit models, and various extensions of them, and derives from the fact that the difference of two type-I GEV-distributed variables follows a logistic distribution, of which the logit function is the quantile function. The type-I GEV distribution thus plays the same role in these logit models as the normal distribution does in the corresponding probit models.

Properties

The cumulative distribution function of the generalized extreme value distribution solves the stability postulate equation. The generalized extreme value distribution is a special case of a max-stable distribution, and is a transformation of a min-stable distribution.

Applications

• The GEV distribution is widely used in the treatment of "tail risks" in fields ranging from insurance to finance. In the latter case, it has been considered as a means of assessing various financial risks via metrics such as value at risk.^[7]

• However, the resulting shape parameters have been found to lie in the range leading to undefined means and variances, which underlines the fact that reliable data analysis is often impossible.^[8]
• In hydrology the GEV distribution is applied to extreme events such as annual maximum one-day rainfalls and river discharges.^[9] The blue picture, made with CumFreq, illustrates an example of fitting the GEV distribution to ranked annually maximum one-day rainfalls showing also the 90% confidence belt based on the binomial distribution. The rainfall data are represented by plotting positions as part of the cumulative frequency analysis.

Example for Normally distributed variables

Let

\left\{ X _{i | 1} \le i \le n \right\} be i.i.d. normally distributed random variables with mean and variance .The Fisher–Tippett–Gnedenko theorem^[10] tells us thatmax \{ X _{i | 1} \le i \le n \} \sim GEV(\mu _{n,} \sigma _{n,} 0 ) , where\begin{align} \mu _{n} & = \Phi ^{-1} \left( 1 - (1)/(n) \right) \\ \sigma _{n} & = \Phi ^{-1} \left( 1 - (1)/(n e) \right) - \Phi ^{-1} \left( 1- (1)/(n) \right) ~. \end{align}

This allow us to estimate e.g. the mean of

max \{ X _{i | 1} \le i \le n \} from the mean of the GEV distribution:\begin{align} \operatorname{ E}\left\{ max\left\{ X _{i | 1} \le i \le n \right\} \right\} & ≈ \mu _{n} + \gamma _{E} \sigma _{n} \\ & = ( 1 - \gamma _{E} ) \Phi ^{-1} \left( 1 - (1)/(n) \right) + \gamma _{E} \Phi ^{-1} \left( 1 - (1)/(e n) \right) \\ & = \sqrt{ log \left( (n ^{2})/(2 \pi log \left( (n ^{2})/(2 \pi) \right)) \right) ~} ⋅ \left( 1 + (\gamma)/(log n) +l{o} \left( (1)/(log n) \right) \right) , \end{align}

where

\gamma _{E} is the Euler–Mascheroni constant.

Related distributions

1. If

X \sim rm{GEV}(\mu,\sigma,\xi) then m X + b \sim rm{GEV}(m \mu + b, m\sigma, \xi)

1. If

X \sim rm{Gumbel}(\mu, \sigma) (Gumbel distribution) then X \sim rm{GEV}(\mu,\sigma,0)

1. If

X \sim rm{Weibull}(\sigma,\mu) (Weibull distribution) then \mu\left( 1- \sigma log \tfrac{X}{\sigma} \right) \sim rm{GEV}(\mu,\sigma,0)

1. If

X \sim rm{GEV}(\mu,\sigma,0) then \sigma \exp ( - \tfrac{X - \mu}{\mu \sigma} ) \sim rm{Weibull}(\sigma,\mu) (Weibull distribution)

1. If

X \sim rm{Exponential}(1) (Exponential distribution) then \mu - \sigma log X \sim rm{GEV}(\mu,\sigma,0)

1. If

X \sim Gumbel (\alpha _{X,} \beta) and Y \sim Gumbel (\alpha _{Y,} \beta) then X - Y \sim Logistic (\alpha _{X-\alpha} _{Y,\beta)} (see Logistic distribution).

1. If

X and Y \sim Gumbel (\alpha, \beta) then X + Y \nsim Logistic ( 2 \alpha,\beta) (The sum is not a logistic distribution).

Note that

\operatorname{ E}\{ X + Y \} = 2 \alpha +2 \beta\gamma ≠ 2 \alpha = \operatorname{ E}\left\{ \operatorname{Logistic}(2 \alpha,\beta) \right\} ~.

Proofs

4. Let

X \sim rm{ Weibull }(\sigma,\mu) , then the cumulative distribution of g(x) = \mu\left( 1- \sigma log (X)/(\sigma) \right) is:\begin{align} \operatorname{ P}\left\{ \mu \left( 1- \sigma log (X)/(\sigma) \right) < x \right\} & = \operatorname{ P}\left\{ log (X)/(\sigma) > (1- x/\mu)/(\sigma) \right\} \ {} \\ & Since the logarithm is always increasing: \ {} \\ & = \operatorname{ P}\left\{ X > \sigma \exp\left[ (1- x/\mu)/(\sigma) \right] \right\} \\ & = \exp\left( - \left(\cancel{\sigma} \exp\left[ (1- x/\mu)/(\sigma) \right] ⋅ \cancel{ (1)/(\sigma) } \right)^\mu \right) \\&= \exp\left(- \left(\exp\left[\frac{\cancelto{\mu}{1} - x/\cancel{\mu}}{\sigma} \right] \right)^\cancel \right) \\&= \exp\left(- \exp\left[\frac{\mu - x}{\sigma} \right] \right) \\&= \exp\left(- \exp\left[- s \right] \right), \quad s = \frac\,\end

which is the cdf for

\sim rm{GEV}(\mu,\sigma,0) ~.

5. Let

X \sim rm{Exponential}(1) , then the cumulative distribution of g(X) = \mu - \sigma log X is:\begin{align} \operatorname{ P}\left\{ \mu - \sigma log X < x \right\} & = \operatorname{ P}\left\{ log X > (\mu - x)/(\sigma) \right\} \ {} \\ & Since the logarithm is always increasing: \ {} \\ & = \operatorname{ P}\left\{ X > \exp\left( (\mu - x)/(\sigma) \right) \right\} \\ & = \exp\left[ - \exp\left( (\mu - x)/(\sigma) \right) \right] \\ & = \exp\left[ - \exp( - s) \right] , ~ where ~ s \equiv (x - \mu)/(\sigma) ; \end{align}

which is the cumulative distribution of

\operatorname{GEV}(\mu, \sigma, 0 ) ~.

See also

• Extreme value theory (univariate theory)
• Fisher–Tippett–Gnedenko theorem
• Generalized Pareto distribution
• German tank problem, opposite question of population maximum given sample maximum
• Pickands–Balkema–De Haan theorem

Further reading

• Book: Embrechts . Paul . Klüppelberg . Claudia. Claudia Klüppelberg . Mikosch . Thomas . Modelling extremal events for insurance and finance . 1997 . Berlin . Springer Verlag . 9783540609315 .
• Book: Leadbetter, M.R., Lindgren, G. and Rootzén, H. . Extremes and related properties of random sequences and processes . Springer-Verlag . 1983 . 0-387-90731-9 .
• Book: Resnick, S.I. . Extreme values, regular variation and point processes . Springer-Verlag . 1987 . 0-387-96481-9 .
• Book: Coles, Stuart . An Introduction to Statistical Modeling of Extreme Values . Springer-Verlag . 2001 . 1-85233-459-2 .

Notes and References

1. Web site: Weisstein. Eric W.. Extreme Value Distribution. 2021-08-06. mathworld.wolfram.com. en.
2. Book: Haan . Laurens . Ferreira . Ana . Extreme value theory: an introduction . 2007 . Springer.
3. Jenkinson, Arthur F. The frequency distribution of the annual maximum (or minimum) values of meteorological elements. Quarterly Journal of the Royal Meteorological Society. 158–171. 1955. 81. 348. 10.1002/qj.49708134804. 1955QJRMS..81..158J .
4. Book: Haan, Laurens. Ferreira, Ana. Extreme value theory: an introduction. Springer. 2007.
5. von Mises, R.. La distribution de la plus grande de n valeurs. Rev. Math. Union Interbalcanique 1. 1936. 141–160.
6. Calculating CVaR and bPOE for common probability distributions with application to portfolio optimization and density estimation . 10.1007/s10479-019-03373-1 . 2021 . Norton . Matthew . Khokhlov . Valentyn . Uryasev . Stan . Annals of Operations Research . 299 . 1–2 . 1281–1315 . 1811.11301 .
7. http://www.unalmed.edu.co/~ndgirald/Archivos%20Lectura/Archivos%20curso%20Riesgo%20Operativo/moscadelli%202004.pdf Moscadelli, Marco. "The modelling of operational risk: experience with the analysis of the data collected by the Basel Committee." Available at SSRN 557214 (2004).
8. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.523.6456&rep=rep1&type=pdf Kjersti Aas, lecture, NTNU, Trondheim, 23 Jan 2008
9. Liu . Xin . Wang . Yu . 2022 . Quantifying annual occurrence probability of rainfall-induced landslide at a specific slope . Computers and Geotechnics . en . 149 . 104877 . 10.1016/j.compgeo.2022.104877. 2022CGeot.14904877L . 250232752 .
10. Book: David . Herbert A. . Order statistics . Nagaraja . Haikady N. . John Wiley & Sons . 2004 . 299.