Generalized beta distribution explained

In probability and statistics, the generalized beta distribution^[1] is a continuous probability distribution with four shape parameters (however it's customary to make explicit the scale parameter as a fifth parameter, while the location parameter is usually left implicit), including more than thirty named distributions as limiting or special cases. It has been used in the modeling of income distribution, stock returns, as well as in regression analysis. The exponential generalized beta (EGB) distribution follows directly from the GB and generalizes other common distributions.

Definition

A generalized beta random variable, Y, is defined by the following probability density function:

GB(y;a,b,c,p,q) = (|a|y ^{ap-1} ( 1- ( 1- c)(y/b) ^{a} ) ^{q-1})/(b ^{ap} B(p,q)( 1+ c(y/b) ^{a} ) ^{p+q}) for 0 <y ^{a} < (b ^{a})/(1- c) , and zero otherwise. Here the parameters satisfy a \ne 0 , 0 \le c \le 1 and b , p , and q positive. The function B(p,q) is the beta function. The parameter b is the scale parameter and can thus be set to 1 without loss of generality, but it is usually made explicit as in the function above (while the location parameter is usually left implicit and set to 0 as in the function above).

Properties

Moments

It can be shown that the hth moment can be expressed as follows:

\operatorname{E} _{GB} (Y ^{h} ) = (b ^{h} B(p + h/a,q))/(B(p,q)) {} _{2} F _{1} \begin{bmatrix} p + h/a,h/a;c \\ p + q + h/a; \end{bmatrix}, where {} _{2} F _{1} denotes the hypergeometric series (which converges for all h if c < 1, or for all h / a < q if c = 1).

Related distributions

The generalized beta encompasses many distributions as limiting or special cases. These are depicted in the GB distribution tree shown above. Listed below are its three direct descendants, or sub-families.

Generalized beta of first kind (GB1)

The generalized beta of the first kind is defined by the following pdf:

GB 1 (y;a,b,p,q) = (|a|y ^{ap-1} ( 1- (y/b) ^{a} ) ^{q-1})/(b ^{ap} B(p,q)) for 0 < y ^{a} <b ^{a} where b , p , and q are positive. It is easily verified thatGB 1 (y;a,b,p,q) = GB(y;a,b,c =0 ,p,q). The moments of the GB1 are given by\operatorname{E} _{GB1} (Y ^{h} ) = (b ^{h} B(p + h/a,q))/(B(p,q)) . The GB1 includes the beta of the first kind (B1), generalized gamma(GG), and Pareto as special cases:B 1 (y;b,p,q) = GB 1 (y;a =1 ,b,p,q) , GG(y;a,\beta,p) = \lim _{q} GB 1 (y;a,b = q ^{1/a} \beta,p,q) , PARETO(y;b,p) = GB 1 (y;a =-1 ,b,p,q =1 ) .

Generalized beta of the second kind (GB2)

The GB2 is defined by the following pdf:

GB 2 (y;a,b,p,q) = (|a|y ^{ap-1})/(b ^{ap} B(p,q)( 1+ (y/b) ^{a)} ^{p+q}) for 0 < y < inf ty and zero otherwise. One can verify thatGB 2 (y;a,b,p,q) = GB(y;a,b,c =1 ,p,q). The moments of the GB2 are given by\operatorname{E} _{GB2} (Y ^{h)} = (b ^{h} B(p + h/a,q - h/a))/(B(p,q)) .

The GB2 is also known as the Generalized Beta Prime (Patil, Boswell, Ratnaparkhi (1984)),^[2] the transformed beta (Venter, 1983),^[3] the generalized F (Kalfleisch and Prentice, 1980),^[4] and is a special case (μ≡0) of the Feller-Pareto (Arnold, 1983)^[5] distribution. The GB2 nests common distributions such as the generalized gamma (GG), Burr type 3, Burr type 12, Dagum, lognormal, Weibull, gamma, Lomax, F statistic, Fisk or Rayleigh, chi-square, half-normal, half-Student's t, exponential, asymmetric log-Laplace, log-Laplace, power function, and the log-logistic.^[6]

Beta

The beta family of distributions (B) is defined by:^[1]

B(y;b,c,p,q) = (y ^{p-1} ( 1- ( 1- c)(y/b)) ^{q-1})/(b ^{p} B(p,q)( 1+ c(y/b)) ^{p+q}) for 0 <y<b/( 1- c) and zero otherwise. Its relation to the GB is seen below:B(y;b,c,p,q) = GB(y;a =1 ,b,c,p,q). The beta family includes the beta of the first and second kind^[7] (B1 and B2, where the B2 is also referred to as the Beta prime), which correspond to c = 0 and c = 1, respectively. Setting c = 0 , b = 1 yields the standard two-parameter beta distribution.

Generalized Gamma

The generalized gamma distribution (GG) is a limiting case of the GB2. Its PDF is defined by:^[8]

GG(y;a,\beta,p) = \lim _{q} GB 2 (y,a,b = q ^{1/a} \beta,p,q) = (|a|y ^{ap -1} e ^{- (y/\beta) ^{a}})/(\beta ^{ap} \Gamma (p)) with the h th moments given by\operatorname{E}(Y ^{h)} _{GG} = (\beta ^{h} \Gamma (p + h/a))/(\Gamma (p)) .

As noted earlier, the GB distribution family tree visually depicts the special and limiting cases (see McDonald and Xu (1995)).

Pareto

The Pareto (PA) distribution is the following limiting case of the generalized gamma:

PA(y;\beta,\theta) = \lim _{a} GG(y;a,\beta,p =- \theta /a) = \lim _{a} \left( (\theta y ^{-\theta-1} e ^{- (y/\beta) ^{a}})/(\beta ^{-\theta} ( - \theta / a)\Gamma( - \theta / a)) \right) = \lim _{a} \left( (\theta y ^{-\theta} e ^{- (y/\beta) ^{a}})/(\beta ^{-\theta} \Gamma( 1- \theta / a)) \right) = (\theta y ^{-\theta})/(\beta ^{-\theta}) for \beta < y and 0 otherwise.

Power

The power (P) distribution is the following limiting case of the generalized gamma:

P(y;\beta,\theta) = \lim _{a → infty} GG(y;a = \theta /p, \beta, p) = \lim _{a → infty} (\mid (\theta)/(|y ^{\theta-1} e ^{- (y/\beta) ^{a}} p))/(\beta ^{\theta} \Gamma(p)) = \lim _{a → infty} (\theta y ^{\theta})/(p\Gamma(p)\beta ^{\theta}) e ^{- (y/\beta) ^{a}} = \lim _{a → infty} (\theta y ^{\theta})/(\Gamma(p +1 )\beta ^{\theta}) e ^{- (y/\beta) ^{a}} = \lim _{a → infty} (\theta y ^{\theta})/(\Gamma( (\theta)/(+ 1 )\beta ^{\theta} a)) e ^{- (y/\beta) ^{a}} = (\theta y ^{\theta})/(\beta ^{\theta}) , which is equivalent to the power function distribution for 0 \leq y\leq\beta and \theta > 0 .

Asymmetric Log-Laplace

The asymmetric log-Laplace distribution (also referred to as the double Pareto distribution ^[9]) is defined by:^[10]

ALL(y;b, λ _{1,λ} _{2)} = \lim _{a} GB 2 (y;a,b,p = λ _{1/a,q} = λ _{2/a)} = (λ _{1λ} _{2})/(y( λ _{1+λ} _{2)}) \begin{cases} ( (y)/(b) ) ^{λ _{1}} & for 0 < y < b \\ ( (b)/(y) ) ^{λ _{2}} & for y \ge b \end{cases} where the h th moments are given by\operatorname{E}(Y ^{h)} _{ALL} = (b ^{h} λ _{1} λ _{2})/(( λ _{1} + h)( λ _{2} - h)) .

When

λ _{1} = λ _{2} , this is equivalent to the log-Laplace distribution.

Exponential generalized beta distribution

Letting

Y \sim GB(y;a,b,c,p,q) (without location parameter), the random variable Z = ln (Y) , with re-parametrization \delta = ln (b) and \sigma = 1 /a , is distributed as an exponential generalized beta (EGB), with the following pdf:EGB(z;\delta,\sigma,c,p,q) = (e ^{p(z-\delta)/\sigma} ( 1- ( 1- c)e ^{(z-\delta)/\sigma} ) ^{q-1})/(|\sigma|B(p,q)( 1+ ce ^{(z-\delta)/\sigma} ) ^{p+q}) for -inf ty < (z - \delta)/(< ln ( \sigma) (1)/(1- c) ) , and zero otherwise.The EGB includes generalizations of the Gompertz, Gumbel, extreme value type I, logistic, Burr-2, exponential, and normal distributions. The parameter \delta = ln (b) is the location parameter of the EGB (while b is the scale parameter of the GB), and \sigma = 1 /a is the scale parameter of the EGB (while a is a shape parameter of the GB); The EGB has thus three shape parameters.

Included is a figure showing the relationship between the EGB and its special and limiting cases.^[11]

Moment generating function

Using similar notation as above, the moment-generating function of the EGB can be expressed as follows:

M _{EGB} (Z) = (e ^{\delta} B(p + t\sigma,q))/(B(p,q)) {} _{2} F _{1} \begin{bmatrix} p + t\sigma,t\sigma;c \\ p + q + t\sigma; \end{bmatrix}.

Multivariate generalized beta distribution

A multivariate generalized beta pdf extends the univariate distributions listed above. For

n variables y = (y _{1} , ... , y _{n)} , define 1 xn parameter vectors by a = (a _{1} , ... , a _{n)} , b = (b _{1} , ... , b _{n)} , c = (c _{1} , ... , c _{n)} , and p = (p _{1} , ... , p _{n)} where each b _{i} and p _{i} is positive, and 0 \le c _{i} \le 1 . The parameter q is assumed to be positive, and define the function B(p _{1,} ... , p _{n,} q) = (\Gamma(p _{1)...\Gamma(p} _{n)\Gamma(q)})/(\Gamma(\bar{p) + q)} for \bar{p} = \sum ^{n} _{i =1} p _{i} .

The pdf of the multivariate generalized beta (

MGB ) may be written as follows:MGB(y; a, b, p, q, c) = ((\prod ^{n} _{i =1} |a _{i|y} ^{a _{i} p _{i} -1} ^{i} )( 1 - \sum ^{n} _{i =1} ( 1- c _{i)( (y _{i})/(b _{i})} ) ^{a _{i}} ) ^{q})/((\prod ^{n} _{i =1} b ^{a _{i} p _{i}} _{i} )B(p _{1,} ... , p _{n,} q)( 1 + \sum ^{n} _{i =1} c _{i( (y _{i})/(b _{i})} ) ^{a _{i}} ) ^{\bar{p} + q) }

where

0 < \sum ^{n} _{i =1} ( 1- c _{i)( (y _{i})/(b _{i})} ) ^{a _{i}} < 1 for 0 \le c _{i} < 1 and 0 < y _{i} when c _{i} = 1 .

Like the univariate generalized beta distribution, the multivariate generalized beta includes several distributions in its family as special cases. By imposing certain constraints on the parameter vectors, the following distributions can be easily derived.^[12]

Multivariate generalized beta of the first kind (MGB1)

When each

c _{i} is equal to 0, the MGB function simplifies to the multivariate generalized beta of the first kind (MGB1), which is defined by:MGB 1 (y; a, b, p, q) = ((\prod ^{n} _{i =1} |a _{i|y} ^{a _{i} p _{i} -1} ^{i} )( 1 - \sum ^{n} _{i =1} ( (y _{i})/(b _{i}) ) ^{a _{i}} ) ^{q})/((\prod ^{n} _{i =1} b ^{a _{i} p _{i}} _{i} )B(p _{1,} ... , p _{n,} q))

where

0 < \sum ^{n} _{i =1} ( (y _{i})/(b _{i}) ) ^{a _{i}} < 1 .

Multivariate generalized beta of the second kind (MGB2)

In the case where each

c _{i} is equal to 1, the MGB simplifies to the multivariate generalized beta of the second kind (MGB2), with the pdf defined below:MGB 2 (y; a, b, p, q) = ((\prod ^{n} _{i =1} |a _{i|y} ^{a _{i} p _{i} -1} ^{i} ))/((\prod ^{n} _{i =1} b ^{a _{i} p _{i}} _{i} )B(p _{1,} ... , p _{n,} q)( 1 + \sum ^{n} _{i =1} ( (y _{i})/(b _{i}) ) ^{a _{i}} ) ^{\bar{p} + q) }

when

0 < y _{i} for all y _{i} .

Multivariate generalized gamma

The multivariate generalized gamma (MGG) pdf can be derived from the MGB pdf by substituting

b _{i} = \beta _{i} q ^{(1)/(a _{i})} and taking the limit as q \to inf ty , with Stirling's approximation for the gamma function, yielding the following function:MGG(y; a, \beta, p) = ( ((\prod ^{n} _{i =1} |a _{i|y} ^{a _{i} p _{i} -1} ^{i} ))/((\prod ^{n} _{i =1} \beta ^{a _{i} p _{i}} _{i} )\Gamma(p _{i)}) )e ^{- \sum ^{n} _{i =1} ( (y _{i})/(\beta _{i}) ) ^{a _{i}}} = \prod ^{n} _{i =1} GG(y _{i;} a _{i,} \beta _{i,} p _{i)}

which is the product of independently but not necessarily identically distributed generalized gamma random variables.

Other multivariate distributions

Similar pdfs can be constructed for other variables in the family tree shown above, simply by placing an M in front of each pdf name and finding the appropriate limiting and special cases of the MGB as indicated by the constraints and limits of the univariate distribution. Additional multivariate pdfs in the literature include the Dirichlet distribution (standard form) given by

MGB 1 (y; a = 1 , b = 1 , p, q) , the multivariate inverted beta and inverted Dirichlet (Dirichlet type 2) distribution given by MGB 2 (y; a = 1 , b = 1 , p, q) , and the multivariate Burr distribution given by MGB 2 (y; a, b, p, q = 1 ) .

Marginal density functions

The marginal density functions of the MGB1 and MGB2, respectively, are the generalized beta distributions of the first and second kind, and are given as follows:

GB 1 (y _{i;} a _{i,} b _{i,} p _{i,} \bar{p} - p _{i} + q) = (|a _{i|y} ^{a _{i} p _{i} -1} ^{i} ( 1 - ( (y _{i})/(b _{i}) ) ^{a _{i}} ) ^{\bar{p} - p _{i} + q - 1)/() }GB 2 (y _{i;} a _{i,} b _{i,} p _{i,} q) = (|a _{i|y} ^{a _{i} p _{i} -1} ^{i})/(b ^{a _{i} p _{i}} _{i} B(p _{i,} q)( 1 + ( (y _{i})/(b _{i}) ) ^{a _{i}} ) ^{p _{i} + q})

Applications

The flexibility provided by the GB family is used in modeling the distribution of:

• distribution of income
• hazard functions
• stock returns
• insurance losses

Applications involving members of the EGB family include:^{[1] [6]}

• partially adaptive estimation of regression models
• time series models
• (G)ARCH models

Distribution of Income

The GB2 and several of its special and limiting cases have been widely used as models for the distribution of income. For some early examples see Thurow (1970),^[13] Dagum (1977),^[14] Singh and Maddala (1976),^[15] and McDonald (1984).^[6] Maximum likelihood estimations using individual, grouped, or top-coded data are easily performed with these distributions.

Measures of inequality, such as the Gini index (G), Pietra index (P), and Theil index (T) can be expressed in terms of the distributional parameters, as given by McDonald and Ransom (2008):^[16]

\begin{align} G = \left({ (1)/(2 \mu) }\right) \operatorname(|Y-X|) = \left(P\right) \int_^\int_^ |x-y|f(x)f(y)\,dx dy \\= 1 - \frac \\P = \left(\frac\right) \operatorname (|Y-\mu|) = \left(\frac\right)\int_0^ |y-\mu|f(y)\, dy \\T = \operatorname (\ln (Y/\mu)^) = \int_0^ \infty (y/\mu) \ln (y/\mu) f(y)\, dy\end

Hazard Functions

The hazard function, h(s), where f(s) is a pdf and F(s) the corresponding cdf, is defined by

h(s) = (f(s))/(1- F(s))

Hazard functions are useful in many applications, such as modeling unemployment duration, the failure time of products or life expectancy. Taking a specific example, if s denotes the length of life, then h(s) is the rate of death at age s, given that an individual has lived up to age s. The shape of the hazard function for human mortality data might appear as follows: decreasing mortality in the first few months of life, then a period of relatively constant mortality and finally an increasing probability of death at older ages.

Special cases of the generalized beta distribution offer more flexibility in modeling the shape of the hazard function, which can call for "∪" or "∩" shapes or strictly increasing (denoted by I}) or decreasing (denoted by D) lines. The generalized gamma is "∪"-shaped for a>1 and p<1/a, "∩"-shaped for a<1 and p>1/a, I-shaped for a>1 and p>1/a and D-shaped for a<1 and p>1/a.^[17] This is summarized in the figure below.^{[18] [19]}

References

1. McDonald, James B. & Xu, Yexiao J. (1995) "A generalization of the beta distribution with applications," Journal of Econometrics, 66(1–2), 133–152
2. Patil, G.P., Boswell, M.T., and Ratnaparkhi, M.V., Dictionary and Classified Bibliography of Statistical Distributions in Scientific Work Series, editor G.P. Patil, Internal Co-operative Publishing House, Burtonsville, Maryland, 1984.
3. Venter, G., Transformed beta and gamma distributions and aggregate losses, Proceedings of the Casualty Actuarial Society, 1983.
4. Kalbfleisch, J.D. and R.L. Prentice, The Statistical Analysis of Failure Time Data, New York: J. Wiley, 1980
5. Arnold, B.C., Pareto Distributions, Volume 5 in Statistical Distributions in Scientific Work Series, International Co-operative Publishing House, Burtonsville, Md. 1983.
6. McDonald, J.B. (1984) "Some generalized functions for the size distributions of income", Econometrica 52, 647–663.
7. Stuart, A. and Ord, J.K. (1987): Kendall's Advanced Theory of Statistics, New York: Oxford University Press.
8. Stacy, E.W. (1962). "A Generalization of the Gamma Distribution." Annals of Mathematical Statistics 33(3): 1187-1192.
9. Reed, W.J. (2001). "The Pareto, Zipf, and other power laws." Economics Letters 74: 15-19.
10. Higbee, J.D., Jensen, J.E., and McDonald, J.B. (2019). "The asymmetric log-Laplace distribution as a limiting case of the generalized beta distribution."Statistics and Probability Letters 151: 73-78.
11. McDonald, James B. & Kerman, Sean C. (2013) "Skewness-Kurtosis Bounds for EGB1, EGB2, and Special Cases," Forthcoming
12. William M. Cockriel & James B. McDonald (2017): Two multivariate generalized beta families, Communications in Statistics - Theory and Methods,
13. Thurow, L.C. (1970) "Analyzing the American Income Distribution," Papers and Proceedings, American Economics Association, 60, 261-269
14. Dagum, C. (1977) "A New Model for Personal Income Distribution: Specification and Estimation," Economie Applique'e, 30, 413-437
15. Singh, S.K. and Maddala, G.S (1976) "A Function for the Size Distribution of Incomes," Econometrica, 44, 963-970
16. McDonald, J.B. and Ransom, M. (2008) "The Generalized Beta Distribution as a Model for the Distribution of Income: Estimation of Related Measures of Inequality", Modeling the Distributions and Lorenz Curves, "Economic Studies in Inequality: Social Exclusion and Well-Being", Springer: New York editor Jacques Silber, 5, 147-166
17. Glaser, Ronald E. (1980) "Bathtub and Related Failure Rate Characterizations," Journal of the American Statistical Association, 75(371), 667-672
18. McDonald, James B. (1987) "A general methodology for determining distributional forms with applications in reliability," Journal of Statistical Planning and Inference, 16, 365-376
19. McDonald, J.B. and Richards, D.O. (1987) "Hazard Functions and Generalized Beta Distributions", IEEE Transactions on Reliability, 36, 463-466

Bibliography

• C. Kleiber and S. Kotz (2003) Statistical Size Distributions in Economics and Actuarial Sciences. New York: Wiley
• Johnson, N. L., S. Kotz, and N. Balakrishnan (1994) Continuous Univariate Distributions. Vol. 2, Hoboken, NJ: Wiley-Interscience.