Imprecise Dirichlet process explained

In probability theory and statistics, the Dirichlet process (DP) is one of the most popular Bayesian nonparametric models. It wasintroduced by Thomas Ferguson^[1] as a prior over probability distributions.

DP \left(s,G _{0\right)} is completely defined by its parameters: G _{0} (the base distribution or base measure) is an arbitrary distribution and s (the concentration parameter) is a positive real number (it is often denoted as \alpha ).According to the Bayesian paradigm these parameters should be chosen based on the available prior information on the domain.

The question is: how should we choose the prior parameters

\left(s,G _{0\right)} of the DP, in particular the infinite dimensional one G _{0} , in case of lack of prior information?

To address this issue, the only prior that has been proposed so far is the limiting DP obtained for

s → 0 , which has been introduced underthe name of Bayesian bootstrap by Rubin;^[2] in fact it can be proven that the Bayesian bootstrap is asymptotically equivalent to the frequentist bootstrap introduced by Bradley Efron.^[3] The limiting Dirichlet process s → 0 has been criticized on diverse grounds. From an a-priori point of view, the maincriticism is that taking s → 0 is far from leading to a noninformative prior.^[4] Moreover, a-posteriori, it assigns zero probability to any set that does not include the observations.^[2]

The imprecise Dirichlet^[5] process has been proposed to overcome these issues. The basic idea is to fix

s > 0 but do not choose any precise base measure G _{0} .

More precisely, the imprecise Dirichlet process (IDP) is defined as follows:

~~ IDP :~\left\{ DP \left(s,G _{0\right):~~G} _{0} \in P \right\}

where

P is the set of all probability measures. In other words, the IDP is the set of all Dirichlet processes (with a fixed s > 0 ) obtainedby letting the base measure G _{0} to span the set of all probability measures.

Inferences with the Imprecise Dirichlet Process

Let

P a probability distribution on ( X , l{B}) (here X is a standard Borel space with Borel \sigma -field l{B} ) and assume that P\sim DP (s,G _{0)} .Then consider a real-valued bounded function f defined on ( X , l{B}) . It is well known that the expectation of E[f] with respect to the Dirichlet process isl{E} [ E(f) ] = l{E}\left[\int f dP\right] = \int f d l{E}[P] = \int f dG _{0.}

One of the most remarkable properties of the DP priors is that the posterior distribution of

P is again a DP.Let X _{1,...,X} _{n} be an independent and identically distributed sample from P and P \sim Dp(s,G _{0)} , then the posterior distribution of P given the observations isP\mid X _{1,...,X} _{n} \sim Dp\left(s + n, G _{n\right),~~~} with ~~~~~~ G _{n = (s)/(s + n)} G _{0+} (1)/(s + n) \sum\limits ^{n} _{i =1} \delta _{X _{i}} ,

where

\delta _{X _{i}} is an atomic probability measure (Dirac's delta) centered at X _{i} . Hence, it followsthat l{E}[E(f)\mid X _{1,...,X} _{n]=} \int f dG _{n.} Therefore, for any fixed G _{0} , we can exploit the previous equations to derive prior and posterior expectations.

In the IDP

G _{0} can span the set of all distributions P . This implies that we will get a different prior and posterior expectation of E(f) for any choice of G _{0} . A way to characterize inferences for the IDP is by computing lower and upper bounds for the expectation of E(f) w.r.t. G _{0} \in P .A-priori these bounds are: \underline{ l{E}} [E(f)] =inf \limits _{G _{0} \in P} \int f dG _{0=inf} f, ~~~~\overline{ l{E}} [E(f)] = \sup\limits _{G _{0} \in P} \int f dG _{0=\sup} f,

the lower (upper) bound is obtained by a probability measure that puts all the mass on the infimum (supremum) of

f , i.e., G _{0=\delta} ^{X _{0}} with X _{0=\arg} inf f (or respectively with X _{0=\arg} \sup f ). From the above expressions of the lower and upper bounds, it can be observed that the range of l{E}[E(f)] under the IDP is the same as the original range of f . In other words, by specifying the IDP, we are not giving any prior information on the value of the expectation of f . A-priori, IDP is therefore a model of prior (near)-ignorance for E(f) .

A-posteriori, IDP can learn from data. The posterior lower and upper bounds for the expectation of

E(f) are in fact given by:\begin{align} \underline{ l{E}} [E(f)\mid X _{1,...,X} _{n]} & = inf \limits _{G _{0} \in P} \int f dG _{n} = (s)/(s + n) inf f + \int f(X) (1)/(s + n) \sum\limits ^{n} _{i =1} \delta _{X _{i}} (dX) \\ & = (s)/(s + n) inf f + (n)/(s + n) (\sum\limits ^{n} _{i =1} f(X _{i)})/(n) ,\\[ 6 pt] \overline{ l{E}} [E(f)\mid X _{1,...,X} _{n]&=\sup\limits} ^{G _{0} \in P} \int f dG _{n=} (s)/(s + n) \sup f + \int f(X) (1)/(s + n) \sum\limits ^{n} _{i =1} \delta _{X _{i}} (dX) \\ & = (s)/(s + n) \sup f + (n)/(s + n) (\sum\limits ^{n} _{i =1} f(X _{i)})/(n) . \end{align}

It can be observed that the posterior inferences do not depend on

G _{0} . To define the IDP, the modeler has only to choose s (the concentration parameter). This explains the meaning of the adjective near in prior near-ignorance, because the IDP requires by the modeller the elicitation of a parameter. However, this is a simple elicitation problem for a nonparametric prior, since we only have to choose the value of a positive scalar (there are not infinitely many parameters left in the IDP model).

Finally, observe that for

n → inf ty , IDP satisfies\underline{ l{E}} \left[E(f)\mid X _{1,} ... ,X _{n\right],} \overline{ l{E}} \left[E(f) \mid X _{1,...,X} _{n\right]} → S(f),

where

S(f) = \lim _{n →} \tfrac{ 1 }{n}\sum ^{n} _{i =1} f(X _{i)} . In other words, the IDP is consistent.

Choice of the prior strength

s

The IDP is completely specified by

s , which is the only parameter left in the prior model.Since the value of s determines how quickly lower and upper posterior expectations converge at theincrease of the number of observations, s can be chosen so to match a certain convergence rate.^[5] The parameter s can also be chosen to have some desirable frequentist properties (e.g., credible intervals to becalibrated frequentist intervals, hypothesis tests to be calibrated for the Type I error, etc.), see Example: median test

Example: estimate of the cumulative distribution

Let

X _{1,...,} X _{n} be i.i.d. real random variables with cumulative distribution function F(x) .

Since

F(x) = E[ I _{(infty,x]} ] , where I _{(infty,x]} is the indicator function, we can useIDP to derive inferences about F(x). The lower and upper posterior mean of F(x) are\begin{align} & \underline{ l{E}}\left[F(x)\mid X _{1,...,X} _{n\right]} = \underline{ l{E}} [E( I _{(infty,x]} )\mid X _{1,...,X} _{n]} \\ = {} & (n)/(s + n) (\sum\limits ^{n} _{i =1} I _{(infty,x]} (X _{i)})/(= n) (n)/(s + n) \hat{F}(x), \\[ 12 pt] & \overline{ l{E}}\left[F(x)\mid X _{1,...,X} _{n\right]} = \overline{ l{E}} \left[E( I _{(infty,x]} )\mid X _{1,...,X} _{n\right]} \\ = {} & (s)/(s + n) + (n)/(s + n) (\sum\limits ^{n} _{i =1} I _{(infty,x]} (X _{i)})/(n) = (s)/(s + n) + (n)/(s + n) \hat{F}(x). \end{align}

where

\hat{F}(x) is the empirical distribution function. Here, to obtain the lower we have exploited the fact that inf I _{(infty,x]} =0 and for the upper that \sup I _{(infty,x]} =1 .

Note that, for any precise choice of

G _{0} (e.g., normal distribution l{N}(x;0,1) ), the posterior expectation of F(x) will be included between the lower and upper bound.

Example: median test

IDP can also be used for hypothesis testing, for instance to test the hypothesis

F( 0 )< 0 . 5 , i.e., the median of F is greater than zero.By considering the partition ( -inf ty, 0 ],( 0 , inf ty) and the property of the Dirichlet process, it can be shown thatthe posterior distribution of F( 0 ) isF( 0 ) \sim Beta (\alpha _{0+n} _{<0} ,\beta _{0+n-n} _{<0} )

where

n _{<0} is the number of observations that are less than zero,\alpha _{0=s\int} ^{0} ^{-inf ty} dG _{0} and \beta _{0=s\int} ^{inf ty} ^{0} dG _{0.}

By exploiting this property, it follows that

\underline{ l{P}} [F( 0 )< 0 . 5 \mid X _{1,...,X} _{n]} = \int\limits ^{0 . 5} _{0} Beta (\theta;s + n _{<0} ,n - n _{<0} )d\theta = I _{1/2} (s + n _{<0} ,n - n _{<0} ), \overline{ l{P}} [F( 0 )< 0 . 5 \mid X _{1,...,X} _{n]=\int\limits} ^{0 . 5} ^{0} Beta (\theta;n _{<0} ,s + n - n _{<0} )d\theta = I _{1/2} (n _{<0} ,s + n - n _{<0} ).

where

I _{x} (\alpha,\beta) is the regularized incomplete beta function.We can thus perform the hypothesis test\underline{ l{P}} [F( 0 )< 0 . 5 \mid X _{1,...,X} _{n]>1-\gamma,} ~~\overline{ l{P}} [F( 0 )< 0 . 5 \mid X _{1,...,X} _{n]>1-\gamma,}

(with

1- \gamma =0 . 95 for instance) and then

1. if both the inequalities are satisfied we can declare that

F( 0 )< 0 . 5 with probability larger than 1- \gamma ;

1. if only one of the inequality is satisfied (which has necessarily to be the one for the upper), we are in an indeterminate situation, i.e., we cannot decide;
2. if both are not satisfied, we can declare that the probability that

F( 0 )< 0 . 5 is lower than the desired probability of 1- \gamma .

IDP returns an indeterminate decision when the decision is prior dependent (that is when it would depend on the choice of

G _{0} ).

By exploiting the relationship between the cumulative distribution function of the Beta distribution, and the cumulative distribution function of a random variable Z from a binomial distribution, where the "probability of success" is p and the sample size is n:

F(k;n,p) = \Pr(Z \le k) = I _{1-p} (n - k, k +1 ) = 1 - I _{p(k+1,n-k),}

we can show that the median test derived with th IDP for any choice of

s\geq 1 encompasses the one-sided frequentistsign test as a test for the median. It can in fact be verified that for s = 1 the p -value of the sign test is equal to 1- \underline{ l{P}} [F( 0 )< 0 . 5 \mid X _{1,...,X} _{n]} . Thus, if \underline{ l{P}} [F( 0 )< 0 . 5 \mid X _{1,...,X} _{n]>0.95} then the p -value is less than 0 . 05 and, thus, they two tests have the same power.

Applications of the Imprecise Dirichlet Process

Dirichlet processes are frequently used in Bayesian nonparametric statistics. The Imprecise Dirichlet Processcan be employed instead of the Dirichlet processes in any application in which prior information is lacking (it is therefore important to model this state of prior ignorance).

In this respect, the Imprecise Dirichlet Process has been used for nonparametric hypothesis testing, see the Imprecise Dirichlet Process statistical package.Based on the Imprecise Dirichlet Process, Bayesian nonparametric near-ignorance versions of the following classical nonparametric estimators have been derived: the Wilcoxon rank sum test^[5] and the Wilcoxon signed-rank test.^[6]

A Bayesian nonparametric near-ignorance model presents several advantages with respect to a traditional approach to hypothesis testing.

1. The Bayesian approach allows us to formulate the hypothesis test as a decision problem. This means that we can verify the evidence in favor of the null hypothesis and not only rejecting it and take decisions which minimize the expected loss.
2. Because of the nonparametric prior near-ignorance, IDP based tests allows us to start the hypothesis test with very weak prior assumptions, much in the direction of letting data speak for themselves.
3. Although the IDP test shares several similarities with a standard Bayesian approach, at the same time it embodies a significant change of paradigm when it comes to take decisions. In fact the IDP based tests have the advantage of producing an indeterminate outcome when the decision is prior-dependent. In other words, the IDP test suspends the judgment when the option which minimizes the expected loss changes depending on the Dirichlet Process base measure we focus on.
4. It has been empirically verified that when the IDP test is indeterminate, the frequentist tests are virtually behaving as random guessers. This surprising result has practical consequences in hypothesis testing. Assume that we are trying to compare the effects of two medical treatments (Y is better than X) and that, given the available data, the IDP test is indeterminate. In such a situation the frequentist test always issues a determinate response (for instance I can tell that Y is better than X), but it turns out that its response is completely random, like if we were tossing of a coin. On the other side, the IDP test acknowledges the impossibility of making a decision in these cases. Thus, by saying "I do not know", the IDP test provides a richer information to the analyst. The analyst could for instance use this information to collect more data.

Categorical variables

For categorical variables, i.e., when

X has a finite number of elements, it is known thatthe Dirichlet process reduces to a Dirichlet distribution.In this case, the Imprecise Dirichlet Process reduces to the Imprecise Dirichlet model proposed by Walley^[7] as a model for prior (near)-ignorance for chances.

See also

Imprecise probability

Robust Bayesian analysis

External links

• Open source implementation of hypothesis tests based on the IDP
• The imprecise probability group at IDSIA

Notes and References

1. Ferguson . Thomas . Thomas Ferguson (statistician) . Bayesian analysis of some nonparametric problems . . 1 . 2 . 209 - 230 . 1973 . 10.1214/aos/1176342360 . 350949 . free .
2. Rubin D (1981). The Bayesian bootstrap. Ann. Stat. 9 130–134
3. Efron B (1979). Bootstrap methods: Another look at the jackknife. Ann. Stat. 7 1–26
4. Sethuraman. J.. Tiwari. R. C.. Convergence of Dirichlet measures and the interpretation of their parameter. Defense Technical Information Center. 1981.
5. Benavoli. Alessio. Mangili. Francesca. Ruggeri. Fabrizio. Zaffalon. Marco. Imprecise Dirichlet Process with application to the hypothesis test on the probability that X< Y. 1402.2755. math.ST. 2014.
6. Benavoli. Alessio. Mangili. Francesca. Corani. Giorgio. Ruggeri. Fabrizio. Zaffalon. Marco. A Bayesian Wilcoxon signed-rank test based on the Dirichlet process. Proceedings of the 30th International Conference on Machine Learning (ICML 2014). 2014.
7. Book: Walley , Peter . Statistical Reasoning with Imprecise Probabilities. Chapman and Hall. 1991. London. 0-412-28660-2 .