Studentized range distribution explained

In probability and statistics, studentized range distribution is the continuous probability distribution of the studentized range of an i.i.d. sample from a normally distributed population.

Suppose that we take a sample of size n from each of k populations with the same normal distribution N(μ, σ²) and suppose that

\bar{y} _{min} is the smallest of these sample means and \bar{y} _{max} is the largest of these sample means, and suppose s² is the pooled sample variance from these samples. Then the following statistic has a Studentized range distribution.q = (\overline{y)/(_{max}) - \overline{y} _{min} }

Definition

Probability density function

Differentiating the cumulative distribution function with respect to q gives the probability density function.

f _{R(q;k,\nu)} = (\sqrt{ 2 \pi)/(k(k -1 )\nu) ^{\nu/2} }\int_0^\infty s^\nu \, \varphi(\sqrt \,s)\,\left[\int_{-\infty}^\infty \varphi(z+q\,s)\,\varphi(z)\, \left[\Phi(z+q\,s)-\Phi(z)\right]^ \, \mathrmz\right] \, \mathrms

Note that in the outer part of the integral, the equation

\varphi(\sqrt{\nu}s) \sqrt{ 2 \pi} = e ^{- \left(\nu s ^{2/2\right)}} was used to replace an exponential factor.

Cumulative distribution function

The cumulative distribution function is given by ^[1]

F _{R(q;k,\nu)} = (\sqrt{ 2 \pi)/(k\nu) ^{\nu/2} } \int_0^\infty s^ \varphi(\sqrt\,s) \left[\int_{-\infty}^\infty \varphi(z) \left[\Phi(z+q\,s)-\Phi(z)\right]^ \, \mathrmz \right] \, \mathrms

Special cases

If k is 2 or 3,^[2] the studentized range probability distribution function can be directly evaluated, where

\varphi(z) is the standard normal probability density function and \Phi(z) is the standard normal cumulative distribution function.f _{R(q;k=2)} = \sqrt{ 2 }\varphi\left(q/\sqrt{ 2 }\right) f _{R(q;k=3)} = 6 \sqrt{ 2 } \varphi\left(q/\sqrt{ 2 }\right)\left[\Phi\left( q / \sqrt{ 6 } \right) - \tfrac{ 1 }{ 2 } \right]

When the degrees of freedom approaches infinity the studentized range cumulative distribution can be calculated for any k using the standard normal distribution.

F _{R(q;k)} = k \int ^{inf ty} _{-inf ty} \varphi(z) l [\Phi(z + q) - \Phi(z) r ] ^{k-1} d z = k \int ^{inf ty} _{-inf ty} l [\Phi(z + q) - \Phi(z) r ] ^{k-1} d \Phi(z)

Applications

Critical values of the studentized range distribution are used in Tukey's range test.^[3]

The studentized range is used to calculate significance levels for results obtained by data mining, where one selectively seeks extreme differences in sample data, rather than only sampling randomly.

The Studentized range distribution has applications to hypothesis testing and multiple comparisons procedures. For example, Tukey's range test and Duncan's new multiple range test (MRT), in which the sample x₁, ..., x_n is a sample of means and q is the basic test-statistic, can be used as post-hoc analysis to test between which two groups means there is a significant difference (pairwise comparisons) after rejecting the null hypothesis that all groups are from the same population (i.e. all means are equal) by the standard analysis of variance.^[4]

Related distributions

When only the equality of the two groups means is in question (i.e. whether μ₁ = μ₂), the studentized range distribution is similar to the Student's t distribution, differing only in that the first takes into account the number of means under consideration, and the critical value is adjusted accordingly. The more means under consideration, the larger the critical value is. This makes sense since the more means there are, the greater the probability that at least some differences between pairs of means will be significantly large due to chance alone.

Derivation

The studentized range distribution function arises from re-scaling the sample range R by the sample standard deviation s, since the studentized range is customarily tabulated in units of standard deviations, with the variable . The derivation begins with a perfectly general form of the distribution function of the sample range, which applies to any sample data distribution.

In order to obtain the distribution in terms of the "studentized" range q, we will change variable from R to s and q. Assuming the sample data is normally distributed, the standard deviation s will be distributed. By further integrating over s we can remove s as a parameter and obtain the re-scaled distribution in terms of q alone.

General form

For any probability density function f, the range probability density f is:^[2]

f _{R(r;k)} = k(k -1 )\int ^{inf ty} _{-inf ty} f _{X\left(t+\tfrac{1}{2}} r\right)f _{X} \left(t - \tfrac{ 1 }{ 2 } r\right) \left[\int _{t-\tfrac{1} { 2 }r} ^{t+\tfrac{1} { 2 } r} f _{X(x)} d x\right] ^{k-2} d t

What this means is that we are adding up the probabilities that, given k draws from a distribution, two of them differ by r, and the remaining k - 2 draws all fall between the two extreme values. If we change variables to u where

u = t - \tfrac{ 1 }{ 2 } r is the low-end of the range, and define F as the cumulative distribution function of f, then the equation can be simplified:f _{R(r;k)} = k(k -1 )\int ^{inf ty} _{-inf ty} f _{X(u+r)} f _{X(u)} \left[ F _{X(u+r)-F} _{X(u)} \right] ^{k-2} d u

We introduce a similar integral, and notice that differentiating under the integral-sign gives

\begin{align} (\partial)/(\partial r) & \left[ k\int ^{inf ty} _{-inf ty} f _{X(u)} l [ F _{X(u+r)-F} _{X(u)} r ] ^{k-1} d u \right] \\[ 5 pt] = {} & k(k -1 )\int ^{inf ty} _{-inf ty} f _{X(u+r)} f _{X(u)} l [ F _{X(u+r)-F} _{X(u)} r ] ^{k-2} d u \end{align}

which recovers the integral above, so that last relation confirms

\begin{align} F _{R(r;k)} & = k \int ^{inf ty} _{-inf ty} f _{X(u)} l [ F _{X(u+r)-F} _{X(u)} r ] ^{k-1} d u \\ & = k \int ^{inf ty} _{-inf ty} l [ F _{X(u+r)-F} _{X(u)} r ] ^{k-1} d F _{X(u) \end{align}}

because for any continuous cdf

(\partial F _{R(r;k)})/(\partial r) = f _{R(r;k)}

Special form for normal data

The range distribution is most often used for confidence intervals around sample averages, which are asymptotically normally distributed by the central limit theorem.

In order to create the studentized range distribution for normal data, we first switch from the generic f and F to the distribution functions φ and Φ for the standard normal distribution, and change the variable r to s·q, where q is a fixed factor that re-scales r by scaling factor s:

f _{R(q;k)} = sk(k -1 )\int ^{inf ty} _{-inf ty} \varphi(u + sq) \varphi(u) \left[ \Phi(u + sq) - \Phi(u) \right] ^{k-2} d u

Choose the scaling factor s to be the sample standard deviation, so that q becomes the number of standard deviations wide that the range is. For normal data s is chi distributed and the distribution function f of the chi distribution is given by:

f _{S(s;\nu)ds =} \begin{cases} \dfrac{\nu ^{\nu/2} s ^{\nu-1} e ^{- \nus ^{2/2}} }{ 2 ^{\left(\nu/2} \Gamma(\nu/ 2 )} d s & for 0 < s < inf ty, \\[ 4 pt] 0 & otherwise . \end{cases}

Multiplying the distributions f and f and integrating to remove the dependence on the standard deviation s gives the studentized range distribution function for normal data:

f _{R(q;k,\nu)} = (\nu ^{\nu/2} k(k -1 ))/(2 ^{\left(} \Gamma(\nu/ 2 )) \int ^{inf ty} _{0} s ^{\nu} e ^{- \nu s ^{2/2}} \int ^{inf ty} _{-inf ty} \varphi(u + sq) \varphi(u) \left[ \Phi(u + sq) - \Phi(u) \right] ^{k-2} d u d s where

q is the width of the data range measured in standard deviations,

is the number of degrees of freedom for determining the sample standard deviation, and

k is the number of separate averages that form the points within the range.

The equation for the pdf shown in the sections above comes from using

e ^{- \nus ^{2/2}} = \sqrt{ 2 \pi}\varphi(\sqrt{\nu}s) to replace the exponential expression in the outer integral.

Further reading

• Pearson . E.S. . Egon Pearson . Hartley . H.O. . Herman Otto Hartley . The probability integral of the range in samples of N observations from a normal population . . 32 . 3 . 301–310 . 1942 . 2332134 . 10.1093/biomet/32.3-4.309.
• Hartley . H.O. . Herman Otto Hartley . The range in random samples . . 32 . 3 . 334–348 . 1942 . 2332137 . 10.2307/2332137.
• Dunlap . W.P. . Powell . R.S. . Konnerth . T.K. . A FORTRAN IV function for calculating probabilities associated with the studentized range statistic . Behavior Research Methods & Instrumentation . 9 . 4 . 373–375 . 1977 . 10.3758/BF03202264. free .

External links

• Table of critical values for the Studentized range distribution

Notes and References

1. Lund . R.E. . Lund . J.R. . Algorithm AS 190: Probabilities and upper quantiles for the studentized range . Journal of the Royal Statistical Society . 32 . 2 . 204–210 . 1983 . 2347300.
2. McKay, A.T. . 1933 . A note on the distribution of range in samples of n . . 25 . 3 . 415–420 . 2332292 . 10.2307/2332292.
3. Web site: StatsExamples | table of Q distribution critical values for alpha=0.05.
4. Pearson & Hartley (1970, Section 14.2)