Durbin–Watson statistic explained

In statistics, the Durbin–Watson statistic is a test statistic used to detect the presence of autocorrelation at lag 1 in the residuals (prediction errors) from a regression analysis. It is named after James Durbin and Geoffrey Watson. The small sample distribution of this ratio was derived by John von Neumann (von Neumann, 1941). Durbin and Watson (1950, 1951) applied this statistic to the residuals from least squares regressions, and developed bounds tests for the null hypothesis that the errors are serially uncorrelated against the alternative that they follow a first order autoregressive process. Note that the distribution of this test statistic does not depend on the estimated regression coefficients and the variance of the errors.^[1]

A similar assessment can be also carried out with the Breusch–Godfrey test and the Ljung–Box test.

Computing and interpreting the Durbin–Watson statistic

If $e\_t$ is the residual given by

e _{t} = \rho e _{t-1} + \nu _{t} , the Durbin-Watson test statistic isd = {\sum ^{T} _{t =2} (e _{t} - e _{t-1} ) ^{2} \over {\sum ^{T} _{t =1} e ^{2 }},} _{t}

where $T$ is the number of observations. For large $T$, $d$ is approximately equal to $2(1-\; \backslash hat)$, where

\hat \rho is the sample autocorrelation of the residuals at lag 1.^[2] $d\; =\; 2$ therefore indicates no autocorrelation. The value of $d$ always lies between $0$ and $4$. If the Durbin–Watson statistic is substantially less than 2, there is evidence of positive serial correlation. As a rough rule of thumb, if Durbin–Watson is less than 1.0, there may be cause for alarm. Small values of $d$ indicate successive error terms are positively correlated. If $d>2$, successive error terms are negatively correlated. In regressions, this can imply an underestimation of the level of statistical significance.

To test for positive autocorrelation at significance $\backslash alpha$, the test statistic $d$ is compared to lower and upper critical values ($d\_$ and $d\_$):

• If , there is statistical evidence that the error terms are positively autocorrelated.

• If $d\; >\; d\_$, there is no statistical evidence that the error terms are positively autocorrelated.

• If

d < d < d , the test is inconclusive.

Positive serial correlation is serial correlation in which a positive error for one observation increases the chances of a positive error for another observation.

To test for negative autocorrelation at significance $\backslash alpha$, the test statistic $(4\; -\; d)$ is compared to lower and upper critical values ($d\_$ and $d\_$):

• If , there is statistical evidence that the error terms are negatively autocorrelated.

• If $(4\; -\; d)\; >\; d\_$, there is no statistical evidence that the error terms are negatively autocorrelated.

• If

d < ( 4 - d) < d , the test is inconclusive.

Negative serial correlation implies that a positive error for one observation increases the chance of a negative error for another observation and a negative error for one observation increases the chances of a positive error for another.

The critical values, $d\_$ and $d\_$, vary by level of significance ($\backslash alpha$) and the degrees of freedom in the regression equation. Their derivation is complex—statisticians typically obtain them from the appendices of statistical texts.

X of the regression is known, exact critical values for the distribution of d under the null hypothesis of no serial correlation can be calculated. Under the null hypothesis d is distributed as(\sum ^{n - k} _{i =1} \nu _{i} \xi ^{2} _{i})/(\sum ^{n - k} _{i =1} \xi ^{2} _{i}) ,

where $n$ is the number of observations and $k$ is number of regression variables; the

\xi _{i} are independent standard normal random variables; and the \nu _{i} are the nonzero eigenvalues of ( I - X ( X ^{T} X ) ^{-1} X ^{T} ) A , where A is the matrix that transforms the residuals into the d statistic, i.e. d = e ^{TAe.} .^[3] A number of computational algorithms for finding percentiles of this distribution are available.^[4]

Although serial correlation does not affect the consistency of the estimated regression coefficients, it does affect our ability to conduct valid statistical tests. First, the F-statistic to test for overall significance of the regression may be inflated under positive serial correlation because the mean squared error (MSE) will tend to underestimate the population error variance. Second, positive serial correlation typically causes the ordinary least squares (OLS) standard errors for the regression coefficients to underestimate the true standard errors. As a consequence, if positive serial correlation is present in the regression, standard linear regression analysis will typically lead us to compute artificially small standard errors for the regression coefficient. These small standard errors will cause the estimated t-statistic to be inflated, suggesting significance where perhaps there is none. The inflated t-statistic, may in turn, lead us to incorrectly reject null hypotheses, about population values of the parameters of the regression model more often than we would if the standard errors were correctly estimated.

If the Durbin–Watson statistic indicates the presence of serial correlation of the residuals, this can be remedied by using the Cochrane–Orcutt procedure.

The Durbin–Watson statistic, while displayed by many regression analysis programs, is not applicable in certain situations. For instance, when lagged dependent variables are included in the explanatory variables, then it is inappropriate to use this test. Durbin's h-test (see below) or likelihood ratio tests, that are valid in large samples, should be used.

Durbin h-statistic

The Durbin–Watson statistic is biased for autoregressive moving average models, so that autocorrelation is underestimated. But for large samples one can easily compute the unbiased normally distributed h-statistic:

h = \left( 1 - (1)/(2) d \right) \sqrt{ (T)/(1- T ⋅ \widehat {\operatorname{Var) }(\widehat\beta_1\,)}},

using the Durbin–Watson statistic d and the estimated variance

\widehat{\operatorname{Var}} (\widehat\beta _{1)}

of the regression coefficient of the lagged dependent variable, provided

T ⋅ \widehat{\operatorname{Var}}(\widehat\beta _{1)<1.}

Implementations in statistics packages

1. R

the dwtest function in the lmtest package, durbinWatsonTest (or dwt for short) function in the car package, and pdwtest and pbnftest for panel models in the plm package.^[5]

1. MATLAB

the dwtest function in the Statistics Toolbox.

1. Mathematica

the Durbin–Watson (d) statistic is included as an option in the LinearModelFit function.

1. SAS

Is a standard output when using proc model and is an option (dw) when using proc reg.

1. EViews

Automatically calculated when using OLS regression

1. gretl

Automatically calculated when using OLS regression

1. Stata

the command estat dwatson, following regress in time series data.^[6] Engle's LM test for autoregressive conditional heteroskedasticity (ARCH), a test for time-dependent volatility, the Breusch–Godfrey test, and Durbin's alternative test for serial correlation are also available. All (except -dwatson-) tests separately for higher-order serial correlations. The Breusch–Godfrey test and Durbin's alternative test also allow regressors that are not strictly exogenous.

1. Excel

although Microsoft Excel 2007 does not have a specific Durbin–Watson function, the d-statistic may be calculated using =SUMXMY2(x_array,y_array)/SUMSQ(array)

1. Minitab

the option to report the statistic in the Session window can be found under the "Options" box under Regression and via the "Results" box under General Regression.

1. Python

a durbin_watson function is included in the statsmodels package (statsmodels.stats.stattools.durbin_watson), but statistical tables for critical values are not available there.

1. SPSS

Included as an option in the Regression function.

1. Julia

the DurbinWatsonTest function is available in the HypothesisTests package.^[7]

See also

• Time-series regression
• ACF / PACF
• Correlation dimension
• Breusch–Godfrey test
• Ljung–Box test

References

• Durbin . J. . Watson . G. S. . 1950 . Testing for Serial Correlation in Least Squares Regression, I . . 37 . 3–4 . 409–428 . 2332391 . 10.1093/biomet/37.3-4.409.
• Durbin . J. . Watson . G. S. . 1951 . Testing for Serial Correlation in Least Squares Regression, II . Biometrika . 38 . 1–2 . 159–179 . 2332325 . 10.1093/biomet/38.1-2.159.
• Book: Gujarati, Damodar N. . Dawn C. . Porter. Dawn C. Porter . 2009 . Basic Econometrics . 5th . Boston . McGraw-Hill Irwin . 978-0-07-337577-9 .
• Book: Kmenta, Jan . Jan Kmenta . Elements of Econometrics . New York . Macmillan . 1986 . Second . 0-02-365070-2 . 328–332 . registration .
• Neumann . John von . 1941 . Distribution of the ratio of the mean square successive difference to the variance . . 12 . 4 . 367–395 . 2235951 . 10.1214/aoms/1177731677. free .
• Book: Verbeek, Marno . Marno Verbeek. A Guide to Modern Econometrics . 4th . Chichester . John Wiley & Sons . 2012 . 117–118 . 978-1-119-95167-4 .

External links

• Table for high n and k
• by Mark Thoma

Notes and References

1. Book: Chatterjee, Samprit. Simonoff. Jeffrey. Handbook of Regression Analysis. 2013. John Wiley & Sons. 1118532813.
2. Gujarati (2003) p. 469
3. Durbin . J. . Watson . G. S. . 1971 . Testing for serial correlation in least squares regression.III . Biometrika . 58 . 1 . 1–19 . 10.2307/2334313.
4. Farebrother . R. W.. 1980 . Algorithm AS 153: Pan's procedure for the tail probabilities of the Durbin-Watson statistic . Journal of the Royal Statistical Society, Series C . 29 . 2 . 224–227.
5. Book: Hateka, Neeraj R. . Principles of Econometrics: An Introduction (Using R) . SAGE Publications . 2010 . 978-81-321-0660-9 . Tests for Detecting Autocorrelation . 379–82 . https://books.google.com/books?id=SdaGAwAAQBAJ&pg=PA379 .
6. Web site: regress postestimation time series — Postestimation tools for regress with time series . Stata Manual .
7. Web site: Time series tests . juliastats.org . 2020-02-04.