Partial autocorrelation function explained

In time series analysis, the partial autocorrelation function (PACF) gives the partial correlation of a stationary time series with its own lagged values, regressed the values of the time series at all shorter lags. It contrasts with the autocorrelation function, which does not control for other lags.

This function plays an important role in data analysis aimed at identifying the extent of the lag in an autoregressive (AR) model. The use of this function was introduced as part of the Box–Jenkins approach to time series modelling, whereby plotting the partial autocorrelative functions one could determine the appropriate lags p in an AR (p) model or in an extended ARIMA (p,d,q) model.

Definition

Given a time series

z _{t} , the partial autocorrelation of lag k , denoted \phi _{k,k} , is the autocorrelation between z _{t} and z _{t+k} with the linear dependence of z _{t} on z _{t+1} through z _{t+k-1} removed. Equivalently, it is the autocorrelation between z _{t} and z _{t+k} that is not accounted for by lags 1 through k -1 , inclusive.^[1] $$\backslash phi\_\; =\; \backslash operatorname(z\_,\; z\_),\backslash textk=\; 1,$$$$\backslash phi\_\; =\; \backslash operatorname(z\_\; -\; \backslash hat\_,\backslash ,\; z\_\; -\; \backslash hat\_),\backslash textk\backslash geq\; 2,$$where \hat{z} _{t+k} and \hat{z} _{t} are linear combinations of \{z _{t+1} , z _{t+2} , ..., z _{t+k-1} \} that minimize the mean squared error of z _{t+k} and z _{t} respectively. For stationary processes, the coefficients in \hat{z} _{t+k} and \hat{z} _{t} are the same, but reversed:^[2] $$\backslash hat\_=\backslash beta\_1z\_+\backslash cdots+\backslash beta\_z\_\backslash qquad\backslash text\backslash qquad\backslash hat\_t=\backslash beta\_1z\_+\backslash cdots+\backslash beta\_z\_.$$

Calculation

The theoretical partial autocorrelation function of a stationary time series can be calculated by using the Durbin–Levinson Algorithm:$$\backslash phi\_\; =\; \backslash frac$$where

\phi _{n,k} = \phi _{n-1,} - \phi _{n,n} \phi _{n-1,n-k} for 1 \leq k \leq n - 1 and \rho(n) is the autocorrelation function.^{[3] [4] [5]}

The formula above can be used with sample autocorrelations to find the sample partial autocorrelation function of any given time series.^{[6] [7]}

Examples

The following table summarizes the partial autocorrelation function of different models:^[8]

Model	PACF
White noise	The partial autocorrelation is 0 for all lags.
Autoregressive model	The partial autocorrelation for an AR(p) model is nonzero for lags less than or equal to p and 0 for lags greater than p.
Moving-average model	If \phi _{1,1} > 0 , the partial autocorrelation oscillates to 0.
	If \phi _{1,1} < 0 , the partial autocorrelation geometrically decays to 0.
Autoregressive–moving-average model	An ARMA(p, q) model's partial autocorrelation geometrically decays to 0 but only after lags greater than p.

The behavior of the partial autocorrelation function mirrors that of the autocorrelation function for autoregressive and moving-average models. For example, the partial autocorrelation function of an AR(p) series cuts off after lag p similar to the autocorrelation function of an MA(q) series with lag q. In addition, the autocorrelation function of an AR(p) process tails off just like the partial autocorrelation function of an MA(q) process.

Autoregressive model identification

Partial autocorrelation is a commonly used tool for identifying the order of an autoregressive model. As previously mentioned, the partial autocorrelation of an AR(p) process is zero at lags greater than p. If an AR model is determined to be appropriate, then the sample partial autocorrelation plot is examined to help identify the order.

The partial autocorrelation of lags greater than p for an AR(p) time series are approximately independent and normal with a mean of 0.^[9] Therefore, a confidence interval can be constructed by dividing a selected z-score by

\sqrt{n} . Lags with partial autocorrelations outside of the confidence interval indicate that the AR model's order is likely greater than or equal to the lag. Plotting the partial autocorrelation function and drawing the lines of the confidence interval is a common way to analyze the order of an AR model. To evaluate the order, one examines the plot to find the lag after which the partial autocorrelations are all within the confidence interval. This lag is determined to likely be the AR model's order.

Notes and References

1. Web site: 6.4.4.6.3. Partial Autocorrelation Plot . 2022-07-14 . www.itl.nist.gov.
2. Book: Shumway . Robert H. . Time Series Analysis and Its Applications: With R Examples . Stoffer . David S. . 2017 . Springer International Publishing . 978-3-319-52451-1 . Springer Texts in Statistics . Cham . 97–99 . en . 10.1007/978-3-319-52452-8.
3. Durbin . J. . 1960 . The Fitting of Time-Series Models . Revue de l'Institut International de Statistique / Review of the International Statistical Institute . 28 . 3 . 233–244 . 10.2307/1401322 . 1401322 . 0373-1138.
4. Book: Shumway . Robert H. . Time Series Analysis and Its Applications: With R Examples . Stoffer . David S. . 2017 . Springer International Publishing . 978-3-319-52451-1 . Springer Texts in Statistics . Cham . 103–104 . en . 10.1007/978-3-319-52452-8.
5. Book: Enders, Walter . Applied econometric time series . 2004 . J. Wiley . 0-471-23065-0 . 2nd . Hoboken, NJ . 65–67 . en . 52387978.
6. Book: Box . George E. P. . Time Series Analysis: Forecasting and Control . Reinsel . Gregory C. . Jenkins . Gwilym M. . John Wiley . 2008 . 9780470272848 . 4th . Hoboken, New Jersey . en.
7. Book: Brockwell . Peter J. . Time Series: Theory and Methods . Davis . Richard A. . Springer . 1991 . 9781441903198 . 2nd . New York, NY . 102, 243–245 . en.
8. Book: Das, Panchanan . Econometrics in Theory and Practice : Analysis of Cross Section, Time Series and Panel Data with Stata 15. 1 . Springer . 2019 . 978-981-329-019-8 . Singapore . 294–299 . en . 1119630068.
9. Quenouille . M. H. . 1949 . Approximate Tests of Correlation in Time-Series . Journal of the Royal Statistical Society, Series B (Methodological) . en . 11 . 1 . 68–84 . 10.1111/j.2517-6161.1949.tb00023.x.