Hodrick–Prescott filter explained

The Hodrick–Prescott filter (also known as Hodrick–Prescott decomposition) is a mathematical tool used in macroeconomics, especially in real business cycle theory, to remove the cyclical component of a time series from raw data. It is used to obtain a smoothed-curve representation of a time series, one that is more sensitive to long-term than to short-term fluctuations. The adjustment of the sensitivity of the trend to short-term fluctuations is achieved by modifying a multiplier

λ .

The filter was popularized in the field of economics in the 1990s by economists Robert J. Hodrick and Nobel Memorial Prize winner Edward C. Prescott,^[1] though it was first proposed much earlier by E. T. Whittaker in 1923.^[2] The Hodrick-Prescott filter is a special case of a smoothing spline.^[3]

The equation

The reasoning for the methodology uses ideas related to the decomposition of time series. Let

y _{t} for t = 1 , 2 , ..., T denote the logarithms of a time series variable. The series y _{t} is made up of a trend component \tau _{t} and a cyclical component c _{t} such that y _{t =} \tau _{t +} c _{t} .^[4] Given an adequately chosen, positive value of λ , there is a trend component that will solvemin _{\tau} \left(\sum ^{T} _{t =1} {(y _{t} - \tau _{t} ) ^{2} } + λ \sum ^{T -1} _{t =2} {[(\tau _{t+1} - \tau _{t)} - (\tau _{t} - \tau _{t} )] ^{2} }\right).

The first term of the equation is the sum of the squared deviations

d _{t=y} _{t-\tau} _{t} , which penalizes the cyclical component. The second term is a multiple λ of the sum of the squares of the trend component's second differences. This second term penalizes variations in the growth rate of the trend component. The larger the value of λ , the higher is the penalty. Hodrick and Prescott suggest 1600 as a value for λ for quarterly data. Ravn and Uhlig (2002) state that λ should vary by the fourth power of the frequency observation ratio; thus, λ should equal 6.25 (1600/4^4) for annual data and 129,600 (1600*3^4) for monthly data;^[5] in practice, λ = 100 for yearly data and λ = 14 , 400 for monthly data are commonly used, however.

The Hodrick–Prescott filter is explicitly given by

HP = \left[ λ L ^{2} - 4λ L + ( 1 + 6λ ) - 4λ L ^{-1} + λ L ^{-2} \right] ^{-1}

where

L denotes the lag operator, as can be seen from the first-order condition for the minimization problem.

Drawbacks to the Hodrick–Prescott filter

The Hodrick–Prescott filter will only be optimal when:^[6]

• Data exists in a I(2) trend.
  • If one-time permanent shocks or split growth rates occur, the filter will generate shifts in the trend that do not actually exist.
• Noise in data is approximately normally distributed.
• Analysis is purely historical and static (closed domain). The filter causes misleading predictions when used dynamically since the algorithm changes (during iteration for minimization) the past state (unlike a moving average) of the time series to adjust for the current state regardless of the size of

λ used.

The standard two-sided Hodrick–Prescott filter is non-causal as it is not purely backward looking. Hence, it should not be used when estimating DSGE models based on recursive state-space representations (e.g., likelihood-based methods that make use of the Kalman filter). The reason is that the Hodrick–Prescott filter uses observations at

t + i, i> 0 to construct the current time point t , while the recursive setting assumes that only current and past states influence the current observation. One way around this is to use the one-sided Hodrick–Prescott filter.^[7]

Exact algebraic formulas are available for the two-sided Hodrick–Prescott filter in terms of its signal-to-noise ratio

λ .^[8]

A working paper by James D. Hamilton at UC San Diego titled "Why You Should Never Use the Hodrick-Prescott Filter"^[9] presents evidence against using the HP filter. Hamilton writes that:

1. The HP filter produces series with spurious dynamic relations that have no basis in the underlying data-generating process.
2. A one-sided version of the filter reduces but does not eliminate spurious predictability and moreover produces series that do not have the properties sought by most potential users of the HP filter.
3. A statistical formalization of the problem typically produces values for the smoothing parameter vastly at odds with common practice, e.g., a value for λ far below 1600 for quarterly data.
4. There's a better alternative. A regression of the variable at date t+h on the four most recent values as of date t offers a robust approach to detrending that achieves all the objectives sought by users of the HP filter with none of its drawbacks."

A working paper by Robert J. Hodrick titled "An Exploration of Trend-Cycle Decomposition Methodologies in Simulated Data"^[10] examines whether the proposed alternative approach of James D. Hamilton is actually better than the HP filter at extracting the cyclical component of several simulated time series calibrated to approximate U.S. real GDP. Hodrick finds that for time series in which there are distinct growth and cyclical components, the HP filter comes closer to isolating the cyclical component than the Hamilton alternative.

See also

• Band-pass filter
• Kalman filter
• Smoothing spline

Further reading

• Book: Enders, Walter . Trends and Univariate Decompositions . Applied Econometric Time Series . New York . Wiley . 2010 . Third . 978-0470-50539-7 . 247–7 .
• Book: Favero, Carlo A. . [{{Google books |plainurl=yes |id=PBToVOKpyL4C |page=54 }} Applied Macroeconometrics ]. New York . Oxford University Press . 2001 . 0-19-829685-1 . 54–5 .
• Book: Mills, Terence C. . Filtering Economic Time Series . Modelling Trends and Cycles in Economic Time Series . New York . Palgrave Macmillan . 2003 . 1-4039-0209-7 . 75–102 .

External links

• a freeware Hodrick Prescott Excel Add-In
• Prescott's Fortran code
• Hodrick–Prescott filter in matlab
• One-sided Hodrick–Prescott filters in matlab
• HP filter in R with package 'mFilter'
• HP filter online app
• One-sided Hodrick-Prescott filter in Excel

Notes and References

1. Hodrick . Robert . Edward C. . Prescott . 1997 . Postwar U.S. Business Cycles: An Empirical Investigation . Journal of Money, Credit, and Banking . 29 . 1 . 1–16 . 10.2307/2953682 . 2953682 . 154995815 .
2. Whittaker . E. T. . 1923 . On a New Method of Graduation . Proceedings of the Edinburgh Mathematical Association . 41 . 63–75 . 10.1017/S0013091500077853 . 120579706 . free . - as quoted in Philips 2010
3. Paige . Robert L. . Trindade . A. Alexandre . 2010 . The Hodrick-Prescott Filter: A special case of penalized spline smoothing . Electronic Journal of Statistics . 4 . 856–874 . 10.1214/10-EJS570 . 1935-7524. 2346/89336 . free .
4. Kim, Hyeongwoo. "Hodrick–Prescott Filter" March 12, 2004
5. Ravn . Morten . Uhlig . Harald . On adjusting the Hodrick–Prescott filter for the frequency of observations . The Review of Economics and Statistics . 2002 . 2 . 84 . 371 . 10.1162/003465302317411604. 845683 .
6. French . Mark W. . Estimating Changes in Trend Growth of Total Factor Productivity: Kalman and H-P Filters versus a Markov-Switching Framework . FEDS Working Paper No. 2001-44 . 2001 . 293105 .
7. Stock . Watson . Forecasting Inflation . Journal of Monetary Economics . 1999 . 44 . 2 . 293–335 . 10.1016/s0304-3932(99)00027-6.
8. McElroy . Exact Formulas for the Hodrick-Prescott Filter . Econometrics Journal . 2008 . 11 . 209–217 . 10.1111/j.1368-423x.2008.00230.x. 17526059 .
9. Hamilton . James D. . Why You Should Never Use the Hodrick-Prescott Filter . Working Paper . 2017 .
10. Hodrick . Robert J. . An Exploration of Trend-Cycle Decomposition Methodologies in Simulated Data . Working Paper . 2020 .