Model output statistics explained

In weather forecasting, model output statistics (MOS) is a multiple linear regression technique in which predictands, often near-surface quantities (such as two-meter-above-ground-level air temperature, horizontal visibility, and wind direction, speed and gusts), are related statistically to one or more predictors. The predictors are typically forecasts from a numerical weather prediction (NWP) model, climatic data, and, if applicable, recent surface observations. Thus, output from NWP models can be transformed by the MOS technique into sensible weather parameters that are familiar to a layperson.

Background

Output directly from the NWP model's lowest layer(s) generally is not used by forecasters because the actual physical processes that occur within the Earth's boundary layer are crudely approximated in the model (i.e., physical parameterizations) along with its relatively coarse horizontal resolution. Because of this lack of fidelity and its imperfect initial state, forecasts of near-surface quantities obtained directly from the model are subject to systematic (bias) and random model errors, which tend to grow with time.[1] [2]

In the development of MOS equations, past observations and archived NWP model forecast fields are used with a screening regression to determine the 'best' predictors and their coefficients for a particular predictand and forecast time. By using archived model forecast output along with verifying surface observations, the resulting equations implicitly take into account physical effects and processes which the underlying numerical weather prediction model cannot explicitly resolve, resulting in much better forecasts of sensible weather quantities. In addition to correcting systematic errors, MOS can produce reliable probabilities of weather events from a single model run. In contrast, despite the enormous amount of computing resources devoted to generating them, ensemble model forecasts' relative frequency of events—often used as a proxy for probability—do not exhibit useful reliability.[3] Thus, ensemble NWP model output also requires additional post-processing in order to obtain reliable probabilistic forecasts, using nonhomogeneous Gaussian regression[4] or other methods.[5] [6]

History

United States

MOS was conceived and planning for its use began within the U.S. National Weather Service’s (NWS’s) Techniques Development Laboratory (TDL) in 1965 and forecasts first issued from it in 1968.[7] Since then, TDL, now the Meteorological Development Laboratory (MDL), continued to create, refine and update MOS equation sets as additional NWP models were developed and made operational at the National Meteorological Center (NMC) and then the Environmental Modeling Center or EMC.[8]

Given its multi-decadal history within the U.S. NWS and its continuous improvement and superior skill over direct NWP model output, MOS guidance is still one of the most valuable forecast tools used by forecasters within the agency.[9]

United States forecast guidance

There are eight sets of MOS guidance available from MDL, operational and experimental, covering the span of time from the next hour out to ten days for the United States and most of its territories.[10]

Name Update frequency
Localized Aviation MOS Program (LAMP) Every hour
North American Mesoscale (NAM) MOS Twice per day
Short-range Global Forecast System (GFS) MOS Every six hours
Extended-range GFS MOS Twice per day
North American Ensemble Forecast System MOS Twice per day
Short-range ECMWF MOS[11] Twice per day
Extended-range ECMWF MOS Twice per day
Ensemble ECMWF MOS Twice per day

Nested Grid Model MOS was discontinued in 2009.[12]

Initially, MOS guidance was developed for airports and other fixed locales where METARs (or similar reports) were routinely issued. Therefore, MOS guidance was and continues to be provided in an alphanumeric 'bulletin' format for these locations. Here is an example of a short-range MOS forecast for Clinton-Sherman Airport, Oklahoma (KCSM) based on the EMC's Global Forecast System model output.

With the availability of private- and government-owned weather mesonets,[13] new objective analysis and interpolation techniques,[14] gridded GFS MOS guidance became available in 2006.[15] [16]

Advantages and disadvantages

The advantage of MOS forecast guidance as developed in the United States allowed for

These points, while greatly desired by forecasters, do come at a price. From its very beginnings, the development of robust MOS equations for a particular NWP model required at least two years' worth of archived model output and observations, during which time the NWP model should remain unchanged, or nearly so. This requirement is necessary in order to fully capture the model's error characteristics under a wide variety of meteorological flow regimes for any particular location or region. Extreme meteorological events such as unusual cold- or heat-waves, heavy rain and snowfall, high winds, etc., are important in the development of robust MOS equations. A lengthy model archive has the best chance of capturing such events.

From the 1970s and into the 1980s, this requirement was not very onerous since EMC (then NMC) scientists, being relatively constrained by computational resources at the time, could only make relatively minor, incremental improvements to their NWP models. However, since the 1990s, NWP models have been upgraded more frequently, oftentimes with significant changes in physics and horizontal and vertical grid resolutions.[17] [18] Since MOS corrects systematic biases of the NWP model it is based on, any changes to the NWP model's error characteristics affects MOS guidance, usually in a negative way.[19] [20] This was a factor in the discontinuation of the MOS for the individual ensemble members of the GFS in April 2019; that product had not been updated since 2009, and NOAA decided to cease offering the product instead of bringing it up to date.[21]

In the case of a major upgrade to a NWP model, the EMC will run the newer version of model in parallel with the operational one for many months to allow for direct comparison of model performance.[22] In addition to parallel real-time runs, EMC also runs the newer model to examine past events and seasons, i.e., retrospective forecasts.

All of these runs from the upgraded model allows the National Weather Service, Weather Prediction Center (WPC), National Hurricane Center (NHC), and Storm Prediction Center (SPC) to evaluate its performance prior to the decision to either accept or reject it for operational use. MDL scientists have taken advantage of these runs to evaluate and reformulate the MOS equations as needed to avoid deterioration in guidance quality.[23]

Other weather centers

Royal Netherlands Meteorological Institute developed a MOS system to forecast probabilities of (severe) thunderstorms in the Netherlands.[24] [25]

Scientists from the Meteorological Service of Canada developed a post-processing system called Updateable MOS (UMOS) that quickly incorporates changes to their regional NWP model without the need for a lengthy model archive.[26] The Canadian UMOS system generates a 2-day forecast of temperatures, wind speed and direction and probability of precipitation (POP). UMOS temperature and wind forecasts are provided at 3-h intervals, and POP at 6-h intervals.

Scientists at the Kongju National University have also implemented a UMOS system to create forecasts of air temperatures over South Korea.[27] It is unclear as to whether it is used operationally at the Korean Meteorological Administration.

Further reading

Notes and References

  1. Lorenz. Edward N.. Deterministic Nonperiodic Flow. Journal of the Atmospheric Sciences. March 1963. 20. 2. 130–141. 10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2. 1963JAtS...20..130L . free.
  2. Simmons. A.J.. Mureau. R.. Petroliagis. T.. Error growth estimates of predictability from the ECMWF forecasting system. Q. J. R. Meteorol. Soc.. 1995. 121. 527. 1739–1771. 10.1002/qj.49712152711.
  3. Rudack. David. Ghirardelli. Judy. A Comparative Verification of Localized Aviation Model Output Statistics Program (LAMP) and Numerical Weather Prediction (NWP) Model Forecast of Ceiling Height and Visibility. Weather and Forecasting. August 2010. 25. 4. 1161–1178. 10.1175/2010WAF2222383.1. 2010WtFor..25.1161R . free.
  4. Jewson. S.. Brix. A.. Ziehmann. C.. A new parametric model for the assessment and calibration of medium‐range ensemble temperature forecasts. Atmospheric Science Letters. 2004. 5. 5. 96–102. 10.1002/asl.69. physics/0308057.
  5. Wilks. Daniel S.. Hamill. Thomas M.. Comparison of Ensemble-MOS Methods Using GFS Reforecasts. Monthly Weather Review. June 2007. 135. 6. 2379–2390. 10.1175/MWR3402.1. 2007MWRv..135.2379W . free.
  6. Veehuis. Bruce. Spread Calibration of Ensemble MOS Forecasts.. Monthly Weather Review. July 2013. 141. 7. 2467–2482. 10.1175/MWR-D-12-00191.1. 2013MWRv..141.2467V. free.
  7. Glahn. Harry R.. Dallavalle. J. Paul. TDL Office Note 00-1:MOS-2000. Internal Publication. January 2000. 179. 9 August 2014. Techniques Development Laboratory. Silver Spring Maryland USA. https://web.archive.org/web/20140812115518/http://www.mdl.nws.noaa.gov/~qa/pdf_files/TDL_Office_Note_00-1.pdf. 12 August 2014. dead.
  8. Carter. Gary M.. Dallevalle. J. Paul. Glahn. Harry R.. Statistical Forecasts Based on the National Meteorological Center's Numerical Weather Prediction System. Weather and Forecasting. September 1989. 4. 3. 401–412. 10.1175/1520-0434(1989)004<0401:SFBOTN>2.0.CO;2. 1989WtFor...4..401C . free.
  9. Web site: Unpublished. Annual MDL Users Survey 2011. 3 August 2014. 25–27.
  10. [Guam]
  11. Access to ECMWF MOS is restricted to the NOAA organization due to European Centre for Medium-Range Weather Forecasts copyright policy.
  12. https://www.weather.gov/mdl/mos_changelog MOS changelog
  13. Web site: NOAA. Earth Systems Research Laboratory. MADIS Surface Network Information. 7 August 2014. https://web.archive.org/web/20140812120033/http://madis.noaa.gov/network_info.html. 12 August 2014. dead.
  14. Glahn. Bob. Im. J.S.. Algorithms for effective objective analysis of surface weather variables. 24th Conf. On Weather and Forecasting/20th Conf. On Numerical Weather Prediction. January 2011. J19.4. 7 August 2014.
  15. Glahn. Bob. Gilbert. Kathryn. Cosgrove. Rebecca. Ruth. David. Sheets. Kari. The Gridding of MOS. Weather and Forecasting. April 2009. 24. 2. 520–529. 10.1175/2008WAF2007080.1. 2009WtFor..24..520G . free.
  16. Web site: National Weather Service. National Digital Guidance Database.
  17. Web site: Environmental Modeling Center. Mesoscale Modeling Branch. Mesoscale Branch Web Page Reference List. 7 August 2014.
  18. Web site: Environmental Modeling Center. Global Branch. [GFS/GDAS] Changes since 1991]. 7 August 2014.
  19. Erickson. Mary C.. Evaluating the Impact of RAFS Changes on the NGM-Based MOS Guidance. Weather and Forecasting. March 1991. 6. 1. 142–147. 10.1175/1520-0434(1991)006<0142:ETIORC>2.0.CO;2. 1991WtFor...6..142E . free.
  20. Erickson. Mary C.. Dallavalle. J. Paul. Carroll. Kevin L.. The new AVN/MRF MOS development and model changes: a volatile mix?. 16th Conference on Probability and Statistics in the Atmospheric Sciences. January 2002. 5 August 2014.
  21. https://www.weather.gov/media/notification/scn19-23gets_mos_termination.pdf SCN19-23: Termination of the Global Ensemble Forecast System (GEFS)-based Model Output Statistics (MOS) product (MEN) on or about April 16, 2019
  22. Web site: National Centers for Environmental Prediction. Environmental Modeling Center. EMC Verification Scorecard. 12 August 2014. https://web.archive.org/web/20140812220853/http://www.emc.ncep.noaa.gov/gmb/wd20rt/vsdb/prhw14/www/scorecard/mainindex.html. 12 August 2014. dead.
  23. Antolik. Mark. Baker. Michael. On the ability to develop MOS guidance with short dependent samples from an evolving numerical model.. 23rd Conference Weather Analysis and Forecasting/19th Conference Numerical Prediction. 2 June 2009. 6A.1. 9 August 2014.
  24. Schmeits. Maurice J.. Kok. Kees J.. Vogelezang. Daan H. P.. Probabilistic Forecasting of (Severe) Thunderstorms in the Netherlands Using Model Output Statistics. Weather and Forecasting. April 2005. 20. 2. 134–148. 10.1175/WAF840.1. 2005WtFor..20..134S . free.
  25. Web site: van Gastel. Valentijn. Investigating MSG-SEVIRI data as an additional predictor source in the KNMI probabilistic (severe) thunderstorm forecasting system. Koninklijk Nederlands Meteorologisch Instituut. Royal Netherlands Meteorological Institute (KNMI) publication. 9 August 2014.
  26. Wilson. Laurence. Vallee. Marcel. The Canadian Updateable Model Output Statistics (UMOS) System: Design and Development Tests. Weather and Forecasting. April 2002. 17. 2. 206–222. 10.1175/1520-0434(2002)017<0206:TCUMOS>2.0.CO;2. 2002WtFor..17..206W . free.
  27. Kang. Jeon-Ho. Suh. Myoung-Seok. Hong. Ki-Ok. Kim. Chansoo. Development of updateable model output statistics (UMOS) system for air temperature over South Korea. Asia-Pacific Journal of the Atmospheric Sciences. February 2011. 47. 2. 199–211. 10.1007/s13143-011-0009-8. 2011APJAS..47..199K .