Abstract
Abstract The spatial structure of bias errors in numerical model output is valuable to both model developers and operational forecasters, especially if the field containing the structure itself has statistical significance in the face of naturally occurring spatial correlation. A semiparametric Monte Carlo method, along with a moving blocks bootstrap method is used to determine the field significance of spatial bias errors within spatially correlated error fields. This process can be completely automated, making it an attractive addition to the verification tools already in use. The process demonstrated here results in statistically significant spatial bias error fields at any arbitrary significance level. To demonstrate the technique, 0000 and 1200 UTC runs of the operational Eta Model and the operational Eta Model using the Kain–Fritsch convective parameterization scheme are examined. The resulting fields for forecast errors for geopotential heights and winds at 850, 700, 500, and 250 hPa over a period of 14 months (26 January 2001–31 March 2002) are examined and compared using the verifying initial analysis. Specific examples are shown, and some plausible causes for the resulting significant bias errors are proposed.
References
34
Referenced
32
10.1175/1520-0434(2002)017<1063:POTCSI>2.0.CO;2
/ Wea. Forecasting / Properties of the convection scheme in NCEP's Eta Model that affect forecast sounding interpretation. by Baldwin (2002){'key': '2020061721254248200_i1520-0493-134-2-519-Betts1', 'first-page': '677', 'article-title': 'A new convective adjustment scheme. Part I: Observational and theoretical basis.', 'volume': '112', 'author': 'Betts', 'year': '1986', 'journal-title': 'Quart. J. Roy. Meteor. Soc'}
/ Quart. J. Roy. Meteor. Soc / A new convective adjustment scheme. Part I: Observational and theoretical basis. by Betts (1986){'key': '2020061721254248200_i1520-0493-134-2-519-Betts2', 'first-page': '693', 'article-title': 'A new convective adjustment scheme. Part II: Single column tests using GATE wave, BOMEX and arctic air-mass data sets.', 'volume': '112', 'author': 'Betts', 'year': '1986', 'journal-title': 'Quart. J. Roy. Meteor. Soc'}
/ Quart. J. Roy. Meteor. Soc / A new convective adjustment scheme. Part II: Single column tests using GATE wave, BOMEX and arctic air-mass data sets. by Betts (1986)10.1175/1520-0434(1994)009<0265:TNNMEM>2.0.CO;2
/ Wea. Forecasting / The new NMC mesoscale Eta Model: Description and forecast examples. by Black (1994)10.1175/1520-0434(1992)007<0120:OTUOMA>2.0.CO;2
/ Wea. Forecasting / On the use of mesoscale and cloud-scale models in operational forecasting. by Brooks (1992)10.1175/1520-0434(1989)004<0391:POTNMC>2.0.CO;2
/ Wea. Forecasting / Performance of the National Meteorological Center's medium-range model. by Caplan (1989)10.1175/1520-0434(2001)016<0611:VOTEEP>2.0.CO;2
/ Wea. Forecasting / Verification of the ECMWF ensemble prediction system forecasts: A study of large-scale patterns. by Chessa (2001)10.1175/1520-0434(1998)013<0187:APIOTE>2.0.CO;2
/ Wea. Forecasting / A preliminary investigation of temperature errors in operational forecasting models. by Colby (1998)10.1175/1520-0434(2000)015<0730:MPVOTP>2.0.CO;2
/ Wea. Forecasting / MM5 precipitation verification over the Pacific Northwest during the 1997–99 cool seasons. by Colle (2000)10.1175/1520-0434(2001)016<0553:EOTTAS>2.0.CO;2
/ Wea. Forecasting / Evaluation of the timing and strength of MM5 and Eta surface trough passages over the eastern Pacific. by Colle (2001)10.1175/1520-0434(2003)18<431:MVOTMP>2.0.CO;2
/ Wea. Forecasting / Multiseason verification of the MM5. Part I: Comparison with the Eta Model over the central and eastern United States and impact of MM5 resolution. by Colle (2003)10.1175/1520-0434(2003)18<458:MVOTMP>2.0.CO;2
/ Wea. Forecasting / Multiseason verification of the MM5. Part II: Evaluation of high-resolution precipitation forecasts over the northeastern United States. by Colle (2003)10.1017/CBO9780511802843
/ Bootstrap Methods and Their Application. by Davison (1997)10.1007/978-1-4899-4541-9
/ An Introduction to the Bootstrap. by Efron (1993)10.1175/1520-0477-37.9.473
/ Bull. Amer. Meteor. Soc / Two outstanding problems of modern meteorology. by Fletcher (1956)10.1175/1520-0434(2000)015<0630:TIOSOO>2.0.CO;2
/ Wea. Forecasting / The impact of step orography on flow in the Eta Model: Two contrasting examples. by Gallus (2000)10.1175/1520-0493(2000)128<1153:BOFOSO>2.0.CO;2
/ Mon. Wea. Rev / Behavior of flow over step orography. by Gallus (2000)10.1175/1520-0493(1994)122<0927:TSMECM>2.0.CO;2
/ Mon. Wea. Rev / The step-mountain Eta coordinate model: Further development of the convection, viscous sublayer, and turbulence closure schemes. by Janjić (1994)10.1175/1520-0450(2004)043<0170:TKCPAU>2.0.CO;2
/ J. Appl. Meteor / The Kain–Fritsch convective parameterization: An update. by Kain (2004)10.1175/1520-0469(1990)047<2784:AODEPM>2.0.CO;2
/ J. Atmos. Sci / A one-dimensional entraining/detraining plume model and its application in convective parameterization. by Kain (1990)-
Kain, J. S., and J. M.Fritsch, 1993: Convective parameterization for mesoscale models: The Kain–Fritsch scheme. The Representation of Cumulus Convection in Numerical Models, Meteor. Monogr., No. 24, Amer. Meteor. Soc., 165–170.
(
10.1007/978-1-935704-13-3_16
) - Kain, J. S., M. B.Baldwin, and S. J.Weiss, 2001: Utilizing the Eta Model with two different convective parameterizations to predict convection initiation and evolution at the SPC. Preprints, Ninth Conf. on Mesoscale Processes, Ft. Lauderdale, FL, Amer. Meteor. Soc., 91–95.
10.1175/1520-0493(1983)111<0046:SFSAID>2.0.CO;2
/ Mon. Wea. Rev / Statistical field significance and its determination by Monte Carlo techniques. by Livezey (1983)10.1175/1520-0477(2002)083<0407:DIHRPM>2.3.CO;2
/ Bull. Amer. Meteor. Soc / Does increasing horizontal resolution produce more skillful forecasts? by Mass (2002)10.1175/1520-0434(1993)008<0235:TDOSRS>2.0.CO;2
/ Wea. Forecasting / The dependence of short-range surface cyclone forecasts on the large-scale circulation: A preliminary assessment. by Mullen (1993)10.1175/1520-0493(1995)123<1582:ACMOSW>2.0.CO;2
/ Mon. Wea. Rev / A coherent method of stratification within a general framework for forecast verification. by Murphy (1995)10.1175/1520-0434(1999)014<0018:EOTKEM>2.0.CO;2
/ Wea. Forecasting / Evaluation of the 29-km Eta Model. Part II: Subjective verification over Florida. by Monobianco (1999)10.1175/1520-0477(2001)082<2749:AOUSTC>2.3.CO;2
/ Bull. Amer. Meteor. Soc / Accuracy of United States tropical cyclone landfall forecasts in the Atlantic basin (1976–2000). by Powell (2001)- Rogers, E., D.Parrish, and G.DiMego, 1999: Changes to the NCEP operational Eta analysis. NWS Technical Procedures Bulletin 454, 25 pp. [Available online at http://www.nws.noaa.gov/om/tpb/454.pdf or Office of Meteorology, 1325 East–West Highway, Silver Spring, MD 20910.].
10.1175/1520-0434(2000)015<0152:AAFRML>2.0.CO;2
/ Wea. Forecasting / Analyzing and forecasting Rocky Mountain lee cyclogenesis often associated with strong winds. by Schultz (2000)10.1175/1520-0434(1993)008<0037:AEOSLC>2.0.CO;2
/ Wea. Forecasting / An evaluation of sea level cyclone forecasts produced by NMC's nested-grid model and global spectral model. by Smith (1993)10.1175/1520-0442(1999)012<1280:EOSDOF>2.0.CO;2
/ J. Climate / Estimation of spatial degrees of freedom of a climate field. by Wang (1999)10.1175/1520-0434(1999)014<0084:STFVOS>2.0.CO;2
/ Wea. Forecasting / Short-term forecast validation of six models. by White (1999)10.1175/1520-0442(1997)010<0065:RHTFAF>2.0.CO;2
/ J. Climate / Resampling hypothesis tests for autocorrelated fields. by Wilks (1997)
Dates
Type | When |
---|---|
Created | 19 years, 5 months ago (March 6, 2006, 11:24 a.m.) |
Deposited | 4 years, 8 months ago (Dec. 7, 2020, 5:17 p.m.) |
Indexed | 1 year, 1 month ago (July 26, 2024, 11:18 a.m.) |
Issued | 19 years, 6 months ago (Feb. 1, 2006) |
Published | 19 years, 6 months ago (Feb. 1, 2006) |
Published Online | 19 years, 6 months ago (Feb. 1, 2006) |
Published Print | 19 years, 6 months ago (Feb. 1, 2006) |
@article{Elmore_2006, title={Field Significance Revisited: Spatial Bias Errors in Forecasts as Applied to the Eta Model}, volume={134}, ISSN={0027-0644}, url={http://dx.doi.org/10.1175/mwr3077.1}, DOI={10.1175/mwr3077.1}, number={2}, journal={Monthly Weather Review}, publisher={American Meteorological Society}, author={Elmore, Kimberly L. and Baldwin, Michael E. and Schultz, David M.}, year={2006}, month=feb, pages={519–531} }