DOI: 10.1002/qj.49712455008. Impact of model resolution and ensemble size on the performance of an Ensemble Prediction System

Impact of model resolution and ensemble size on the performance of an Ensemble Prediction System

10.1002/qj.49712455008

Crossref journal-article

Wiley

Quarterly Journal of the Royal Meteorological Society (311)

Abstract

AbstractEnsemble integrations for 14 cases are described. These integrations test the relative impact of increase in ensemble size and in the resolution of the model used to integrate the ensemble. The ensembles are evaluated using a variety of statistical tests. Some of these indicate a relative advantage of an increase in ensemble size, whilst most tests suggest a relative advantage of an increase in model resolution. However, overall, the best performance was obtained by combining enhancement in model resolution (from T63L19 to T106L31) with an increase in ensemble size (from 32 to 50 members).

Bibliography

Buizza, R., Petroliagis, T., Palmer, T., Barkmeijer, J., Hamrud, M., Hollingsworth, A., Simmons, A., & Wedi, N. (1998). Impact of model resolution and ensemble size on the performance of an Ensemble Prediction System. Quarterly Journal of the Royal Meteorological Society, 124(550), 1935â1960. Portico.

Authors 8

R. Buizza (first)
T. Petroliagis (additional)
T. Palmer (additional)
J. Barkmeijer (additional)
M. Hamrud (additional)
A. Hollingsworth (additional)
A. Simmons (additional)
N. Wedi (additional)

References 34 Referenced 86

10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2
10.1002/qj.49712454916
10.1002/qj.49712051609
10.1175/1520-0493(1997)125<0099:PFSOEP>2.0.CO;2 / Mon. Weather Rev. / Potential forecast skill of ensemble prediction, and spread and skill distributions of the ECMWF Ensemble Prediction System (1997)
{'key': 'e_1_2_1_6_1', 'first-page': '6', 'article-title': 'Linear time evolution of T21, T42 and T63 singular vectors', 'volume': '55', 'year': '1998', 'journal-title': 'J. Atmos. Sci.'} / J. Atmos. Sci. / Linear time evolution of T21, T42 and T63 singular vectors (1998)
10.1175/1520-0469(1995)052<1434:TSVSOT>2.0.CO;2 / J. Atmos. Sci. / The singular vector structure of the atmospheric general circulation by Buizza R. (1995)
{'key': 'e_1_2_1_8_1', 'volume-title': 'Singular vectors, norms and large‐scale condensation', 'author': 'Buizza R.', 'year': '1996'} / Singular vectors, norms and large‐scale condensation by Buizza R. (1996)
Courtier P. Freyder C. Geleyn J. F. Rabier F.andRochas M.1991‘The Arpege project at Météo France’. Proceedings of the ECMWF seminar on ‘Numerical methods in atmospheric models’. 9–13 September 1991 Vol. 2. ECMWF Shinfield Park Reading RG2 9AX UK
10.1111/j.2153-3490.1969.tb00483.x
10.1175/1520-0450(1969)008<0985:ASSFPF>2.0.CO;2
10.1175/1520-0493(1994)122<0703:TLEAIP>2.0.CO;2
{'key': 'e_1_2_1_13_1', 'volume-title': 'Big Sky', 'author': 'Errico E. R.', 'year': '1995'} / Big Sky by Errico E. R. (1995)
10.1175/1520-0493(1971)099<0851:OSDP>2.3.CO;2
10.1175/1520-0493(1971)099<0927:OSDP>2.3.CO;2
10.1175/1520-0450(1970)009<0333:SDP>2.0.CO;2
Harrison M. S. J. Richardson D. S. Robertson K.andWoodcock A.1995‘Medium‐range ensembles using both the ECMWF T63 and unified models—An initial report’. Technical Report No. 153 Forecasting Research Division Meteorological Office. London Road Bracknell Berkshire RG12 2SZ UK
10.1175/1520-0469(1995)052<3885:SVTEOS>2.0.CO;2 / J. Atmos. Sci. / Singular vectors: the effect of spatial scale on linear growth of disturbances by Hartmann D. L. (1995)
10.1175/1520-0493(1996)124<1225:ASSATE>2.0.CO;2
Jacob C.1994‘The impact of the new cloud scheme on ECMWF's Integrated Forecasting System (IFS)’. Proceedings of the ECMWF workshop on ‘Modelling validation and assimilation of clouds’ 31 October‐4 November 1994. ECMWF Shinfield Park Reading RG2 9AX UK
10.1175/1520-0493(1974)102<0409:TSOMCF>2.0.CO;2
10.1002/qj.49712353704
{'key': 'e_1_2_1_23_1', 'first-page': '291', 'article-title': 'A model for assessment of weather forecasts', 'volume': '30', 'author': 'Mason I.', 'year': '1982', 'journal-title': 'Aust. Meteorol. Mag.'} / Aust. Meteorol. Mag. / A model for assessment of weather forecasts by Mason I. (1982)
10.1002/qj.49712252905
Palmer T. N. Molteni F. Mureau R.andBuizza R.1993‘Ensemble prediction’. ECMWF seminar proceedings on ‘Validation of models over Europe: Vol. 1’. ECMWF Shinfield Park Reading RG2 9AX UK
10.1175/1520-0469(1998)055<0633:SVMAAO>2.0.CO;2
10.1017/S1350482797000297
10.1007/BF01027467
Stanski H. R. Wilson L. J.andBurrows W. R.1989‘Survey of common verification methods in meteorology’. Research Report No. 89–5 Atmospheric Environment Service Forecast Research Division 4905 Dufferin Street Downsview Ontario Canada M3H 5T4
{'key': 'e_1_2_1_30_1', 'volume-title': 'Introduction to applied mathematics', 'author': 'Strang G.', 'year': '1986'} / Introduction to applied mathematics by Strang G. (1986)
10.1002/qj.49711649404
10.1175/1520-0493(1993)121<3040:ROCILS>2.0.CO;2
Toth Z. Kalnay E. Tracton S. Wobus R.andIrwin J.1996‘A synoptic evaluation of the NCEP ensemble’. Proceedings of the Fifth workshop on Meteorological Operational Systems 13–17 November 1995 European Centre for Medium‐Range Weather Forecasts Shinfield Park Reading RG2 9AX UK
10.1175/1520-0434(1993)008<0379:OEPATN>2.0.CO;2
10.1175/1520-0442(1995)008<2716:AILSPS>2.0.CO;2

Dates

Type	When
Created	18 years, 7 months ago (Feb. 3, 2007, 12:11 a.m.)
Deposited	1 year, 11 months ago (Oct. 7, 2023, 3:04 a.m.)
Indexed	4 months, 2 weeks ago (April 20, 2025, 12:30 a.m.)
Issued	27 years, 2 months ago (July 1, 1998)
Published	27 years, 2 months ago (July 1, 1998)
Published Online	18 years, 8 months ago (Dec. 15, 2006)
Published Print	27 years, 2 months ago (July 1, 1998)

Funders 0

None

BibTeX

@article{Buizza_1998, title={Impact of model resolution and ensemble size on the performance of an Ensemble Prediction System}, volume={124}, ISSN={1477-870X}, url={http://dx.doi.org/10.1002/qj.49712455008}, DOI={10.1002/qj.49712455008}, number={550}, journal={Quarterly Journal of the Royal Meteorological Society}, publisher={Wiley}, author={Buizza, R. and Petroliagis, T. and Palmer, T. and Barkmeijer, J. and Hamrud, M. and Hollingsworth, A. and Simmons, A. and Wedi, N.}, year={1998}, month=jul, pages={1935–1960} }

JSON

{
  "indexed": {
    "date-parts": [
      [
        2025,
        4,
        20
      ]
    ],
    "date-time": "2025-04-20T04:30:34Z",
    "timestamp": 1745123434219
  },
  "reference-count": 34,
  "publisher": "Wiley",
  "issue": "550",
  "license": [
    {
      "start": {
        "date-parts": [
          [
            2006,
            12,
            15
          ]
        ],
        "date-time": "2006-12-15T00:00:00Z",
        "timestamp": 1166140800000
      },
      "content-version": "vor",
      "delay-in-days": 3089,
      "URL": "http://onlinelibrary.wiley.com/termsAndConditions#vor"
    }
  ],
  "content-domain": {
    "domain": [
      "rmets.onlinelibrary.wiley.com"
    ],
    "crossmark-restriction": true
  },
  "published-print": {
    "date-parts": [
      [
        1998,
        7
      ]
    ]
  },
  "abstract": "<jats:title>Abstract</jats:title><jats:p>Ensemble integrations for 14 cases are described. These integrations test the relative impact of increase in ensemble size and in the resolution of the model used to integrate the ensemble. The ensembles are evaluated using a variety of statistical tests. Some of these indicate a relative advantage of an increase in ensemble size, whilst most tests suggest a relative advantage of an increase in model resolution. However, overall, the best performance was obtained by combining enhancement in model resolution (from T63L19 to T106L31) with an increase in ensemble size (from 32 to 50 members).</jats:p>",
  "DOI": "10.1002/qj.49712455008",
  "type": "journal-article",
  "created": {
    "date-parts": [
      [
        2007,
        2,
        3
      ]
    ],
    "date-time": "2007-02-03T05:11:14Z",
    "timestamp": 1170479474000
  },
  "page": "1935-1960",
  "update-policy": "http://dx.doi.org/10.1002/crossmark_policy",
  "source": "Crossref",
  "is-referenced-by-count": 86,
  "title": "Impact of model resolution and ensemble size on the performance of an Ensemble Prediction System",
  "prefix": "10.1002",
  "volume": "124",
  "author": [
    {
      "given": "R.",
      "family": "Buizza",
      "sequence": "first",
      "affiliation": []
    },
    {
      "given": "T.",
      "family": "Petroliagis",
      "sequence": "additional",
      "affiliation": []
    },
    {
      "given": "T.",
      "family": "Palmer",
      "sequence": "additional",
      "affiliation": []
    },
    {
      "given": "J.",
      "family": "Barkmeijer",
      "sequence": "additional",
      "affiliation": []
    },
    {
      "given": "M.",
      "family": "Hamrud",
      "sequence": "additional",
      "affiliation": []
    },
    {
      "given": "A.",
      "family": "Hollingsworth",
      "sequence": "additional",
      "affiliation": []
    },
    {
      "given": "A.",
      "family": "Simmons",
      "sequence": "additional",
      "affiliation": []
    },
    {
      "given": "N.",
      "family": "Wedi",
      "sequence": "additional",
      "affiliation": []
    }
  ],
  "member": "311",
  "published-online": {
    "date-parts": [
      [
        2006,
        12,
        15
      ]
    ]
  },
  "reference": [
    {
      "key": "e_1_2_1_2_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_3_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1002/qj.49712454916"
    },
    {
      "key": "e_1_2_1_4_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1002/qj.49712051609"
    },
    {
      "key": "e_1_2_1_5_1",
      "doi-asserted-by": "crossref",
      "first-page": "99",
      "DOI": "10.1175/1520-0493(1997)125<0099:PFSOEP>2.0.CO;2",
      "article-title": "Potential forecast skill of ensemble prediction, and spread and skill distributions of the ECMWF Ensemble Prediction System",
      "volume": "125",
      "year": "1997",
      "journal-title": "Mon. Weather Rev."
    },
    {
      "key": "e_1_2_1_6_1",
      "first-page": "6",
      "article-title": "Linear time evolution of T21, T42 and T63 singular vectors",
      "volume": "55",
      "year": "1998",
      "journal-title": "J. Atmos. Sci."
    },
    {
      "key": "e_1_2_1_7_1",
      "doi-asserted-by": "crossref",
      "first-page": "9",
      "DOI": "10.1175/1520-0469(1995)052<1434:TSVSOT>2.0.CO;2",
      "article-title": "The singular vector structure of the atmospheric general circulation",
      "volume": "52",
      "author": "Buizza R.",
      "year": "1995",
      "journal-title": "J. Atmos. Sci."
    },
    {
      "key": "e_1_2_1_8_1",
      "volume-title": "Singular vectors, norms and large\u2010scale condensation",
      "author": "Buizza R.",
      "year": "1996"
    },
    {
      "key": "e_1_2_1_9_1",
      "unstructured": "Courtier P. Freyder C. Geleyn J. F. Rabier F.andRochas M.1991\u2018The Arpege project at M\u00e9t\u00e9o France\u2019. Proceedings of the ECMWF seminar on \u2018Numerical methods in atmospheric models\u2019. 9\u201313 September 1991 Vol. 2. ECMWF Shinfield Park Reading RG2 9AX UK"
    },
    {
      "key": "e_1_2_1_10_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1111/j.2153-3490.1969.tb00483.x"
    },
    {
      "key": "e_1_2_1_11_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0450(1969)008<0985:ASSFPF>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_12_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0493(1994)122<0703:TLEAIP>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_13_1",
      "volume-title": "Big Sky",
      "author": "Errico E. R.",
      "year": "1995"
    },
    {
      "key": "e_1_2_1_14_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0493(1971)099<0851:OSDP>2.3.CO;2"
    },
    {
      "key": "e_1_2_1_15_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0493(1971)099<0927:OSDP>2.3.CO;2"
    },
    {
      "key": "e_1_2_1_16_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0450(1970)009<0333:SDP>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_17_1",
      "unstructured": "Harrison M. S. J. Richardson D. S. Robertson K.andWoodcock A.1995\u2018Medium\u2010range ensembles using both the ECMWF T63 and unified models\u2014An initial report\u2019. Technical Report No. 153 Forecasting Research Division Meteorological Office. London Road Bracknell Berkshire RG12 2SZ UK"
    },
    {
      "key": "e_1_2_1_18_1",
      "doi-asserted-by": "crossref",
      "first-page": "22",
      "DOI": "10.1175/1520-0469(1995)052<3885:SVTEOS>2.0.CO;2",
      "article-title": "Singular vectors: the effect of spatial scale on linear growth of disturbances",
      "volume": "52",
      "author": "Hartmann D. L.",
      "year": "1995",
      "journal-title": "J. Atmos. Sci."
    },
    {
      "key": "e_1_2_1_19_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0493(1996)124<1225:ASSATE>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_20_1",
      "unstructured": "Jacob C.1994\u2018The impact of the new cloud scheme on ECMWF's Integrated Forecasting System (IFS)\u2019. Proceedings of the ECMWF workshop on \u2018Modelling validation and assimilation of clouds\u2019 31 October\u20104 November 1994. ECMWF Shinfield Park Reading RG2 9AX UK"
    },
    {
      "key": "e_1_2_1_21_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0493(1974)102<0409:TSOMCF>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_22_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1002/qj.49712353704"
    },
    {
      "key": "e_1_2_1_23_1",
      "first-page": "291",
      "article-title": "A model for assessment of weather forecasts",
      "volume": "30",
      "author": "Mason I.",
      "year": "1982",
      "journal-title": "Aust. Meteorol. Mag."
    },
    {
      "key": "e_1_2_1_24_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1002/qj.49712252905"
    },
    {
      "key": "e_1_2_1_25_1",
      "unstructured": "Palmer T. N. Molteni F. Mureau R.andBuizza R.1993\u2018Ensemble prediction\u2019. ECMWF seminar proceedings on \u2018Validation of models over Europe: Vol. 1\u2019. ECMWF Shinfield Park Reading RG2 9AX UK"
    },
    {
      "key": "e_1_2_1_26_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0469(1998)055<0633:SVMAAO>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_27_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1017/S1350482797000297"
    },
    {
      "key": "e_1_2_1_28_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1007/BF01027467"
    },
    {
      "key": "e_1_2_1_29_1",
      "unstructured": "Stanski H. R. Wilson L. J.andBurrows W. R.1989\u2018Survey of common verification methods in meteorology\u2019. Research Report No. 89\u20135 Atmospheric Environment Service Forecast Research Division 4905 Dufferin Street Downsview Ontario Canada M3H 5T4"
    },
    {
      "key": "e_1_2_1_30_1",
      "volume-title": "Introduction to applied mathematics",
      "author": "Strang G.",
      "year": "1986"
    },
    {
      "key": "e_1_2_1_31_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1002/qj.49711649404"
    },
    {
      "key": "e_1_2_1_32_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0493(1993)121<3040:ROCILS>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_33_1",
      "unstructured": "Toth Z. Kalnay E. Tracton S. Wobus R.andIrwin J.1996\u2018A synoptic evaluation of the NCEP ensemble\u2019. Proceedings of the Fifth workshop on Meteorological Operational Systems 13\u201317 November 1995 European Centre for Medium\u2010Range Weather Forecasts Shinfield Park Reading RG2 9AX UK"
    },
    {
      "key": "e_1_2_1_34_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0434(1993)008<0379:OEPATN>2.0.CO;2"
    },
    {
      "key": "e_1_2_1_35_1",
      "doi-asserted-by": "publisher",
      "DOI": "10.1175/1520-0442(1995)008<2716:AILSPS>2.0.CO;2"
    }
  ],
  "container-title": "Quarterly Journal of the Royal Meteorological Society",
  "original-title": [],
  "language": "en",
  "link": [
    {
      "URL": "https://api.wiley.com/onlinelibrary/tdm/v1/articles/10.1002%2Fqj.49712455008",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "text-mining"
    },
    {
      "URL": "https://rmets.onlinelibrary.wiley.com/doi/pdf/10.1002/qj.49712455008",
      "content-type": "unspecified",
      "content-version": "vor",
      "intended-application": "similarity-checking"
    }
  ],
  "deposited": {
    "date-parts": [
      [
        2023,
        10,
        7
      ]
    ],
    "date-time": "2023-10-07T07:04:27Z",
    "timestamp": 1696662267000
  },
  "score": 1,
  "resource": {
    "primary": {
      "URL": "https://rmets.onlinelibrary.wiley.com/doi/10.1002/qj.49712455008"
    }
  },
  "subtitle": [],
  "short-title": [],
  "issued": {
    "date-parts": [
      [
        1998,
        7
      ]
    ]
  },
  "references-count": 34,
  "journal-issue": {
    "issue": "550",
    "published-print": {
      "date-parts": [
        [
          1998,
          7
        ]
      ]
    }
  },
  "alternative-id": [
    "10.1002/qj.49712455008"
  ],
  "URL": "http://dx.doi.org/10.1002/qj.49712455008",
  "relation": {},
  "ISSN": [
    "0035-9009",
    "1477-870X"
  ],
  "subject": [],
  "container-title-short": "Quart J Royal Meteoro Soc",
  "published": {
    "date-parts": [
      [
        1998,
        7
      ]
    ]
  },
  "assertion": [
    {
      "value": "1997-01-22",
      "order": 0,
      "name": "received",
      "label": "Received",
      "group": {
        "name": "publication_history",
        "label": "Publication History"
      }
    },
    {
      "value": "2006-12-15",
      "order": 2,
      "name": "published",
      "label": "Published",
      "group": {
        "name": "publication_history",
        "label": "Publication History"
      }
    }
  ]
}