Analysis of the relative operating characteristic and economic value using the LAPS ensemble prediction system in Taiwan

Hui Ling Chang, Shu Chih Yang, Huiling Yuan, Pay Liam Lin, Yu Chieng Liou

Research output: Contribution to journalArticlepeer-review

12 Scopus citations


Measurement of the usefulness of numerical weather prediction considers not only the forecast quality but also the possible economic value (EV) in the daily decision-making process of users. Discrimination ability of an ensemble prediction system (EPS) can be assessed by the relative operating characteristic (ROC), which is closely related to the EV provided by the same forecast system. Focusing on short-range probabilistic quantitative precipitation forecasts (PQPFs) for typhoons, this study demonstrates the consistent and strongly related characteristics of ROC and EV based on the Local Analysis and Prediction System (LAPS) EPS operated at the Central Weather Bureau in Taiwan. Sensitivity experiments including the effect of terrain, calibration, and forecast uncertainties on ROC and EV show that the potential EV provided by a forecast system is mainly determined by the discrimination ability of the same system. The ROC and maximum EV (EVmax) of an EPS are insensitive to calibration, but the optimal probability threshold to achieve the EVmax becomes more reliable after calibration. In addition, the LAPS ensemble probabilistic forecasts outperform deterministic forecasts in respect to both ROC and EV, and such an advantage grows with increasing precipitation intensity. Also, even without explicitly knowing the cost-loss ratio, one can still optimize decision-making and obtain the EVmax by using ensemble probabilistic forecasts.

Original languageEnglish
Pages (from-to)1833-1848
Number of pages16
JournalMonthly Weather Review
Issue number5
StatePublished - 2015


  • Economic value
  • Ensembles
  • Forecast verification/skill
  • Mesoscale forecasting


Dive into the research topics of 'Analysis of the relative operating characteristic and economic value using the LAPS ensemble prediction system in Taiwan'. Together they form a unique fingerprint.

Cite this