Limits...
Improved Discrimination of Influenza Forecast Accuracy Using Consecutive Predictions.

Shaman J, Kandula S - PLoS Curr (2015)

Bottom Line: The expected accuracy of a given forecast can be inferred in real-time through quantification of the agreement (e.g. the variance) among the ensemble of simulations.Here we show that forecast expected accuracy can be further discriminated with the additional consideration of the streak or persistence of the forecast-the number of consecutive weeks the forecast has converged to the same outcome.The findings indicate that the use of both the streak and ensemble agreement provides a more detailed and informative assessment of forecast expected accuracy.

View Article: PubMed Central - PubMed

Affiliation: Department of Environmental Health Sciences, Mailman School of Public Health, Columbia University, New York, New York, USA.

ABSTRACT

Introduction: The ability to predict the growth and decline of infectious disease incidence has advanced considerably in recent years. In particular, accurate forecasts of influenza epidemiology have been developed using a number of approaches.

Methods: Within our own group we produce weekly operational real-time forecasts of influenza at the municipal and state level in the U.S. These forecasts are generated using ensemble simulations depicting local influenza transmission dynamics, which have been optimized prior to forecast with observations of influenza incidence and data assimilation methods. The expected accuracy of a given forecast can be inferred in real-time through quantification of the agreement (e.g. the variance) among the ensemble of simulations.

Results: Here we show that forecast expected accuracy can be further discriminated with the additional consideration of the streak or persistence of the forecast-the number of consecutive weeks the forecast has converged to the same outcome.

Discussion: The findings indicate that the use of both the streak and ensemble agreement provides a more detailed and informative assessment of forecast expected accuracy.

No MeSH data available.


Related in: MedlinePlus

These plots are segregated by forecast week, streak and within ensemble log variance. A calibrated forecast will fall on the diagonal line (e.g. forecast outcomes with a 70% expected accuracy have an observed frequency—are observed accurate—70% of the time). The ‘None’ column presents forecasts only discriminated by streak; the ‘None’ row presents forecasts only discriminated by ensemble variance.
© Copyright Policy
Related In: Results  -  Collection


getmorefigures.php?uid=PMC4608841&req=5

d35e595: These plots are segregated by forecast week, streak and within ensemble log variance. A calibrated forecast will fall on the diagonal line (e.g. forecast outcomes with a 70% expected accuracy have an observed frequency—are observed accurate—70% of the time). The ‘None’ column presents forecasts only discriminated by streak; the ‘None’ row presents forecasts only discriminated by ensemble variance.


Improved Discrimination of Influenza Forecast Accuracy Using Consecutive Predictions.

Shaman J, Kandula S - PLoS Curr (2015)

These plots are segregated by forecast week, streak and within ensemble log variance. A calibrated forecast will fall on the diagonal line (e.g. forecast outcomes with a 70% expected accuracy have an observed frequency—are observed accurate—70% of the time). The ‘None’ column presents forecasts only discriminated by streak; the ‘None’ row presents forecasts only discriminated by ensemble variance.
© Copyright Policy
Related In: Results  -  Collection

Show All Figures
getmorefigures.php?uid=PMC4608841&req=5

d35e595: These plots are segregated by forecast week, streak and within ensemble log variance. A calibrated forecast will fall on the diagonal line (e.g. forecast outcomes with a 70% expected accuracy have an observed frequency—are observed accurate—70% of the time). The ‘None’ column presents forecasts only discriminated by streak; the ‘None’ row presents forecasts only discriminated by ensemble variance.
Bottom Line: The expected accuracy of a given forecast can be inferred in real-time through quantification of the agreement (e.g. the variance) among the ensemble of simulations.Here we show that forecast expected accuracy can be further discriminated with the additional consideration of the streak or persistence of the forecast-the number of consecutive weeks the forecast has converged to the same outcome.The findings indicate that the use of both the streak and ensemble agreement provides a more detailed and informative assessment of forecast expected accuracy.

View Article: PubMed Central - PubMed

Affiliation: Department of Environmental Health Sciences, Mailman School of Public Health, Columbia University, New York, New York, USA.

ABSTRACT

Introduction: The ability to predict the growth and decline of infectious disease incidence has advanced considerably in recent years. In particular, accurate forecasts of influenza epidemiology have been developed using a number of approaches.

Methods: Within our own group we produce weekly operational real-time forecasts of influenza at the municipal and state level in the U.S. These forecasts are generated using ensemble simulations depicting local influenza transmission dynamics, which have been optimized prior to forecast with observations of influenza incidence and data assimilation methods. The expected accuracy of a given forecast can be inferred in real-time through quantification of the agreement (e.g. the variance) among the ensemble of simulations.

Results: Here we show that forecast expected accuracy can be further discriminated with the additional consideration of the streak or persistence of the forecast-the number of consecutive weeks the forecast has converged to the same outcome.

Discussion: The findings indicate that the use of both the streak and ensemble agreement provides a more detailed and informative assessment of forecast expected accuracy.

No MeSH data available.


Related in: MedlinePlus