Facets of forecast evaluation

Forecasts are issued as point or probabilistic predictions, and their performance is measured using consistent scoring functions or proper scoring rules. We identify classes of elementary members of these performance measures and develop diagnostic tools to assist in the ranking of forecasters. Rankings are subject to the choice of evaluation criterion and the sampling variability. We also provide guidance in the computation of a particular scoring rule, the continuous ranked probability score.