IRI Home

CPT Help Home -> Specific Menu Items -> Tools -> Validation -> Performance

Validation - Performance Measures

The validation window provides a variety of forecast performance scores together with a graph of forecast (green line) and observed (red line) values, and ROC graphs for the above- (red line) and below-normal (blue line) categories. The categorical measures and the ROC graphs are based on three categories (see Contingency Tables for further details on the definitions of the categories). Scores and graphs are shown for one series at a time. Verification for the desired series can be shown by setting the appropriate number at the top left of the validation window. A series that has been omitted in the calculations will be skipped.

The y-axis limits on the hindcasts plot can be set by right-clicking on the image and then selecting the Customise ~ Hindcasts ~ Y-Axis Limits option. The maximum and minimum values on the y-axis are indicated and can be reset. Resetting these axis limits will in turn automatically reset the tick-mark interval and number of tick marks. Greater flexibility for setting the tick marks is planned for future releases. Further options for customizing the graphs, including adjusting the size of the fonts, and the size of the images, are available from Options ~ Graphics.

The graphics can be saved individually or as a montage as a BMP, EMF, GIF, JPEG, PCX, or PNG file by right-clicking anywhere in the child window, and then selecting the desired graphic to be saved from Export. A default name is given to the graphic file, but this name can be changed using the browse button. The quality of the JPEG file can be adjusted using the slider or by the quality indicator, which ranges between 0.01 and 1.00. The highest quality is obtained using 1.00. The size of the JPEG file is affected by the quality chosen, with larger files being generated the higher the selected quality. The image quality for all the graphics formats can be improved by increasing the size of the image (see Options ~ Graphics ~ Graph Scaling). The graphic titles can be set using the Customise option upon right-clicking in the child window.

Further details are available under Viewing results.


 
Last modified: