Document Type
Conference Proceeding
Publication Date
7-2015
Subjects
Fishery management, Intracranial pressure, Model theory, Policy sciences -- Mathematical models
Abstract
It is essential to objectively test how well policy models predict real world behavior. The method used to support this assertion involves the review of three SD policy models emphasizing the degree to which the model was able to fit the historical outcome data and how well model-predicted outcomes matched real world outcomes as they unfolded. Findings indicate that while historical model agreement is a favorable indication of model validity, the act of making predictions without knowing the actual data, and comparing these predictions to actual data, can reveal model weaknesses that might be overlooked when all of the available data is used for model development. Although this finding is based on just three cases, the value of using prediction to validate models, as recommended by leaders in the field, is compellingly demonstrated. The implication for decision makers is to be cautious about analyses made using models that have been tested only against historical data. The primary contribution is to clearly demonstrate the oft-prescribed but less often performed validation method of testing model predictions against reality.
Persistent Identifier
http://archives.pdx.edu/ds/psu/17705
Citation Details
Wakeland W. “Prediction--the Quintessential Policy Model Validation Test,” Proc. 33rd Int’l System Dynamics Conference, Boston, July, 2015.
Presented at the Systems Science Seminar Presentation, 10/9/15
Description
Presented at the Proceedings of the 33rd International Conference of the System Dynamics Society, Boston.
Presentation is included in Additional Files below