Systems Science Friday Noon Seminar Series
Files
Download (2.0 MB)
Date
10-9-2015
Abstract
It is essential to objectively test how well policy models predict real world behavior. The method used to support this assertion involves the review of three SD policy models emphasizing the degree to which the model was able to fit the historical outcome data and how well model-predicted outcomes matched real world outcomes as they unfolded. Findings indicate that while historical model agreement is a favorable indication of model validity, the act of making predictions without knowing the actual data, and comparing these predictions to actual data, can reveal model weaknesses that might be overlooked when all of the available data is used for model development. Although this finding is based on just three cases, the value of using prediction to validate models, as recommended by leaders in the field, is compellingly demonstrated. The implication for decision makers is to be cautious about analyses made using models that have been tested only against historical data. The primary contribution is to clearly demonstrate the oft-prescribed but less often performed validation method of testing model predictions against reality.
Biographical Information
Wayne is Professor and Systems Science Program Chair at Portland State University. He earned a B.S. and a Master of Engineering at Harvey Mudd College (1973); and a Ph.D. in Systems Science at Portland State U. (1977). His current research focuses on health policy related to drug diversion, abuse and treatment; applied data mining; and environmental/ecological sustainability.
Subjects
Forecasting -- Simulation methods -- Case studies, Mathematical models -- Calibration, System theory
Disciplines
Statistical Models | Theory and Algorithms
Persistent Identifier
https://archives.pdx.edu/ds/psu/31211
Rights
© Copyright the author(s)
IN COPYRIGHT:
http://rightsstatements.org/vocab/InC/1.0/
This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s).
DISCLAIMER:
The purpose of this statement is to help the public understand how this Item may be used. When there is a (non-standard) License or contract that governs re-use of the associated Item, this statement only summarizes the effects of some of its terms. It is not a License, and should not be used to license your Work. To license your own Work, use a License offered at https://creativecommons.org/
Recommended Citation
Wakeland, Wayne, "Prediction: The Quintessential Model Validation Test" (2015). Systems Science Friday Noon Seminar Series. 66.
https://archives.pdx.edu/ds/psu/31211