Panacea or Poison: Assessing How Well Basic Propensity Score Modeling Can Replicate Results from Randomized Controlled Trials in Criminal Justice Research
Sponsor
This project was supported by a grant from the National Institute of Justice (Award #2016-R2-CX-0030).
Published In
Journal of Experimental Criminology
Document Type
Citation
Publication Date
10-29-2022
Abstract
As a substitute, randomized controlled trial (RCT) researchers increasingly rely on propensity score modeling (PSM) to estimate causal effects. However, some warn about the dangers of placing too much blind faith in the abilities of PSM. This study tests the reliability and validity of seven common PSM methods in their ability to remove an artificial selection bias and replicate results from several RCTs in criminal justice data. Findings suggest PSM can be an effective means for simulating RCT results. Meta-analyses reveal the average difference between PSM and RCT estimates were relatively small. Ultimately, our findings suggest that PSM can be an effective means for simulating an RCT while also harboring reason for concern. Researchers and policy-makers should approach the use and interpretation of PSM with cautious optimism as it appears to provide a reliable and valid estimate of the treatment effect most of the time.
Rights
© The Author(s), under exclusive license to Springer Nature B.V. 2022
Locate the Document
DOI
10.1007/s11292-022-09532-y
Persistent Identifier
https://archives.pdx.edu/ds/psu/39235
Citation Details
Campbell, C. M., & Labrecque, R. M. (2022). Panacea or poison: Assessing how well basic propensity score modeling can replicate results from randomized controlled trials in criminal justice research. Journal of Experimental Criminology, 1-25.