CEP LSE RSS Contact Us YouTube Facebook Twitter

Abstract:

cover
CEP Discussion Paper
The Credibility Revolution in Empirical Economics: How Better Research Design is taking the Con out of Econometrics
Joshua D. Angrist and Jörn-Steffen Pischke May 2010
Paper No' CEPDP0976:
Full Paper (pdf)

JEL Classification: C01


Tags: research design; natural experiment; quasi-experiment; structural models

This essay reviews progress in empirical economics since Leamer’s (1983) critique. Leamer highlighted the benefits of sensitivity analysis, a procedure in which researchers show how their results change with changes in specification or functional form. Sensitivity analysis has had a salutary but not a revolutionary effect on econometric practice. As we see it, the credibility revolution in empirical work can be traced to the rise of a design-based approach that emphasizes the identification of causal effects. Design-based studies typically feature either real or natural experiments and are distinguished by their prima facie credibility and by the attention investigators devote to making the case for a causal interpretation of the findings their designs generate. Design-based studies are most often found in the microeconomic fields of Development, Education, Environment, Labor, Health, and Public Finance, but are still rare in Industrial Organization and Macroeconomics. We explain why IO and Macro would do well to embrace a design-based approach. Finally, we respond to the charge that the design-based revolution has overreached.