Jack Fitzgerald | The Need for Equivalence Testing

The Need for Equivalence Testing in Economics

Equivalence testing can provide statistically significant evidence that economic relationships are practically negligible. I demonstrate its necessity in a large-scale reanalysis of estimates defending 135 null claims made in 81 recent articles from top economics journals. 36-63% of estimates defending the average null claim fail lenient equivalence tests. In a prediction platform survey, researchers accurately predict that equivalence testing failure rates will significantly exceed levels which they deem acceptable. Obtaining equivalence testing failure rates that these researchers deem acceptable requires arguing that nearly 75% of published estimates in economics are practically equal to zero. These results imply that Type II error rates are unacceptably high throughout economics, and that many null findings in economics reflect low power rather than truly negligible relationships. I provide economists with guidelines and commands in Stata and R for conducting credible equivalence testing and practical significance testing in future research.

Read the paper here, opens in a new window

If you are interested in attending, please fill out the expression of interest form below.

EOI Form, opens in a new window

Zoom link:

https://unsw.zoom.us/j/8048058719?pwd=od2Qbhgrz8yGS6GULKuawIp2gqe1Gn.1&omn=84134763219

Password: 123456

Jack Fitzgerald is a PhD candidate in economics at Vrije Universiteit (VU) Amsterdam. He works on issues in applied econometrics, replication, and economics of science.

Equivalence testing is a major focus of his current research. He documents empirical evidence that null claims made in the absence of equivalence testing exhibit high error rates in top economics journals. To facilitate adoption, he offered practical guidelines and developed software commands for implementing equivalence testing. He also introduced equivalence testing improvements to standard methods (such as manipulation tests in regression discontinuity and hypothetical bias experiments) and introduced equivalence testing to different disciplines through empirical applications (for example, see his article in the Journal of Business Ethics, opens in a new window).

Learn more about him on his personal website, opens in a new window.