- UNSW
- ...
- Events
- Past Seminars
- Patrick Vu | Why Are Replication Rates So Low
- Home
- About us
- Announcements
-
Events
- Current Events
- Past Roundtables
-
Past Workshops
- Bob Reed | Social capital and economic growth
- NSW Emerging HR Professionals Network
- 2019 Invitation-Only Workshop
- 2018 Workshop: From Questionable Research Practices to Sound Science
- 2017 Workshop on Research Methods in Social Sciences and Business
- 2016 Workshop on Experimental Research in Social Science and Business
- 2015 BizLab workshop in Experimental Methods
-
Past Seminars
- Sam Kirshner | Artificial Agents in Operations Management Experiments
- Jack Fitzgerald | The Need for Equivalence Testing in Economics
- Ben Greiner | Reproducibility in Economics and Management
- Florian Artinger | Frequency, Costs, and Remedies of “Cover-Your-Ass” Behaviour in Organisations
- Florian Artinger | BIBaP Luncheon on Psychological AI
- Jack Fitzgerald | Impact of Hypothetical Incentives
- Patrick Vu | Why Are Replication Rates So Low
- Malte Friese | Is Ego Depletion Real? An Analysis of Arguments
- Thomas Pfeiffer | Replication Markets In The Social And Behavioural Sciences
- Chris Donkin | Why Preregistration Is Not Worthwhile
- Bill von Hippel | Discovering Your Own Name On A Wall Of Shame
- Eva Vivalt | Uses of Forecasts in Research
- Bob Reed | Yes You Can Calculate Ex Post Power
- Xueting Wang | Quasi-hyperbolic Present Bias
- Julia Rohrer | Not Even Unreplicable
- Daniel Lakens | When It’s OK to Use P-Values
- Ben Newell | Nudges For People Who Think
- Uli Schimmack | Implicit Preferences
- Fiona Fidler & Bonnie Wintle | The repliCATS Project
- Anna Dreber Almenberg | Replications and Predicting Replication Outcomes
- Adam Gorajek & Joel Bank | Star Wars at Central Banks
- Frederik Anseel | Can We Accomplish Both Academic And Practical Impact
- Gilad Chen | Research Methods Seminar
- Gilad Chen | The State Of The OB Science
- Gilad Feldman | Mass Mobilizing For Collaborative Credibility Revolution
- Hazel Bateman | Learning To Value Annuities
- Jonas Fooken | Performance-Based Pay, Motivation, Stress And Preferences
- Will Felps | Can We Make Business Science Better
- John Roberts | A Research Agenda for Studying the Role of Emotions in Choice Models
- Joel Pearson | Future Minds Lab, Who Are We And What Are We Doing
- Lionel Page | The Matthew Effect: How Success Fosters Further Success
- Bob Reed | On Replications, Significance Testing, Confidence Intervals and p-Values
- Elise Payzan-Le Nestour | Neuroeconomics as Neuropragmatism
- Fiona Fidler | Will This Time Be Different
- Eva Vivalt | How Much Can We Generalize From Impact Evaluations?
- Amirali Minbashian | Lessons From Psychology
- Daniel Friedman | Varieties of Risk Elicitation
- Gina Perry | Backstage and Frontstage
- Danielle Navarro | Between the devil and the deep blue sea
- Uwe Dulleck | The Case for Economic Theory
- Chris Donkin | Back to the Drawing Board
- Carsten Murawski | Computational Complexity and Decision-Making
- Will Felps | Solutions to the Credibility Crisis in Business Science
- Joshua Miller | The Hot Hand Fallacy Fallacy
- Mark Rubin | Hypothesising After the Results are Known
- Jeanette Deetlefs | On Recently Completed RCT Interventions
- Chew Soo Hong | A Revolutionary Understanding of How People Make Decisions
- Rachael Meager | Evidence Aggregation in the Presence of Heterogeneity
- Dan Goldstein | Interpretable Artificial Intelligence
- Glenn W. Harrison | Welfare Evaluation of Insurance
- Adam Gorajek | An Introduction to Specification Curves and P-curves
- Renee Adams | The ABCs of Empirical Corporate (Governance) Research
- Vinayak Dixit | Risk Perceptions in Transport
- Michaela Pagel | The Retirement-Consumption Puzzle
- Sarah Walker | Taking the Lab to the Field
- Eva Vivalt | How Do Policymakers Update?
- Gideon Nave | Does Oxytocin Increase Trust in Humans?
- Peter Bossaerts | How Neurobiology Can Inform Decision Science
- Erte Xiao on Competing by Default: A New Way to Break the Glass Ceiling
- Clara Chen on The Effects of Directional Goals
- Taisuke Imai | Meta-Analysis in Behavioral Economics
- Useful links
- Articles
- Members and associates
- Contact
- Home
- About us
- Announcements
-
Events
Past Workshops
- Bob Reed | Social capital and economic growth
- NSW Emerging HR Professionals Network
- 2019 Invitation-Only Workshop
- 2018 Workshop: From Questionable Research Practices to Sound Science
- 2017 Workshop on Research Methods in Social Sciences and Business
- 2016 Workshop on Experimental Research in Social Science and Business
- 2015 BizLab workshop in Experimental Methods
Past Seminars
- Sam Kirshner | Artificial Agents in Operations Management Experiments
- Jack Fitzgerald | The Need for Equivalence Testing in Economics
- Ben Greiner | Reproducibility in Economics and Management
- Florian Artinger | Frequency, Costs, and Remedies of “Cover-Your-Ass” Behaviour in Organisations
- Florian Artinger | BIBaP Luncheon on Psychological AI
- Jack Fitzgerald | Impact of Hypothetical Incentives
- Patrick Vu | Why Are Replication Rates So Low
- Malte Friese | Is Ego Depletion Real? An Analysis of Arguments
- Thomas Pfeiffer | Replication Markets In The Social And Behavioural Sciences
- Chris Donkin | Why Preregistration Is Not Worthwhile
- Bill von Hippel | Discovering Your Own Name On A Wall Of Shame
- Eva Vivalt | Uses of Forecasts in Research
- Bob Reed | Yes You Can Calculate Ex Post Power
- Xueting Wang | Quasi-hyperbolic Present Bias
- Julia Rohrer | Not Even Unreplicable
- Daniel Lakens | When It’s OK to Use P-Values
- Ben Newell | Nudges For People Who Think
- Uli Schimmack | Implicit Preferences
- Fiona Fidler & Bonnie Wintle | The repliCATS Project
- Anna Dreber Almenberg | Replications and Predicting Replication Outcomes
- Adam Gorajek & Joel Bank | Star Wars at Central Banks
- Frederik Anseel | Can We Accomplish Both Academic And Practical Impact
- Gilad Chen | Research Methods Seminar
- Gilad Chen | The State Of The OB Science
- Gilad Feldman | Mass Mobilizing For Collaborative Credibility Revolution
- Hazel Bateman | Learning To Value Annuities
- Jonas Fooken | Performance-Based Pay, Motivation, Stress And Preferences
- Will Felps | Can We Make Business Science Better
- John Roberts | A Research Agenda for Studying the Role of Emotions in Choice Models
- Joel Pearson | Future Minds Lab, Who Are We And What Are We Doing
- Lionel Page | The Matthew Effect: How Success Fosters Further Success
- Bob Reed | On Replications, Significance Testing, Confidence Intervals and p-Values
- Elise Payzan-Le Nestour | Neuroeconomics as Neuropragmatism
- Fiona Fidler | Will This Time Be Different
- Eva Vivalt | How Much Can We Generalize From Impact Evaluations?
- Amirali Minbashian | Lessons From Psychology
- Daniel Friedman | Varieties of Risk Elicitation
- Gina Perry | Backstage and Frontstage
- Danielle Navarro | Between the devil and the deep blue sea
- Uwe Dulleck | The Case for Economic Theory
- Chris Donkin | Back to the Drawing Board
- Carsten Murawski | Computational Complexity and Decision-Making
- Will Felps | Solutions to the Credibility Crisis in Business Science
- Joshua Miller | The Hot Hand Fallacy Fallacy
- Mark Rubin | Hypothesising After the Results are Known
- Jeanette Deetlefs | On Recently Completed RCT Interventions
- Chew Soo Hong | A Revolutionary Understanding of How People Make Decisions
- Rachael Meager | Evidence Aggregation in the Presence of Heterogeneity
- Dan Goldstein | Interpretable Artificial Intelligence
- Glenn W. Harrison | Welfare Evaluation of Insurance
- Adam Gorajek | An Introduction to Specification Curves and P-curves
- Renee Adams | The ABCs of Empirical Corporate (Governance) Research
- Vinayak Dixit | Risk Perceptions in Transport
- Michaela Pagel | The Retirement-Consumption Puzzle
- Sarah Walker | Taking the Lab to the Field
- Eva Vivalt | How Do Policymakers Update?
- Gideon Nave | Does Oxytocin Increase Trust in Humans?
- Peter Bossaerts | How Neurobiology Can Inform Decision Science
- Erte Xiao on Competing by Default: A New Way to Break the Glass Ceiling
- Clara Chen on The Effects of Directional Goals
- Taisuke Imai | Meta-Analysis in Behavioral Economics
- Useful links
- Articles
- Members and associates
- Contact
Patrick Vu | Why are replication rates so low?

Topic
Why Are Replication Rates So Low?
Many explanations have been offered for why replication rates are low in the social sciences, including selective publication, p-hacking, and treatment effect heterogeneity. This article emphasizes that issues with the most commonly used approach for setting sample sizes in replication studies may also play an important role. Theoretically, I show in a simple model of the publication process that we should expect the replication rate to fall below its nominal target, even when original studies are unbiased. The main mechanism is that the most commonly used approach for setting the replication sample size does not account for non-linearities in the replication power function. Empirically, I find that a parsimonious model accounting only for these issues can fully explain observed replication rates in experimental economics and social science, and two-thirds of the replication gap in psychology. I conclude with practical recommendations for replicators.
Expression of interest
If you are interested in attending, please fill out the expression of interest form below.
Please note that the seating of this event is limited.
About the speaker
Patrick Vu is an Assistant Professor/Lecturer of Economics at the UNSW Business School.
His research interests are primarily in applied and theoretical econometrics, with a focus on how publication bias impacts the statistical credibility of published research and the quality of evidence-based policy decisions.
He received his PhD in economics at Brown University, where he was awarded the George Borts Prize for best dissertation. He holds an MPhil in economics from the University of Oxford and an undergraduate degree from the University of Western Australia, with majors in economics and classical music.
Learn more about him on his personal website, opens in a new window.