Show Summary Details

Page of

PRINTED FROM OXFORD HANDBOOKS ONLINE ( © Oxford University Press, 2018. All Rights Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).

date: 25 August 2019

Abstract and Keywords

Economics and other sciences use null hypothesis statistical significance testing without a loss function and avoid asking “how big is a big loss or gain?.” Statistical significance is not equivalent to economic significance; the mistake is evident when one reflects that the estimated payoff from a lottery is not the same as the odds of winning that lottery. Yet a widespread failure to make the distinction between an estimate of human consequence and an estimate of its probability—between the meaning of an estimated average and the random variance around it—is killing people in medicine and impoverishing people in economics. The ethical problem created by a test of statistical significance is made worse by the method’s blatant illogic at the foundational level, a fact unacknowledged by most of those depending on it. Several changes to the literature and a recent Supreme Court decision could help.

Keywords: ethics, statistical significance, oomph, Matrixx v. Siracusano, Fisher, Gosset

Access to the complete content on Oxford Handbooks Online requires a subscription or purchase. Public users are able to search the site and view the abstracts and keywords for each book and chapter without a subscription.

Please subscribe or login to access full text content.

If you have purchased a print title that contains an access token, please see the token for information about how to register your code.

For questions on access or troubleshooting, please check our FAQs, and if you can''t find the answer there, please contact us.