Show Summary Details

Page of

PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).

date: 18 February 2020

Abstract and Keywords

Research in decision making and metacognition has long investigated the calibration of subjective probabilities. To assess calibration, mean ratings on a percentage scale (e.g., subjective likelihood of recalling an item) are typically compared directly to performance percentages (e.g., actual likelihood of recall). Means that are similar versus discrepant are believed to indicate good versus poor calibration, respectively. This chapter argues that this process is incomplete: it examines only the mapping between the overt scale values and objective performance (mapping 2), while ignoring the process by which the overt scale values are first assigned to different levels of subjective evidence (mapping 1). The chapter demonstrates how ignoring mapping 1 can lead to conclusions about calibration that are misleading. It proposes a signal detection framework that not only provides a powerful method for analyzing calibration data, but also offers a variety of measures of relative metacognitive accuracy (resolution).

Keywords: calibration, metacognitive accuracy, signal detection theory, resolution, AUC, gamma

Access to the complete content on Oxford Handbooks Online requires a subscription or purchase. Public users are able to search the site and view the abstracts and keywords for each book and chapter without a subscription.

Please subscribe or login to access full text content.

If you have purchased a print title that contains an access token, please see the token for information about how to register your code.

For questions on access or troubleshooting, please check our FAQs, and if you can''t find the answer there, please contact us.