Show Summary Details

Page of

PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).

date: 12 December 2019

Abstract and Keywords

This chapter is from the forthcoming The Oxford Handbook of Affective Computing edited by Rafael Calvo, Sidney K. D'Mello, Jonathan Gratch, and Arvid Kappas. Facial expression communicates emotion, intention, and physical state; it also regulates interpersonal behavior. Automated face analysis (AFA) for the detection, synthesis, and understanding of facial expression is a vital focus of basic research. While open research questions remain, the field has become sufficiently mature to support initial applications in a variety of areas. We review (1) human observer‒based approaches to measurement that inform AFA; (2) advances in face detection and tracking, feature extraction, registration, and supervised learning; and (3) applications in action unit and intensity detection, physical pain, psychological distress and depression, detection of deception, interpersonal coordination, expression transfer, and other applications. We consider “user in the loop” as well as fully automated systems and discuss open questions in basic and applied research.

Keywords: automated face analysis and synthesis, facial action coding system (FACS), continuous measurement, emotion

Jeffrey F. Cohn

Jeffrey Cohn is Professor of Psychology at the University of Pittsburgh and Adjunct Professor at the Robotics Institute, Carnegie Mellon University. He received his PhD in psychology from the University of Massachusetts at Amherst. Dr. Cohn has led interdisciplinary and inter-institutional efforts to develop advanced methods of automatic analysis and synthesis of facial expression and prosody and applied those tools to research in human emotion, interpersonal processes, social development, psychopathology, and affective computing. He co-chairs the ACM International Conference on Multimodal Interfaces (ICMI 2014) and the IEEE International Conference on Automatic Face and Gesture Recognition (FG 2015).

Fernando De La Torre

Fernando De la Torre received his B.Sc. degree in Telecommunications, as well as his M.Sc. and Ph. D degrees in Electronic Engineering from La Salle School of Engineering at Ramon Llull University, Barcelona, Spain in 1994, 1996, and 2002, respectively. In 1997 and 2000, he became Assistant and Associate Professor in the Department of Communications and Signal Theory in Enginyeria La Salle. In 2003 he joined the Robotics Institute at Carnegie Mellon University and currently he is Research Associate Professor. His research interests are in the fields of Computer Vision and Machine Learning. Currently, he is directing the Component Analysis Laboratory and the Human Sensing Laboratory.

Access to the complete content on Oxford Handbooks Online requires a subscription or purchase. Public users are able to search the site and view the abstracts and keywords for each book and chapter without a subscription.

Please subscribe or login to access full text content.

If you have purchased a print title that contains an access token, please see the token for information about how to register your code.

For questions on access or troubleshooting, please check our FAQs, and if you can''t find the answer there, please contact us.