- [UNTITLED]
- Preface
- Contributors
- Representations and representational specificity in speech perception and spoken word recognition
- Audiovisual speech perception and word recognition
- Eight questions about spoken word recognition
- Statistical and connectionist models of speech perception and word recognition
- Visual word recognition
- Eye movements and visual word recognition
- Speech and spelling interaction: the interdependence of visual and auditory word recognition
- Word processing in the brain as revealed by neurophysiological imaging
- Word recognition in aphasia
- Representation and processing of lexically ambiguous words
- Morphological Processes in language Comprehension
- Semantic representation
- Conceptual structure
- Connectionist models of reading
- The multilingual lexicon
- The biocognition of the mental lexicon
- Syntactic parsing
- Spoken language comprehension: insights from eye movements
- Eye movements and on-line comprehension processes
- Inference processing in discourse comprehension
- Language and action: creating sensible combinations of ideas
- Bilingual sentence processing
- Event-related brain potential (ERP) studies of sentence processing
- Neuroimaging studies of sentence and discourse comprehension
- Sentence-level deficits in aphasia
- Alignment in dialogue
- Grammatical Encoding
- Word form retrieval in language production
- Speech Production
- The problem of speech patterns in time
- Connectionist principles in theories of speech production
- Cross-linguistic research on language production
- Brain-imaging studies of language production
- Language production in aphasia
- The perceptual foundations of phonological development
- Statistical learning in infant language development
- Word learning
- Concept formation and language development: count nouns and object kinds
- Learning to parse and its implications for language acquisition
- Learning to read
- Developmental dyslexia
- Genetics of language disorders: clinical conditions, phenotypes, and genes
- The psycholinguistics of signed and spoken languages: how biology affects processing
- Spoken language processing by machine
- Relating structure and time in linguistics and psycholinguistics
- Working Memory and Language
- Language and mirror neurons
- The evolution of language: a comparative perspective
- Thinking across the boundaries: psycholinguistic perspectives
- Subject index
- Author index
Abstract and Keywords
This article gives an overview of the main research questions and findings unique to audiovisual speech perception research, and discusses what general questions about speech perception and cognition the research in this field can answer. The influence of a second perceptual source in audiovisual speech perception compared to auditory speech perception immediately necessitates the question of how the information from the different perceptual sources is used to reach the best overall decision. The article explores how our understanding of speech benefits from having the speaker's face present, and how this benefit makes transparent the nature of speech perception and word recognition. Modern communication methods such as Voice over Internet Protocol find a wide acceptance, but people are reluctant to forfeit face-to-face communication. The article also considers the role of visual speech as a language-learning tool in multimodal training, information and information processing in audiovisual speech perception, lexicon and word recognition, facial information for speech perception, and theories of audiovisual speech perception.
Keywords: audiovisual speech perception, cognition, auditory speech perception, word recognition, communication, visual speech, language learning, multimodal training, information processing, lexicon
Dominic W. Massaro, Department of Psychology, University of California, Santa Cruz.
Alexandra Jesse, Department of Psychology, University of California, Santa Cruz.
Access to the complete content on Oxford Handbooks Online requires a subscription or purchase. Public users are able to search the site and view the abstracts and keywords for each book and chapter without a subscription.
Please subscribe or login to access full text content.
If you have purchased a print title that contains an access token, please see the token for information about how to register your code.
For questions on access or troubleshooting, please check our FAQs, and if you can''t find the answer there, please contact us.
- [UNTITLED]
- Preface
- Contributors
- Representations and representational specificity in speech perception and spoken word recognition
- Audiovisual speech perception and word recognition
- Eight questions about spoken word recognition
- Statistical and connectionist models of speech perception and word recognition
- Visual word recognition
- Eye movements and visual word recognition
- Speech and spelling interaction: the interdependence of visual and auditory word recognition
- Word processing in the brain as revealed by neurophysiological imaging
- Word recognition in aphasia
- Representation and processing of lexically ambiguous words
- Morphological Processes in language Comprehension
- Semantic representation
- Conceptual structure
- Connectionist models of reading
- The multilingual lexicon
- The biocognition of the mental lexicon
- Syntactic parsing
- Spoken language comprehension: insights from eye movements
- Eye movements and on-line comprehension processes
- Inference processing in discourse comprehension
- Language and action: creating sensible combinations of ideas
- Bilingual sentence processing
- Event-related brain potential (ERP) studies of sentence processing
- Neuroimaging studies of sentence and discourse comprehension
- Sentence-level deficits in aphasia
- Alignment in dialogue
- Grammatical Encoding
- Word form retrieval in language production
- Speech Production
- The problem of speech patterns in time
- Connectionist principles in theories of speech production
- Cross-linguistic research on language production
- Brain-imaging studies of language production
- Language production in aphasia
- The perceptual foundations of phonological development
- Statistical learning in infant language development
- Word learning
- Concept formation and language development: count nouns and object kinds
- Learning to parse and its implications for language acquisition
- Learning to read
- Developmental dyslexia
- Genetics of language disorders: clinical conditions, phenotypes, and genes
- The psycholinguistics of signed and spoken languages: how biology affects processing
- Spoken language processing by machine
- Relating structure and time in linguistics and psycholinguistics
- Working Memory and Language
- Language and mirror neurons
- The evolution of language: a comparative perspective
- Thinking across the boundaries: psycholinguistic perspectives
- Subject index
- Author index