Development and Evaluation of a
Computer-Animated Tutor

Dominic W. Massaro

Department of Psychology
University of California, Santa Cruz

Date: Friday, May 7, 2004
Place: CS Conference Room, Engineering 1, Rm. 2114
Time: 4:00 pm – 5:00 pm (Refreshments served at 3:30 pm)

Abstract:
Speech and language science evolved under the assumption that speech was a solely auditory event. However, a burgeoning record of research findings reveals that our perception and understanding are influenced by a speaker's face and accompanying gestures, as well as the actual sound of the speech. Perceivers expertly use these multiple sources of information to identify and interpret the language input. This behavior is accurately described by our Fuzzy Logical Model of Perception. Given the value of face-to-face interaction, our persistent goal has been to develop, evaluate, and apply animated agents to produce realistic and accurate speech. Baldi is an accurate three-dimensional animated talking head appropriately aligned with either synthesized or natural speech. Baldi has a tongue and palate, which can be displayed by making his skin transparent. Based on this research and technology, we have implemented computer-assisted speech and language tutors for hard of hearing and autistic children. Our language-training program utilizes Baldi as the conversational agent, who guides students through a variety of exercises designed to teach vocabulary and grammar, to improve speech articulation, and to develop linguistic and phonological awareness. Some of the advantages of the Baldi pedagogy and technology include the popularity and effectiveness of computers and embodied conversational agents, the perpetual availability of the program, and individualized instruction. The science and technology of Baldi holds great promise in language learning, dialog, human-machine interaction, and education.

Biography:
Dominic W. Massaro is Professor of Psychology and director of the Perceptual Science Laboratory at the University of California, Santa Cruz. He has been a Guggenheim Fellow, a University of Wisconsin Romnes Fellow, a James McKeen Cattell Fellow, and an NIMH Fellow. He is a past president of the Society for Computers in Psychology, and is currently the book review editor of the American Journal of Psychology and co-editor of the journal Interpreting. His research uses a formal experimental and theoretical approach to the study of speech perception, reading, psycholinguistics, memory, cognition, learning, and decision making. One focus of his current research is on the development and theoretical and applied use of a completely synthetic and animated head for speech synthesis, language tutoring, and edutainment.

Host: Matthew Turk, Professor of Computer Science and Media Arts & Technology