Two main types of embodied agents are playing an increasingly important role in cognitive interaction technology: virtual humans inhabiting simulated environments and humanoid robots inhabiting the real world. The need to develop an integrated perspective of embodiment in communication, establishing bridges between lower-level, sensorimotor functions and a range of higher-level, communicative functions involving language and bodily action has led to the exploration of how artificial agents can advance our understanding of key aspects of embodiment, cognition, and communication.
The 17 articles in this state-of-the-art survey address artificial intelligence research on communicative agents and also provide an interdisciplinary perspective from linguistics, behavioral research, theoretical biology, philosophy, communication psychology, and computational neuroscience. The topics include studies on human multimodal communication; the modeling of feedback signals, facial expression, eye contact, and deception; the recognition and comprehension of hand gestures and head movements; communication interfaces for humanoid robots; the evolution of cognition and language; emotion and social appraisal in nonverbal communication; dialogue models and methodologies; theory of mind and intentionality; complex systems, dynamic field theory, and connectionist modeling.
Author(s): Ipke Wachsmuth, Günther Knoblich
Series: Lecture Notes in Artificial Intelligence 4930
Edition: 1
Publisher: Springer
Year: 2008
Language: English
Pages: 344
Front matter......Page 1
Introduction......Page 9
Annotating Multimodal Information......Page 11
Multimodal Corpora for ECA Design......Page 13
Multimodal Corpora for Modeling Human Behavior......Page 17
Evaluation of Corpus-Based Approaches to Generation......Page 20
Conclusion......Page 22
Introduction......Page 26
Previous Approaches to Modeling Feedback......Page 27
Framing Embodied Feedback......Page 29
The Virtual Human Max......Page 32
A Feedback System for Max......Page 34
Architecture and Realization......Page 35
Generation Examples......Page 41
Conclusions......Page 42
References......Page 43
Introduction......Page 46
Sensing Technology......Page 47
Gesture Recognition......Page 48
Gesture Segmentation......Page 49
Gesture and Speech......Page 50
Three Semiotic Dimensions of Meaning......Page 54
Deixis All over the Place......Page 56
Integrated Multimodal Language Comprehension......Page 58
Conclusion......Page 60
Introduction......Page 65
Communicating Uncertainty Face-to-face......Page 66
Visual Communication of Uncertainty......Page 69
Starting Point: RUTH......Page 70
Data and Analysis......Page 71
Head Pose......Page 73
Facial Displays......Page 77
Future Extensions and Issues......Page 78
Conclusion......Page 81
First Order Embodiment......Page 85
From First Order to Second Order Embodiment......Page 87
MMC --- An Internal Model......Page 89
Interconnection of Internal Sub-models......Page 98
Walknet --- From Reactive to Cognitive Systems......Page 102
Conclusion......Page 109
Introduction......Page 117
Speech Communication Function in WABOT-1......Page 118
``Pianist'' Robot WABOT-2......Page 119
Multi Modal Communications and AIs (Waseda and MIT)......Page 120
Beginning of the Party - Arrival of Honda Humanoid......Page 121
Robot as a Media - Why Physical Robots?......Page 122
Communication and the Body......Page 124
Model of Mind......Page 126
Hardware and Software Architectures of the Mind......Page 127
Applications......Page 128
Schematic Overview and Relation with Other Disciplines......Page 129
Future Directions......Page 130
Introduction......Page 133
Some Observations of Spatial Language......Page 134
Spatial Categories......Page 135
Spatial Perspective......Page 138
Conclusions......Page 139
The Perspective Reversal Experiment......Page 140
Embodiment......Page 141
Language Games......Page 142
Testing Different Configurations of Cognitive Mechanisms......Page 145
Conclusions and Further Research......Page 147
Introduction......Page 151
Multiple Levels of Detail......Page 153
Multiple Information Types – Numerous Forms of Constraints......Page 154
Emergence......Page 155
Intermediate Conclusion......Page 157
Models and Methods......Page 159
Large Heterogeneous Systems and Model Validity......Page 161
Abstract Modules and Near-Decomposability......Page 162
Model Examples......Page 166
Neurocognitive Architecture......Page 169
Conclusion......Page 171
References......Page 172
Introductory Remarks......Page 177
On Touch / Contact......Page 178
Communication as Eye Con-tact......Page 180
Responsiveness as Responsibility......Page 181
Meetings in Virtual Space......Page 182
References......Page 187
Introduction......Page 189
Social Emotions......Page 191
Social Appraisal Theory......Page 193
Computational Models......Page 195
Social Appraisals......Page 196
Appraising Speech Acts and Communicative Goals......Page 197
Social Goals......Page 198
Social Perception and Reactivity......Page 199
Conclusion......Page 201
References......Page 202
Introduction......Page 206
A General Model of Mind and Social Action......Page 207
The Two Faces of Communication......Page 209
The Default Rule of Telling the Truth......Page 210
What Is Deception?......Page 211
Why Do We Deceive?......Page 212
What Do We Deceive about?......Page 213
In How Many Ways Do We Deceive?......Page 214
Detecting Deception......Page 215
Building an Embodied Conversational Agent That Deceives......Page 216
Deceiving about Emotions in ECA......Page 219
Algorithm......Page 220
Facial Expression Management......Page 221
Annotation Scheme and Results......Page 222
Variables of Facial Expression Management......Page 223
Facial Expression Management Model......Page 224
Conclusion......Page 225
Introduction......Page 230
Communicating with Virtual Humans......Page 231
Attributes and Prerequisites for Human Communication......Page 234
Perspective Taking......Page 235
Common Ground......Page 236
Imputing One´s Knowledge to Others......Page 237
Theory of Mind......Page 238
Lacking Aspects in Human-Agent Communication......Page 240
Current Implementations of a Theory of Mind......Page 241
Suggestion with Regard to a Research Approach Based on ToM......Page 242
References......Page 243
Introduction......Page 249
The Sensitive Artificial Listener......Page 251
Head Movements in Context......Page 254
Functional Schemes......Page 257
Basic Movements......Page 260
Conclusion......Page 265
Embodied Cognition and Embodied Communication......Page 268
Dynamic Field Theory (DFT)......Page 271
Sequence Generation within DFT......Page 275
A Dynamic Field Model of Turn Taking......Page 277
Discussion......Page 281
Mathematical Description of the Models......Page 282
Preliminaries......Page 287
Who Is Max?......Page 290
Machine Consciousness......Page 292
Physically Grounded Self-knowledge (Anderson and Perlis)......Page 293
Implicit and Explicit Self-knowledge (Beckermann)......Page 294
Max as a Cognitive Agent......Page 296
Criteria for a ‘Human’ Non-human Consciousness......Page 299
References......Page 301
Introduction......Page 304
General Methodology......Page 305
Aspects of Dialogue Theory for Virtual Humans......Page 310
Question Answering Characters......Page 311
Group Conversation Characters......Page 312
Advanced Virtual Humans......Page 314
Conclusions......Page 316
Introduction......Page 318
Repetition and Content-Addressability in Melody Generation......Page 322
CAPAS Spelled Out as Dynamical Systems......Page 324
Basic ESN Concepts and Notation......Page 325
Signal Coding......Page 326
Architecture......Page 327
Study 1: CAPAS with Limited Resources......Page 328
Study 2: Hosting Exponentially Many Periodic Attractors......Page 333
Discussion......Page 335
Back matter......Page 344
