Research on the multifaceted aspects of modeling, analysis, and synthesis of - man gesture is receiving growing interest from both the academic and industrial communities. On one hand, recent scienti?c developments on cognition, on - fect/emotion, on multimodal interfaces, and on multimedia have opened new perspectives on the integration of more sophisticated models of gesture in c- putersystems.Ontheotherhand,theconsolidationofnewtechnologiesenabling “disappearing” computers and (multimodal) interfaces to be integrated into the natural environments of users are making it realistic to consider tackling the complex meaning and subtleties of human gesture in multimedia systems, - abling a deeper, user-centered, enhanced physical participation and experience in the human-machine interaction process. The research programs supported by the European Commission and s- eral national institutions and governments individuated in recent years strategic ?elds strictly concerned with gesture research. For example, the DG Infor- tion Society of the European Commission (www.cordis.lu/ist) supports several initiatives, such as the “Disappearing Computer” and “Presence” EU-IST FET (Future and Emerging Technologies), the IST program “Interfaces & Enhanced Audio-Visual Services” (see for example the project MEGA, Multisensory - pressive Gesture Applications, www.megaproject.org), and the IST strategic - jective “Multimodal Interfaces.” Several EC projects and other funded research are represented in the chapters of this book. Awiderangeofapplicationscanbene?tfromadvancesinresearchongesture, from consolidated areas such as surveillance to new or emerging ?elds such as therapy and rehabilitation, home consumer goods, entertainment, and aud- visual, cultural and artistic applications, just to mention only a few of them.
Author(s): Sylvie Gibet, Jean-François Kamp, Franck Poirier (auth.), Antonio Camurri, Gualtiero Volpe (eds.)
Series: Lecture Notes in Computer Science 2915 : Lecture Notes in Artificial Intelligence
Edition: 1
Publisher: Springer-Verlag Berlin Heidelberg
Year: 2004
Language: English
Pages: 560
Tags: Artificial Intelligence (incl. Robotics); Computer Science, general; User Interfaces and Human Computer Interaction; Computer Graphics; Image Processing and Computer Vision; Pattern Recognition
Front Matter....Pages -
Gesture Analysis: Invariant Laws in Movement....Pages 1-9
The Features People Use to Recognize Human Movement Style....Pages 10-19
Multimodal Analysis of Expressive Gesture in Music and Dance Performances....Pages 20-39
Correlation of Gestural Musical Audio Cues and Perceived Expressive Qualities....Pages 40-54
Gestural Imagery in the Service of Musical Imagery....Pages 55-62
The Interaction of Iconic Gesture and Speech in Talk....Pages 63-69
Conceptual and Lexical Factors in the Production of Speech and Conversational Gestures: Neuropsychological Evidence....Pages 70-76
The Communicative System of Touch. Alphabet, Lexicon, and Norms of Use....Pages 77-89
Some Issues in Sign Language Processing....Pages 90-100
Multimodality and Gestures in the Teacher’s Communication....Pages 101-111
Deixis in Multimodal Human Computer Interaction: An Interdisciplinary Approach....Pages 112-123
The Analysis of Gesture: Establishing a Set of Parameters....Pages 124-131
Holistic Body Tracking for Gestural Interfaces....Pages 132-139
Recovering Articulated Motion with a Hierarchical Factorization Method....Pages 140-151
An Experimental Comparison of Trajectory-Based and History-Based Representation for Gesture Recognition....Pages 152-163
Tracking of Real Time Acrobatic Movements by Image Processing....Pages 164-171
A Dynamic Model for Real-Time Tracking of Hands in Bimanual Movements....Pages 172-179
Robust Video-Based Recognition of Dynamic Head Gestures in Various Domains – Comparing a Rule-Based and a Stochastic Approach....Pages 180-197
Remote Vision-Based Multi-type Gesture Interaction....Pages 198-209
Model-Based Motion Filtering for Improving Arm Gesture Recognition Performance....Pages 210-230
GesRec3D: A Real-Time Coded Gesture-to-Speech System with Automatic Segmentation and Recognition Thresholding Using Dissimilarity Measures....Pages 231-238
Classification of Gesture with Layered Meanings....Pages 239-246
Handshapes and Movements: Multiple-Channel American Sign Language Recognition....Pages 247-258
Hand Postures Recognition in Large–Display VR Environments....Pages 259-268
Developing Task-Specific RBF Hand Gesture Recognition....Pages 269-276
Developing Context Sensitive HMM Gesture Recognition....Pages 277-287
Database Indexing Methods for 3D Hand Pose Estimation....Pages 288-299
Experience with and Requirements for a Gesture Description Language for Synthetic Animation....Pages 300-311
The Development of a Computational Notation for Synthesis of Sign and Gesture....Pages 312-323
Gesture in Style....Pages 324-337
Gestural Mind Markers in ECAs....Pages 338-349
Audio Based Real-Time Speech Animation of Embodied Conversational Agents....Pages 350-360
Neo Euclide: A Low-Cost System for Performance Animation and Puppetry....Pages 361-368
Gesture Desk – An Integrated Multi-modal Gestural Workplace for Sonification....Pages 369-379
Gesture Frame – A Screen Navigation System for Interactive Multimedia Kiosks....Pages 380-385
Intuitive Manipulation of a Haptic Monitor for the Gestural Human-Computer Interaction....Pages 386-398
Gesturing with Tangible Interfaces for Mixed Reality....Pages 399-408
A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI....Pages 409-420
Evaluating Multimodal Interaction Patterns in Various Application Scenarios....Pages 421-435
Imitation Games with an Artificial Agent: From Mimicking to Understanding Shape-Related Iconic Gestures....Pages 436-447
Gesture Components for Natural Interaction with In-Car Devices....Pages 448-459
Analysis of Expressive Gesture: The EyesWeb Expressive Gesture Processing Library....Pages 460-467
Performance Gestures of Musicians: What Structural and Emotional Information Do They Convey?....Pages 468-478
Expressiveness of Musician’s Body Movements in Performances on Marimba....Pages 479-486
Expressive Bowing on a Virtual String Instrument....Pages 487-496
Recognition of Musical Gestures in Known Pieces and in Improvisations....Pages 497-508
Design and Use of Some New Digital Musical Instruments....Pages 509-518
Analysis of a Genuine Scratch Performance....Pages 519-528
Conducting Audio Files via Computer Vision....Pages 529-540
A Video System for Recognizing Gestures by Artificial Neural Networks for Expressive Musical Control....Pages 541-548
Ghost in the Cave – An Interactive Collaborative Game Using Non-verbal Communication....Pages 549-556
Back Matter....Pages -
