Auditory Interfaces

Cover
Half Title
Title
Copyright
Contents
List of figures
List of tables
Preface
0.1 Introduction
0.2 Overview
0.3 The authors
1 Nonspeech audio: an introduction
1.1 Introduction
1.2 What about noise?
1.3 Figure and ground in audio
1.4 Sound and the visually impaired
1.5 Auditory display techniques
1.6 Some examples
1.7 Sound in collaborative work
1.8 Function and signal type
1.8.1 Alarms and warning systems
1.9 Audio cues and learning
1.10 Perception and psychoacoustics
1.11 The logistics of sound
1.12 Summary
2 Acoustics and psychoacoustics
2.1 Introduction
2.2 Acoustics
2.2.1 Waveforms
2.2.2 Fourier analysis and spectral plots
2.3 More complex waves
2.3.1 Sound, obstacles, bending, and shadows
2.3.2 Phase: its implication on sound and representations
2.3.3 The inverse-square law
2.3.4 Helmholtz revisited
2.3.5 Spectrograms
2.3.6 Formants versus partials
2.4 Digital filters
2.5 Spatial hearing
2.5.1 Head-related transfer functions (HRTF)
2.5.2 3D sound distance and reverberation
2.6 Psychoacoustics
2.6.1 Just noticeable difference (JND)
2.6.2 Critical bands
2.6.3 Pitch
2.6.4 Pitches, intervals, scales, and ratios
2.6.5 Loudness
2.6.6 Duration, attack time, and rhythm
2.6.7 Microvariation and spectral fusion
2.6.8 Timbre
2.6.9 Masking
2.6.10 Auditory streaming
2.6.11 Sounds with variations
2.6.12 Psychoacoustic illusions
2.7 Perception of 3D sound
2.7.1 Precedence/Hass effect
2.7.2 Binaural rendering
2.8 Hearing versus listening
2.9 Annoying sounds
2.10 Pleasant sounds
2.11 Embodied sound and music cognition
2.12 Conclusions
3 Sonification
3.1 Introduction
3.2 History
3.3 Model-based sonification (MBS)
3.4 Case studies
3.4.1 Case study 1: presenting information in sound
3.4.2 Case study 2: dynamic representation of multivariate time series data
3.4.3 Case study 3: stereophonic and surface sound generation
3.4.4 Case study 4: auditory presentation of experimental data
3.4.5 Case study 5: sonification of EEG data
3.5 Discussion
3.6 Issues
3.7 Issues of data
3.7.1 Issues of sound parameters
3.7.2 Issues of evaluation
3.8 Conclusions
4 Earcons
4.1 Introduction
4.2 Case studies
4.2.1 Case study 1: alarms and warning systems
4.2.2 Alarms as applied psychoacoustics
4.2.3 Problems with traditional alarms and convergences with audio interfaces
4.2.4 Case study 2: concurrent earcons
4.2.5 Case study 3: earcons for visually impaired users
4.3 Conclusions
5 Everyday listening
5.1 Introduction
5.2 Musical and everyday listening
5.2.1 Musical and everyday listening are experiences
5.3 The psychology of everyday listening
5.3.1 Knowledge about everyday listening
5.4 The ecological approach to perception
5.4.1 Developing an ecological account of listening
5.5 What do we hear?
5.6 The physics of sound-producing events
5.7 Vibrating objects
5.7.1 Aerodynamic sounds
5.7.2 Liquid sounds
5.7.3 Temporally complex events
5.8 Asking people what they hear
5.9 Attributes of everyday listening
5.10 Patterned, compound, and hybrid complex sounds
5.10.1 Problems and potentials of the framework
5.11 How do we hear it?
5.12 Analysis and synthesis of sounds and events
5.12.1 Breaking and bouncing bottles
5.12.2 Impact sounds
5.12.3 Material and length
5.12.4 Internal friction and material
5.13 Sound synthesis by physical modeling
5.14 Conclusions
6 Auditory icons
6.1 Introduction
6.2 Advantages of auditory icons
6.3 Systems that use auditory icons
6.3.1 Case study 1: SonicFinder: creating an auditory desktop
6.3.2 Case study 2: SoundShark: sounds in a large collaborative environment
6.3.3 Case study 3: ARKola: studying the use of sound in a complex system
6.3.4 Case study 4: ShareMon: background sounds for awareness
6.3.5 Case study 5: EAR: environmental audio reminders
6.3.6 Case study 6: Shoogle: excitatory multimodal interaction on mobile devices
6.3.7 Summary
6.4 Issues with auditory icons
6.4.1 Mapping sounds to events
6.4.2 What is being mapped to what?
6.4.3 Types of mapping
6.5 The vocabulary of auditory icons
6.5.1 Beyond literal mappings: metaphors, sound effects, cliches, and genre sounds
6.6 Annoyance
6.7 The psychoacoustics of annoying sounds
6.7.1 The principle of optimal complexity
6.7.2 Semantic effects
6.7.3 The tension between clarity and obtrusiveness
6.8 Conclusions
6.9 What’s next?
7 Sonic interaction design
7.1 Introduction
7.2 Psychology of sonic interactions
7.3 Sonic interactions in products
7.4 Examples of objects with interesting sounds
7.5 Methods in sonic interaction design
7.6 Case studies
7.6.1 Case study 1: naturalness influences perceived usability and pleasantness
7.6.2 Case study 2: the Ballancer: continuous sonic feedback from a rolling ball
7.7 Challenges of evaluation
7.8 Conclusions
8 Multimodal interactions
8.1 Introduction
8.2 Audiovisual interactions
8.3 Embodied interactions
8.4 Audio-haptic interactions
8.5 Case study 1: HapticWave
8.6 Conclusions
9 Spatial auditory displays
9.1 Introduction
9.2 Hearables
9.3 Case studies
9.3.1 Case study 1: the LISTEN system
9.3.2 Case study 2: Soundscape by Microsoft
9.3.3 Case study 3: SWAN – a system for wearable audio navigation
9.3.4 Case study 4: superhuman hearing
9.4 Conclusions
10 Synthesis and control of auditory icons
10.1 Generating and controlling sounds
10.2 Parameterized icons
10.2.1 Creating parameterized auditory icons
10.2.2 Acoustic information for events
10.2.3 Analysis and synthesis of events
10.2.4 Impact sounds
10.2.5 Mapping synthesis parameters to source attributes
10.2.6 An efficient algorithm for synthesis
10.2.7 Breaking, bouncing, and spilling
10.2.8 From impacts to scraping
10.2.9 Machine sounds
10.3 Physics-based simulations
10.4 Communicating with sound models
10.5 Evaluation of sound synthesis methods
10.6 Conclusions
11 Summary and future research
Bibliography
Index