Multimodality’s popularity as a semiotic approach has not resulted in a common voice yet. Its conceptual anchoring as well as its empirical applications often remain localized and disparate, and ideas of a theory of multimodality are heterogeneous and uncoordinated. For the field to move ahead, it must achieve a more mature status of reflection, mutual support, and interaction with regard to both past and future directions. The red thread across the disciplines reflected in this book is a common goal of capturing the mechanisms of synergetic knowledge construction and transmission using diverse forms of expressions, i.e., multimodality. The collection of chapters brought together in the book reflects both a diversity of disciplines and common interests and challenges, thereby establishing an excellent roadmap for the future. The contributions revisit and redefine theoretical concepts or empirical analyses, which are crucial to the study of multimodality from various perspectives, with a view towards evolving issues of multimodal analysis. With this, the book aims at repositioning the field as a well-grounded scientific discipline with significant implications for future communication research in many fields of study.
Author(s): Janina Wildfeuer; Jana Pflaeging; John Bateman; Ognyan Seizov; Chiao-I Tseng
Publisher: Walter de Gruyter GmbH & Co KG
Year: 2019
Language: English
Pages: 340
Preface and Acknowledgements|V
Part I: Introduction
Janina Wildfeuer, Jana Pflaeging, John A. Bateman, Ognyan Seizov, and Chiao-I
Tseng
Multimodality: Disciplinary Thoughts and the Challenge of Diversity –
Introduction|3
Part II: Disciplinary Thoughts
Hartmut Stöckl
Linguistic Multimodality – Multimodal Linguistics:
A State-of-the-Art Sketch|41
Martin Thomas
Making a Virtue of Material Values:
Tactical and Strategic Benefits for Scaling Multimodal Analysis|69
Kay L. O’Halloran, Sabine Tan, Peter Wignell, Rui Wang, Kevin Chai, and Rebecca
Lange
Towards a Discipline of Multimodality:
Parallels to Mathematics and Linguistics and New Ways Forward|93
Part III: Diversity
Axel Schmidt and Konstanze Marx
Multimodality as Challenge:
YouTube Data in Linguistic Corpora|115
Lauren O’Hagan
Class, Culture, and Conflict in the Edwardian Book Inscription:
A Multimodal Ethnohistorical Approach|145
John Harnett
Cognitive Pathfinders:
Highlighting Cross-Modal Interaction and the Orchestration of Memory in
Comics|171
Christopher Taylor
Audio Description:
A Multimodal Practice in Expansion|195
Edward Larkey
Narrative as a Mode of Communication:
Comparing TV Format Adaptations with Multimodal and Narratological
Approaches|219
Wendy Nielsen, Pauline Jones, Helen Georgiou, Annette Turney, and Mary
Macken-Horarik
Learning Science through Generating Multimodal Digital Explanations:
Contributions to Multimodality in Educational Practice|247
Dušan Stamenković and Milan Jaćević
Video Games and Multimodality:
Exploring Interfaces and Analyzing Video Screens Using the GeM
Model|277
Part IV: More Disciplinary Thoughts
John A. Bateman
Afterword: Legitimating Multimodality|297
List of Contributors|323
Index|329
