The Routledge Handbook of Semiosis and the Brain

Cover
Half Title
Series Information
Title Page
Copyright Page
Table of Contents
Figures
Tables
Acknowledgments
Contributor Information
Introduction: Semiosis, Brain, and Context: The Unmet Need for a Transdisciplinary Framework
Neurosemiotics: What, How, Why?
The Handbook at a Glance
Looking Forward
Funding
References
Part I Prolegomena to Neurosemiotics
1 Neurosemiotics: A Brief History of Its Development and Key Concerns
Introduction
A Brief History of Neurosemiotics
Characteristics of Research in Neurosemiotics
Preconditions for Neural Semiosis
Some Features of Neural Cells That Are Relevant for Semiosis
Neurosemiosis, or the Neural Processes That Are Responsible for the Creation of Sign-Relations
Process–Relation Duality
Semiosis Is the Process That Creates the Simultaneous Presence of Multiple Options
Codes Are the Building Blocks of Semiosis
Habituation Quasi-Stabilizes the Neural Structure
Conclusion
Acknowledgements
Notes
References
2 Steps to a Semiotic Cognitive Neuroscience
Cognition Explained Away
Semiosis: The Missing Link
The Non-Semiotic Framing of Cognitive Science
Semiotic Preliminaries
Semiosis: The Process of Interpreting
Semiotic Affordances
Deconstructing the Code Analogy
Nested Interpretive Dependencies
Semiotic Neuroscience
A Dynamical Basis for Cortical Iconism
Counter-Current Information Processing
Recursive Interpretation
Symbolic Interpretation
Ungrounding Symbolic Reference
From Index to Symbol
Mnemonic Implications
Summary and Conclusions
Notes
References
3 An Active Inference Approach to Semiotics: A Variational Theory of Signs
Introduction
Active Inference
An Introduction to the Active Inference Framework
Markov Blankets and Generative Models
A Simple Generative Model: Likelihood Mappings and Prior Beliefs
Toward a Variational Semiotics
Active Inference and Deflationary Semantics
A Basic Semiotic Structure
Variational Icons (“Looks Like”)
Variational Indices (“Points To”)
Variational Symbols (“Refers To, Within a Convention”)
Deontic Cues and the Conventionalization of Signs
The Syntactic Aspect of Symbols
Conclusion
Acknowledgments
Notes
References
4 Experimental Semiotics: Past, Present, and Future
Introduction
Historical Context of Experimental Semiotics
The Fundamentals of Human Semiosis
Symbol Grounding
Design Features
The Cognitive and Social Underpinnings of Human Semiosis
Cognitive Underpinnings: Impact of Modality
Social Underpinnings: Horizontal and Vertical Transmission
Open Challenges and Future Directions
Limitations
Integration of ES and Neuroscience in a Neurosemiotic Framework
Conclusions
Note
References
5 Beyond the Human Animal: Towards a Cross-Species Neurosemiotics
Introduction
The “Neural Code”: A Semiotic Concept?
Neurosemiotics in Jakob Von Uexküll’s Umwelt Theory
The Neural Code Across Species in Light of Umwelt Theory
Neurosemiotic Agency and Objecthood Across Species
A Biosemiotic Perspective On Anthropocentrism in Behavioral Neuroscience
Concluding Remarks
Notes
References
Part II Language and Its Pathways to Meaning
6 Neural Bases of Multimodal Semantics
Introduction
Semantic Memory
The History of Semantic Research
The Neural Basis of Semantic Memory
Semantic Dementia
Semantic Problems in Temporal Lobe Epilepsy Patients
Neuroimaging
The Frequency Effect
Lateralization Within the Semantic Network
Semantic Control System
Conclusion
Note
References
7 Embodied Mechanisms and the Shaping of Semantics
Introduction
Processing Verbs
Neural Structures of Verbs Processing
Behavioral Evidence
Time-Course of Verb Understanding
Embodiment in Movements Disorders
Mirror Neurons and Their Potential Role in Language Processing
Processing Concrete Nouns
Neural Representation of Objects
Neural Representation of Concrete Nouns
Time-course of Concrete Nouns Processing
The Language of Emotions
Embodied Communication in a Neurosemiotic Framework
Conclusion
References
8 The Figurative Brain
Introduction
Pragmatic Insights for a Neurosemiotics of Figurative Language
Figurative Language and the Brain
Figurative Language and Embodied Simulation
Other Forms of Figurative Meaning
The Time Course of Figurative Language Processing
Conclusion
Notes
References
9 Pharmacological Modulation of Meaning Attribution
Introduction
Two Dimensions of Meaning in the Brain
Dopaminergic Modulation of Salience
Serotonergic Modulation of Meaning Attribution
Specificity of Dopaminergic and Serotonergic Effects
Therapeutic Use of Psychedelics and the Attribution of Personal Meaning
Conclusion
Notes
References
10 How Grammar Means
Introduction
Conventional Approaches to Meaning and Syntax
Meaning
Syntax
Interim Conclusions
Towards a Neurosemiotics of Syntactic Meaning
Syntactic Constructions Convey Meaning
Syntactic Constructions Are Referential Tools
Interim Conclusions
Syntactic Constructions Reuse Ancient Neural Networks
Broca’s Area
The Inhibitory Control System
Interim Conclusions
Neural Coupling in Communication
Interim Conclusions
Concluding Remarks
Note
References
11 Discourse and the Brain: Capturing Meaning in the Wild
Introduction
Lexical Processing in Discourse Context
Word Frequency
Surprisal and Entropy
Semantic Features
Embodiment
Combinatorial and Compositional Processing
Regions Involved in Semantics of Discourse Processing
Anterior Temporal Lobe
Angular Gyrus
Precuneus and Posterior Cingulate
Bilaterality
Neurosemiotics and Language in the Wild
Cautions, Caveats, and Future Directions
Conclusion
References
12 Words, Meanings, and the Bilingual Brain
Introduction
Bilingual Word Production: Activation, Competition, and Control
Lexico-semantic Processing in the Bilingual Brain
Towards an Integrative View of Bilingual Communication
Iconicity in Bilingual Language Processing
Conclusions
Note
References
13 How Do Sign Languages Mean?
Introduction
Early Signs: The Role of Homesign in the Development of Signed Communication
Homesign: A Way Into Language Through Iconicity
Sign Languages Are Born – and Made – By Deaf People
How Sign Languages Work: Iconicity, Language, and Gesture
Language And/or Gesture: Neurolinguistic and Neurosemiotic Considerations
Pivoting From Neurolinguistics to Neurosemiotics
How – and When – Do Iconic Features Function in SL?
Is the Core Language System Necessary for Meaning Processing in SL Users?
A Deeper Dive: The Extraction of Meaning Types Through Dual Processing Streams
Orientation: A Sketch of Brain Regions and Functions
Dual Processing Streams for Visual (And Auditory) Signals
Actions (Pantomimes) and Things (Emblems): Functional Differentiation of Gesture Follows Dual Routes
Hand Shapes and Hand Actions: Discrete Sensitivities in Sensory Networks
Conclusion
Acknowledgements
Notes
References
Part III The Neurosemiotics of Social Dynamics
14 Empathy, Meaning, and the Human Brain
Introduction
Empathy
Mentalizing
Empathy and Mentalizing During Complex Social Interactions in the Wild
Summarizing the Relevance of Empathy and Mentalizing in the Construal of Meaning
References
15 Biological Bases of Moral Cognition and Their Role in the Construal of Meaning
Introduction
Moral Cognition and Neurosemiotics
Biological Bases of Moral Cognition
Neural Bases
Neurocognitive Network Models of Moral Cognition
Hormonal Bases
Genetic Factors
Towards an Integrative View of Moral Cognition
Conclusion
References
16 The Neurosemiotics of Social Interaction: Insights From Second-Person Neuroscience
Introduction: From Semiotics to Neurosemiotics
Smile With Me
Social Context Matters
Joint Orienting, Shared Attention, and Reality
Second-Person Neuroscience Meets Neurosemiotics
Second-Person Neuropsychiatry
Conclusion
References
17 Joint Epistemic Engineering: The Neglected Process in Human Communication
Introduction
From Pre-Darwinian Types to Contingently Shared Tokens
What Is in a Signal?
Shannon-Signals
Grice-Signals
Peirce-Signals
Fixed-Code Fallacy
What Counts as Context?
Disambiguation
Strategic Reasoning
Mutual Coordination
What Do Interlocutors Construct?
Joint Epistemic Engineering
Engineering a Bar Conversation
Engineering a Communication System
What Does the Brain Care About?
What Could Possibly Go Wrong?
Conclusion
References
18 Towards a Neurosemiotics of Friendship
Introduction: Why Friendship?
Neuroscience Needs Semiotics
A Semiotics of Friendship
A Neurosemiotics of Friendship
The Neurosemiotics of Opacity in Data-Intensive Brain Research
Concluding Remarks on a Friendly Critique of Common Neurosense
Acknowledgements
Notes
References
19 Neurosemiotics and Ideology: A Linguistic View
Introduction
Why Ideology and Neurosemiotics
Defining Ideology
The Ideological Potential of Language
The Ideological Brain
Size, Extent, Complexity, and Metastability of the Brain
The Brain Is Not Like a Computer
Hierarchy, Stratification, Value, and Re-Entry: The Modeling of Brain Structure and Function
Degeneracy
Concluding Remarks: Integrating Ideology Into Neurosemiotics
Notes
References
20 The Interplay of Culture, Religion, and Biology
Introduction
Meaning in Cultural Psychology
Meaning in Cultural Neuroscience and Genetics
Cultural Neuroscience Research Relies On Cultural Meanings
Benefits of Integrating Neuroscience Into Cultural Psychology
Meaning in Religion
Overlaps and Distinctions Between Religion and Culture
Historical Examples of Meaning in Religion
Psychological Research Demonstrating Meaning in Religion
The Unique Utility of Neuroscience in the Study of Religion
The Need for Meaning in Gene–environment Interaction and Religion Research
Future Research and Challenges in Cultural Neuroscience and Religion
Integrating Culture, Semiotics, and Neuroscience
Conclusion
References
Part IV Further Semiotic Domains
21 What Makes Us Human? Face Identity Recognition
Introduction
The Human Face as a Powerful Sign of Social Communication
Face Identity Recognition: A Human-Specific Expertise
The Challenge and Quality of Human Face Identity Recognition
Development, Genetics, and Experience
A Human-Specific Expertise in FIR
Face Identity Recognition: A Human-Specific Neural Circuitry
A Right-Lateralized Network of Face-Selective Regions
The Lack of a Ventral Face-Selective Network in Macaque Monkeys
The Key Role of Reentrant Semantically Driven Identity Representations
Conclusions: Towards a Neurosemiotics of Human Face Recognition?
Acknowledgements
Notes
References
22 Musical Signs and the Human Organism
Introduction
Neurocognitive Components of Music
Emotional Associations
Emotions Expressed By Music
Emotions Experienced By the Listener
Interim Summary
Other Semantic Associations
Semantic Concepts Evoked By Music
Other Cross-Modal Associations
Self-related Meaning
Interim Summary
Timecourse of Meaning in Music
Interim Summary
Conclusion
References
23 The Meaning of Tools: The Pragmatic Value of Semantic Knowledge
Introduction
From Semantic Knowledge …
The Classical Semantic Knowledge Hypothesis
No Evidence for the Classical Semantic Knowledge Hypothesis
… to Technical Reasoning
Epistemological Consideration
The Technical Reasoning Hypothesis
When Are Semantic Knowledge and Technical Reasoning Involved?
Real Tool Use
Single Tool Use
What Is the Role of Semantic Knowledge?
Semantic Or Pragmatic Knowledge?
Organizing the Search Within Episodic Memory
Conclusion
Acknowledgments
Notes
References
24 Interpreting the Signals Within: Meaning and Prediction During Interoception
Introduction
Afferent Signaling, Integration, and Perceptual Representation
Interoceptive Meaning-Making and Emotion
Social Signaling of Interoceptive States
Maladaptive Interoceptive Representation
Neurosemiotics of Interoception: Theoretical, Methodological, and Epistemological Implications
Conclusion
Notes
References
25 The Hierarchical Semantics of Self
Introduction
Hierarchical Layers of Self
From the Hierarchy of Self to Semantic Similarity and Relatedness
Neural Hierarchy of Self: Different Layers of Self-Processing
Layers and Neural Hierarchy of Self
The Intero-Exteroceptive Self: Self-Related Processing
Predictive Or Cognitive Self: Self-Predictive Processing
Higher-order Reflective Or Mental Self: Self-Referential Processing
Nested Hierarchy of Self: Different Spatial and Temporal Scales Are Integrated
Self Meets Language: Semantic Similarity and Semantic Relatedness
Semantic Relatedness Versus Semantic Similarity
Isomorphism of Structural and Semantic Relations
From Isomorphism to Structuralism: The Self Is Part of Sociocultural Structure
Computational Mechanisms: Vector Semantic Space
Converging Semantics, Brain, and Self Through Their Timescales
Vector Semantic Space: Short- and Long-Time Relations Shape Similarity and Relatedness
Self, Brain, and Environment Are Predispositions of Semantics
From the Hierarchy of Self to the Temporal Continuum of Semantic Similarity and Relatedness
Conclusion
Notes
References
Index