Multisensory Perception: From Laboratory to Clinic

MULTISENSORY PERCEPTION: From Laboratory to Clinic
Copyright
Contributors
Preface
	References
1. Bouba-Kiki: cross-domain resonance and the origins of synesthesia, metaphor, and words in the human mind
	Introduction
	Synesthesia
		Physiology of synesthesia
		Creativity
		Paradoxes of synesthesia
	Bouba-Kiki
		Bouba-Kiki and word origins
		Bouba‐Kiki and memory consolidation
		Bouba-Kiki and conceptual metaphors
		Intersensory metaphors
		Directionality of metaphors
		Inferior parietal lobule and Bouba-Kiki
		Other sequelae of IPL damage
		Predictions about dyslexia
		Metaphor blindness
		Taxonomy of intersensory effects
		Esthetic Blending
	Sex and violence
	The mirror neuron system
		Sensory mirror neuron system
		Out-of-body experience
		Gestures, imitation, synkinesia, and the MNS
		Autism
	Number lines
		Calendar lines
		Neural basis of mental calendars
	Conclusion
	References
	Further reading
2. Philosophical insights
	Starting point: the problem of individuating the senses
	A taxonomy of sensory interactions
	Multisensory blends
	Binding and unisensory perception
	Are all experiences multimodal?
	References
3. Neural development of multisensory integration
	Overview
		The products of multisensory integration
		Multisensory integration in individual SC neurons
		The native state of multisensory integration is competitive
	Developing multisensory integration and the principles that govern it
		How experience leads to the development of SC multisensory integration capabilities
	Incorporating multisensory experience into the circuit
		Multisensory experience and influences from cortex: two interrelated developmental events
	Multisensory plasticity in adulthood
	Clinical implications
	Using the principles of multisensory integration to ameliorate hemianopia
		Postrehabilitation visual capabilities
	Acknowledgments
	References
4. The development of multisensory processes for perceiving the environment and the self
	Infant perception of the audiovisual attributes specifying inanimate and animate objects
		Development of audiovisual processing in infancy
		Effects of early experience on audiovisual processing
		Early experience and audiovisual processing: multisensory perceptual narrowing
		Development of selective attention to multisensory inputs
	Multisensory processes for perceiving the body, self, and the environment at hand in infancy and childhood
		Visual–haptic object perception in infancy
		Multisensory body perception in infancy and childhood
	Summary
	References
5. Computational models of multisensory integration
	Introduction
		Combining information from a single sensory channel with prior knowledge
		Forced fusion: integrating sensory signals that come from a common source
		Causal inference: accounting for observer's uncertainty about the world's causal structure
	Conclusions
	Acknowledgments
	References
6. Multisensory contributions to object recognition and memory across the life span
	Introduction
		Multisensory contributions to object recognition
		Multisensory learning as the norm rather than an exception
		From multisensory learning to unisensory object memory
			When is multisensory memory better than memory based on unisensory experiences?
			What do multisensory benefits for memory depend on and how/why do they vary across individuals?
			What are the cognitive and brain mechanisms governing multisensory benefits in memory?
				Brain correlates of implicit multisensory benefits in memory
				Multisensory representations of objects in the brain
		Broader implications: multisensory processes scaffold cognition across the life span
			Theoretical implications of the interplay between multisensory processes and memory functions
			Outlook: the importance of multisensory processes in public health
		Conclusion
	Acknowledgments
	References
7. Visuo-haptic object perception
	Introduction
	Haptic and visuo-haptic object recognition
		Behavioral studies
		The neural basis of visuo-haptic object processing
			Segregated ventral “what” and dorsal “where” pathways
			Multisensory processing of object shape
	Object categorization
		Behavioral studies
		Neural correlates of visuo-haptic object categorization
	View-dependence
		Behavioral studies
		View-(in)dependent cortical regions
	Individual differences in visuo-haptic representations
		Neural differences between object and spatial imagers
	A model of visuo-haptic multisensory object representation
	Conclusion
	Acknowledgments
	References
8. Multisensory processes in body ownership
	Introduction
	Perceptual rules of body ownership
		Temporal rule
		Spatial rule(s)
		Tactile congruence rule
		Humanoid shape rule
	Multisensory congruency matters, not the particular modality
	Multisensory integration of body signals in the cortex: nonhuman primates
	Multisensory integration of body signals in the cortex: human neuroimaging
	Neuroimaging studies of limb ownership
	Full-body ownership
	Self-identification, mirrors, and the third-person visual perspective
	Summary
	Acknowledgments
	References
9. Visual–vestibular interactions
	Visual–vestibular interaction in directional heading
		The visual signal as a source of heading perception
		The vestibular signal as a source of heading perception
		Visual–vestibular interaction in heading perception and its neural correlates
	Visual–vestibular interaction in tilt perception
		The visual signal for tilt perception
		The vestibular signal for tilt perception
		Visual–vestibular interaction and its neural correlates
		How is multisensory convergence affected in neurological conditions?
			Impaired tilt perception in vestibular and proprioceptive loss
			Impaired spatial orientation in stroke
	Future perspective—translating the concepts of visuo–vestibular integration in clinical neuroscience
	Summary
	References
	Further reading
10. Multisensory flavor perception: A cognitive neuroscience perspective
	Introduction
	Food and the brain
	Multisensory flavor perception: gustatory and olfactory inputs
	Oral–somatosensory contributions to multisensory flavor perception
	Visual contributions to multisensory flavor perception
	Auditory contributions to multisensory flavor perception
	Conclusions
	References
11. Audiovisual crossmodal correspondences: behavioral consequences and neural underpinnings
	Introduction
	Kinds of audiovisual crossmodal correspondence and their effects on behavior
	Assessing the impact of crossmodal correspondences on other aspects of cognition
	Do crossmodal correspondences occur early or late in human information processing?
	Elevation as a fundamental organizational dimension for many crossmodal correspondences
	On the relative versus absolute nature of crossmodal correspondences
		Sound symbolism and crossmodal correspondences
		Crossmodal correspondences and synesthesia
		Conclusions
	References
12. How do crossmodal correspondences and multisensory processes relate to synesthesia?
	Introduction
		Crossmodal correspondences
		Phenomenological similarities between synesthesia and crossmodal correspondences: grapheme-color, sound-color, and number-f ...
		Phenomenological similarities between synesthesia and crossmodal correspondences: sequence-space synesthesias and synesthet ...
		Phenomenological similarities between synesthesia and crossmodal correspondences: less well-studied varieties of synesthesia
		How do these models account for other cognitive and perceptual differences present in synesthetes?
		Relationships between crossmodal correspondences and synesthesia still requiring clarification
		Conclusions
	References
13. Synesthesia: the current state of the field
	Definition and diagnosis
	The neural basis of synesthesia
	Neurodevelopmental accounts of synesthesia
		Evidence of functional and structural brain differences in adults
			What is the nature of the connectivity (e.g., functional vs. structural)?
			Where in the adult brain are the inducer and concurrent connected together?
			Are there atypical features of the synesthete's brain more widely?
	Where do synesthetic associations come from?
	The cognitive profile of synesthesia
		Perception
		Imagery
		Memory
		Art, personality, and creativity
		Cognitive weaknesses
		Future directions
	References
14. How synesthesia may lead to enhanced memory
	Introduction
	Synesthesia and long-term memory
	Beyond long-term memory
	Testing earlier stages of memory in synesthesia
	Load manipulations
	The dual coding model
	The recoding model of memory
	Conclusions
	References
15. Task-selectivity in the sensory deprived brain and sensory substitution approaches for clinical practice: evidence from bli ...
	Introduction
	Sensory substitution devices
	Crossmodal plasticity in cases of sensory deprivation
		Task-selective sensory-independent organization in the deprived higher-order “visual” cortices
		Does task-selective and sensory-independent organization extend to higher-order auditory regions as well?
		Does TSSI organization extend to deprived primary sensory cortices as well?
	Task-switching versus TSSI organization in higher-order “visual” cortices
	Beyond the notion of strictly sensory-specific critical periods
	Specific multisensory training as a tool to maximize sensory restoration outcomes
	SSD training as a tool to maximize visual recovery after partial visual loss
	General conclusions
	References
16. Crossmodal neuroplasticity in deafness: evidence from animal models and clinical populations
	Introduction
	Crossmodal neuroplasticity in animal models of deafness
		Changes in auditory cortex as a consequence of deafness: structure and neural function
		Crossmodal reorganization in auditory cortex following deafness: behavior and psychophysics
		What is the anatomical basis for crossmodal reorganization following deafness?
	Crossmodal neuroplasticity in clinical populations with deafness and hearing loss
		Congenital auditory deprivation and neuroplasticity
		Compensatory crossmodal plasticity in pediatric deafness
		Clinical implications of compensatory crossmodal plasticity in pediatric hearing loss
			Using crossmodal reorganization to direct individualized intervention and habilitation for children with hearing loss
			Crossmodal reorganization as an indicator of efficacy of cochlear implantation
		Age-related hearing loss and neuroplasticity
			Compensatory crossmodal plasticity in adult-onset deafness
			Compensatory crossmodal plasticity in early-stage, mild-moderate, age-related hearing loss
		Clinical implications of crossmodal plasticity in age-related hearing loss
			Using crossmodal reorganization to direct individualized rehabilitation for age-related hearing loss
	Conclusions
	Acknowledgments
	References
	Further reading
17. Neurodevelopmental and neuropsychiatric disorders affecting multisensory processes
	Introduction
	Autism spectrum disorder
		Audiovisual integration in autism spectrum disorder
		Differences in integration of simple audiovisual stimuli
		Differences in integration of audiovisual speech signals
		Disrupted audiovisual temporal processing
		Developmental considerations
		Summary of audiovisual integration in autism spectrum disorder
		Integration of extrapersonal and peripersonal sensory input in ASD
		Visual–somatic integration in autism spectrum disorder
		Bottom-up influences on visual–somatic integration
		Top-down influences on visual-somatic integration
		Stimulus considerations
		Summary of extrapersonal-peripersonal multisensory processing in ASD
		Multisensory integration in animal models of autism spectrum disorder
	Schizophrenia
		Low-level multisensory integration
		Complex stimulus multisensory integration
		Multisensory integration relevant for self-perception
		Multisensory integration in animal models of schizophrenia
	Basic and clinical neuroscience links for multisensory integration
	Conclusions
	References
18. Disorders of body representation
	Introduction
	Neurological disorders of body representation
		Unilateral disorder of body representation
			Personal neglect
			Feeling of amputation, hemi-depersonalization
			Somatoparaphrenia
			Phantom limbs and supernumerary phantom limbs
			Macro- and microsomatognosia
		Global body representation disorder
			Autoscopic hallucinations
			Heautoscopy
			Out-of-body experience
			Feeling of presence
	Body representation disturbance in chronic pain
		Complex regional pain syndrome
		Phantom limb pain
		Spinal cord injury
	Body representation disturbance in psychiatric disorders
		Anorexia
		Schizophrenia
		Gender dysphoria
	References
19. Hemianopia, spatial neglect, and their multisensory rehabilitation
	Introduction
	Multisensory rehabilitation for central visual field defects
		Visual field defects: clinical features and anatomy
		Multisensory perception in hemianopia
		Multisensory rehabilitation of VFDs
			Overview of standard rehabilitation approaches
			Multisensory compensatory training
	Unilateral spatial neglect
		Clinical presentation
		Unisensory and multisensory perception in USN
			VISUAL deficits
			Auditory deficits
			Tactile deficits
			Perceptual sensory awareness
		The neural bases of the neglect syndrome
		Multisensory perception and its potential for neglect rehabilitation
	Perspectives for multisensory rehabilitation research
	References
20. Mirror therapy
	Introduction
	Neural mechanisms of mirror visual feedback
	Effects of mirror therapy on pain syndromes
	Effects of mirror therapy on hemiparesis after stroke
	Effects of mirror therapy on other symptoms after stroke
	Effects of mirror therapy on pain after stroke
	Effects of mirror therapy on other conditions
		How should mirror therapy be performed?
	Conclusion
	References
Index
	A
	B
	C
	D
	E
	F
	G
	H
	I
	J
	L
	M
	N
	O
	P
	R
	S
	T
	U
	V
	W