Blindness: Rethinking the representation of sound

Blindness triggers a reorganization of the visual and auditory cortices in the brain.
  1. Łukasz Bola  Is a corresponding author
  1. Institute of Psychology, Polish Academy of Sciences, Poland

Humans are visual creatures, and making sense of what we see is a key task for many regions of the human brain. But what is the function of these regions in the brains of people who are blind? Now, in eLife, Stefania Mattioni, Olivier Collignon and colleagues at the University of Louvain report the results of experiments on blind and sighted participants which show that, in blindness, some regions that typically process visual signals are used to process sounds instead (Mattioni et al., 2022).

In sighted people, high-level visual areas in a region of the brain called the ventral occipitotemporal cortex sort incoming visual signals into different categories, with the distinctions between animate and inanimate, and between human and non-human, being important organizational principles (Konkle and Caramazza, 2013). High-level auditory areas in a nearby region of the brain, the superior temporal cortex, do the same for incoming sounds, and these two high-level areas are also known to communicate with each other (Adam and Noppeney, 2010).

Mattioni et al. used functional magnetic resonance imaging to study brain activity in participants as they listened to different types of sounds. In blind participants, the sounds activated the high-level visual areas more strongly than they did in sighted participants: this result is consistent with previous studies (such as Wang et al., 2015). The researchers also studied the high-level auditory areas and found that the activation of these areas was stronger for sighted participants than for blind participants – the opposite of what was observed for the high-level visual areas.

To explore further Mattioni et al. investigated how the participants responded to different types of sounds. They used four different sound categories: humans, animals, manipulable objects and big objects/places. Moreover, each category had two sub-categories: a human sound, for example, could be a vocalization or a facial-expression sound (such as laughing), and an animal sound could be made by a bird or by a mammal. The analysis involved using a special algorithm called a “classifier” that tried to distinguish between the different sounds based on how they activated the high-level visual and auditory areas.

The researchers found that the activation of the visual area contained more information about the sound category in blind participants than in sighted participants, whereas the activation of the auditory area was more informative in sighted participants than in blind participants. This confirms that blindness results in changes to both the ventral occipitotemporal cortex (which contains the high-level visual areas) and the superior temporal cortex (which contains the high-level auditory areas).

Mattioni et al. also wanted to find out if there were any organizing principles that helped to explain how the brains of blind and sighted participants responded to the different categories of sounds. They found that a model that divides sounds into human and non-human sounds best described the activations observed in both the auditory areas (although the model accuracy in these areas was diminished compared with sighted participants) and the visual areas in blind participants. In sighted participants, by contrast, this “human/non-human” model accurately described activations observed in the auditory areas but not in the visual areas. These results show that the reorganization of visual and auditory cortices in blindness might be complementary: in blind people, the distinction between human and non-human sounds is less precise in the auditory areas, but, at the same time, can be found in some visual areas (see Figure 1).

Blindness triggers a reorganization in the visual and auditory cortices in the brain.

(A) In sighted people, high-level visual areas in the ventral occipitotemporal cortex (VOTC) sort incoming visual signals into categories (blue), and high-level auditory areas in the superior temporal cortex do the same with incoming sounds (orange). The high-level visual and auditory areas also communicate with each other. (B) Mattioni et al. found that, in blind participants, the high-level auditory areas (which are responsible for most of the processing of incoming sounds in sighted people) were less involved in sorting sounds into human and non-human sounds than in sighted participants. At the same time, parts of the VOTC that are primarily associated with visual processing in sighted people had become involved in sorting incoming sounds into these two categories.

Several studies have already hinted that the representation of sound in both the visual cortex and the auditory cortex undergoes a reorganization in blind people (Dormal et al., 2016; Jiang et al., 2016; van den Hurk et al., 2017; Vetter et al., 2020; Battal et al., 2022). Now Mattioni et al. have shown for the first time that these two processes might be linked and driven by a specific aspect of the sound (namely if it is produced by a human or not). Importantly, the researchers obtained very similar results in early-blind participants (who had been blind from an early age and reported having no visual memories) and late-blind participants (who did have visual memories). This shows that significant visual experience in the past does not preclude this type of reorganization, so the processes responsible for this reorganization are likely to rely on neural architecture that typically develops in sighted people.

As mentioned previously, when the high-level visual areas in the ventral occipitotemporal cortex are sorting incoming visual signals, the distinctions between animate/inanimate and human/non-human are important. Previous studies suggest that these high-level visual areas also contain some information about the category of incoming sounds in both blind and sighted people (van den Hurk et al., 2017; Mattioni et al., 2020). Now, Mattioni et al. have shown that some parts of the ventral occipitotemporal cortices are involved in sorting incoming sounds into categories (namely, human and non-human sounds) in blind participants only.

This calls for a detailed investigation of what is stable and what is plastic in the organization of this region. Could it be that some areas in this region – for example, those representing animate entities – are so dominated by visual signals that the auditory information in them only becomes apparent when vision is absent (Bi et al., 2016; Bola et al., 2022)? That would reconcile the hypothesis about the typical neural architecture supporting the reorganization processes studied by Mattioni et al. with the fact that, in sighted participants, no auditory effects were detected in the visual areas studied.

Other interesting questions spring to mind. What are the pathways that support joint reorganization of the visual and auditory cortices in blind people? Can observed neural changes explain better voice recognition abilities in blind people (Bull et al., 1983)? And can similar mechanisms guide reorganization in other visual regions (as suggested by Battal et al., 2022)? Whatever the ultimate answers to these questions might be, the work of Mattioni et al. illustrates an important point: understanding reorganization of the blind brain might require looking beyond the visual cortex.

References

Article and author information

Author details

  1. Łukasz Bola

    Łukasz Bola is in the Institute of Psychology, Polish Academy of Sciences, Warsaw, Poland

    For correspondence
    lbola@psych.pan.pl
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3774-8664

Publication history

  1. Version of Record published:

Copyright

© 2022, Bola

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,313
    views
  • 112
    downloads
  • 1
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Łukasz Bola
(2022)
Blindness: Rethinking the representation of sound
eLife 11:e82747.
https://doi.org/10.7554/eLife.82747

Further reading

    1. Neuroscience
    Yichun Shuai, Megan Sammons ... Yoshinori Aso
    Tools and Resources

    The mushroom body (MB) is the center for associative learning in insects. In Drosophila, intersectional split-GAL4 drivers and electron microscopy (EM) connectomes have laid the foundation for precise interrogation of the MB neural circuits. However, investigation of many cell types upstream and downstream of the MB has been hindered due to lack of specific driver lines. Here we describe a new collection of over 800 split-GAL4 and split-LexA drivers that cover approximately 300 cell types, including sugar sensory neurons, putative nociceptive ascending neurons, olfactory and thermo-/hygro-sensory projection neurons, interneurons connected with the MB-extrinsic neurons, and various other cell types. We characterized activation phenotypes for a subset of these lines and identified a sugar sensory neuron line most suitable for reward substitution. Leveraging the thousands of confocal microscopy images associated with the collection, we analyzed neuronal morphological stereotypy and discovered that one set of mushroom body output neurons, MBON08/MBON09, exhibits striking individuality and asymmetry across animals. In conjunction with the EM connectome maps, the driver lines reported here offer a powerful resource for functional dissection of neural circuits for associative learning in adult Drosophila.

    1. Neuroscience
    Hendrik Heinbockel, Gregor Leicht ... Lars Schwabe
    Research Article

    When retrieved, seemingly stable memories can become sensitive to significant events, such as acute stress. The mechanisms underlying these memory dynamics remain poorly understood. Here, we show that noradrenergic stimulation after memory retrieval impairs subsequent remembering, depending on hippocampal and cortical signals emerging during retrieval. In a three-day study, we measured brain activity using fMRI during initial encoding, 24 hr-delayed memory cueing followed by pharmacological elevations of glucocorticoid or noradrenergic activity, and final recall. While post-retrieval glucocorticoids did not affect subsequent memory, the impairing effect of noradrenergic arousal on final recall depended on hippocampal reactivation and category-level reinstatement in the ventral temporal cortex during memory cueing. These effects did not require a reactivation of the original memory trace and did not interact with offline reinstatement during rest. Our findings demonstrate that, depending on the retrieval-related neural reactivation of memories, noradrenergic arousal after retrieval can alter the future accessibility of consolidated memories.