Mice and primates use distinct strategies for visual segmentation

  1. Francisco J Luongo
  2. Lu Liu
  3. Chun Lum Andy Ho
  4. Janis K Hesse
  5. Joseph B Wekselblatt
  6. Francesco Lanfranchi
  7. Daniel Huber
  8. Doris Y Tsao  Is a corresponding author
  1. California Institute of Technology, United States
  2. University of Geneva, Switzerland
  3. University of California, Berkeley, United States

Abstract

The rodent visual system has attracted great interest in recent years due to its experimental tractability, but the fundamental mechanisms used by the mouse to represent the visual world remain unclear. In the primate, researchers have argued from both behavioral and neural evidence that a key step in visual representation is 'figure-ground segmentation', the delineation of figures as distinct from backgrounds (Nakayama, He, and Shimojo 1995; Lamme 1995; Poort et al. 2012; Qiu and Heydt 2005). To determine if mice also show behavioral and neural signatures of figure-ground segmentation, we trained mice on a figure-ground segmentation task where figures were defined by gratings and naturalistic textures moving counterphase to the background. Unlike primates, mice were severely limited in their ability to segment figure from ground using the opponent motion cue, with segmentation behavior strongly dependent on the specific carrier pattern. Remarkably, when mice were forced to localize naturalistic patterns defined by opponent motion, they adopted a strategy of brute force memorization of texture patterns. In contrast, primates, including humans, macaques, and mouse lemurs, could readily segment figures independent of carrier pattern using the opponent motion cue. Consistent with mouse behavior, neural responses to the same stimuli recorded in mouse visual areas V1, RL, and LM also did not support texture-invariant segmentation of figures using opponent motion. Modeling revealed tha­t the texture dependence of both the mouse's behavior and neural responses could be explained by a feedforward neural network lacking explicit segmentation capabilities. These findings reveal a fundamental limitation in the ability of mice to segment visual objects compared to primates.

Data availability

Source data has been provided to replicate all neural and behavioral figures (2,3,4,5,6,7). These data have been uploaded to dryad: https://doi.org/10.5061/dryad.ngf1vhhvp.Sufficient modeling details have been provided in methods section to replicate relevant parts of figure 8.

The following data sets were generated

Article and author information

Author details

  1. Francisco J Luongo

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  2. Lu Liu

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Chun Lum Andy Ho

    Department of Basic Neurosciences, University of Geneva, Geneva, Switzerland
    Competing interests
    The authors declare that no competing interests exist.
  4. Janis K Hesse

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  5. Joseph B Wekselblatt

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  6. Francesco Lanfranchi

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  7. Daniel Huber

    Department of Basic Neurosciences, University of Geneva, Geneva, Switzerland
    Competing interests
    The authors declare that no competing interests exist.
  8. Doris Y Tsao

    University of California, Berkeley, Berkeley, United States
    For correspondence
    dortsao@berkeley.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1083-1919

Funding

NIH , Howard Hughes Medical Institute

  • Doris Y Tsao

Arnold O. Beckman postdoctoral fellowship, Burroughs Wellcome PDEP Award

  • Francisco J Luongo

Swiss National Science Foundation

  • Daniel Huber

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: The following animals were used in this study: adult mice 2-12 months old, both male and female; adult treeshrews 7-18 months old, both male and female; adult mouse lemurs 2-3.5 yrs, both male and female; and adult macaques 3 and 7 yrs old, male. All procedures on mice, macaques, and tree shrews were conducted in accordance with the ethical guidelines of the National Institutes of Health and were approved by the Institutional Animal Care and Use Committee at the California Institute of Technology.Mouse lemur experiments were in accordance with European animal welfare regulations and were reviewed by the local ethics committee ('Comite d'éthique en expérimentation animale No. 68') in Brunoy, France, by the ethics committee of the University of Geneva, Switzerland and authorized by the French 'Ministère de l'education nationale de l'enseignement supérieur et de la recherche."

Copyright

© 2023, Luongo et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,982
    views
  • 352
    downloads
  • 10
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Francisco J Luongo
  2. Lu Liu
  3. Chun Lum Andy Ho
  4. Janis K Hesse
  5. Joseph B Wekselblatt
  6. Francesco Lanfranchi
  7. Daniel Huber
  8. Doris Y Tsao
(2023)
Mice and primates use distinct strategies for visual segmentation
eLife 12:e74394.
https://doi.org/10.7554/eLife.74394

Share this article

https://doi.org/10.7554/eLife.74394

Further reading

    1. Ecology
    2. Evolutionary Biology
    Rebecca D Tarvin, Jeffrey L Coleman ... Richard W Fitch
    Research Article

    Understanding the origins of novel, complex phenotypes is a major goal in evolutionary biology. Poison frogs of the family Dendrobatidae have evolved the novel ability to acquire alkaloids from their diet for chemical defense at least three times. However, taxon sampling for alkaloids has been biased towards colorful species, without similar attention paid to inconspicuous ones that are often assumed to be undefended. As a result, our understanding of how chemical defense evolved in this group is incomplete. Here, we provide new data showing that, in contrast to previous studies, species from each undefended poison frog clade have measurable yet low amounts of alkaloids. We confirm that undefended dendrobatids regularly consume mites and ants, which are known sources of alkaloids. Thus, our data suggest that diet is insufficient to explain the defended phenotype. Our data support the existence of a phenotypic intermediate between toxin consumption and sequestration — passive accumulation — that differs from sequestration in that it involves no derived forms of transport and storage mechanisms yet results in low levels of toxin accumulation. We discuss the concept of passive accumulation and its potential role in the origin of chemical defenses in poison frogs and other toxin-sequestering organisms. In light of ideas from pharmacokinetics, we incorporate new and old data from poison frogs into an evolutionary model that could help explain the origins of acquired chemical defenses in animals and provide insight into the molecular processes that govern the fate of ingested toxins.

    1. Computational and Systems Biology
    2. Evolutionary Biology
    Pierre Barrat-Charlaix, Richard A Neher
    Research Article

    As pathogens spread in a population of hosts, immunity is built up, and the pool of susceptible individuals are depleted. This generates selective pressure, to which many human RNA viruses, such as influenza virus or SARS-CoV-2, respond with rapid antigenic evolution and frequent emergence of immune evasive variants. However, the host’s immune systems adapt, and older immune responses wane, such that escape variants only enjoy a growth advantage for a limited time. If variant growth dynamics and reshaping of host-immunity operate on comparable time scales, viral adaptation is determined by eco-evolutionary interactions that are not captured by models of rapid evolution in a fixed environment. Here, we use a Susceptible/Infected model to describe the interaction between an evolving viral population in a dynamic but immunologically diverse host population. We show that depending on strain cross-immunity, heterogeneity of the host population, and durability of immune responses, escape variants initially grow exponentially, but lose their growth advantage before reaching high frequencies. Their subsequent dynamics follows an anomalous random walk determined by future escape variants and results in variant trajectories that are unpredictable. This model can explain the apparent contradiction between the clearly adaptive nature of antigenic evolution and the quasi-neutral dynamics of high-frequency variants observed for influenza viruses.