Tracking subjects' strategies in behavioural choice experiments at trial resolution
- University of Nottingham, United Kingdom
- Atlantic Technological University, Ireland
- University of Oxford, United Kingdom
Abstract
Investigating how, when, and what subjects learn during decision-making tasks requires tracking their choice strategies on a trial-by-trial basis. Here we present a simple but effective probabilistic approach to tracking choice strategies at trial resolution using Bayesian evidence accumulation. We show this approach identifies both successful learning and the exploratory strategies used in decision tasks performed by humans, non-human primates, rats, and synthetic agents. Both when subjects learn and when rules change the exploratory strategies of win-stay and lose-shift, often considered complementary, are consistently used independently. Indeed, we find the use of lose-shift is strong evidence that subjects have latently learnt the salient features of a new rewarded rule. Our approach can be extended to any discrete choice strategy, and its low computational cost is ideally suited for real-time analysis and closed-loop control.
Data availability
Source data from the rat Y-maze task data are available from crcns.org at http://dx.doi.org/10.6080/K0KH0KH5. Source data from the rat lever-press task (32 rats), the human gain/loss task (20 participants) and the primate stimulus-to-action task (one session) are available from the Nottingham Research Data Management Service at http://doi.org/10.17639/nott.7274.Processed data and analysis code to replicate all figures are available in our GitHub repository https://github.com/Humphries-Lab/Bayesian_strategy_analysis_Paper. Our copies of the source data for the Y-maze task, lever-press task, gain/loss task, and stimulus-to-action task are also freely available from the same repository.
Article and author information
Author details
Funding
Medical Research Council (MR/J008648/1)
- Mark D Humphries
Medical Research Council (MR/P005659/1)
- Mark D Humphries
Medical Research Council (MR/S025944/1)
- Mark D Humphries
Medical Research Council (MR/K005480/1)
- Mark Buckley
Biotechnology and Biological Sciences Research Council (BB/T00598X/1)
- Mark Buckley
- Mark D Humphries
Biotechnology and Biological Sciences Research Council (BB/M008770/1)
- Rebecca M Hock
- Paula M Moran
- Tobias Bast
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Ethics
Animal experimentation: Rat - lever-press task: All experimental procedures were conducted in accordance with the requirements of the United Kingdom (UK) Animals (Scientific Procedures) Act 1986, approved by the University of Nottingham's Animal Welfare and Ethical Review Board (AWERB) and run under the authority of Home Office project license 30/3357.Non-human primate task: All animal training and experimental procedures were performed in accordance with the guidelines of the UK Animals (Scientific Procedures) Act of 1986, licensed by the UK Home Office, and approved by Oxford University's Committee on Animal Care and Ethical Review.
Human subjects: The human gain/loss task study was approved by Research Ethics Committee (Stanmore London REC 17/LO/0577). All participants were read a participation information leaflet and undertook informed consent.
Copyright
© 2024, Maggi et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,815
- views
-
- 259
- downloads
-
- 3
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
A two-part list of links to download the article, or parts of the article, in various formats.
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Tracking subjects' strategies in behavioural choice experiments at trial resolution
eLife 13:e86491.
https://doi.org/10.7554/eLife.86491
Further reading
-
- Neuroscience
The entorhinal cortex (EC) plays a pivotal role in memory function and spatial navigation, connecting the hippocampus with the neocortex. The EC integrates a wide range of cortical and subcortical inputs, but its synaptic organization in the human brain is largely unknown. We used volume electron microscopy to perform a 3D analysis of the microanatomical features of synapses in all layers of the medial EC (MEC) from the human brain. Using this technology, 12,974 synapses were fully 3D reconstructed at the ultrastructural level. The MEC presented a distinct set of synaptic features, differentiating this region from other human cortical areas. Furthermore, ultrastructural synaptic characteristics within the MEC was predominantly similar, although layers I and VI exhibited several synaptic characteristics that were distinct from other layers. The present study constitutes an extensive description of the synaptic characteristics of the neuropil of all layers of the EC, a crucial step to better understand the connectivity of this cortical region, in both health and disease.
-
- Neuroscience
Dopamine can play opposing physiological roles depending on the receptor subtype. In the fruit fly Drosophila melanogaster, Dop1R1 and Dop2R encode the D1- and D2-like receptors, respectively, and are reported to oppositely regulate intracellular cAMP levels. Here, we profiled the expression and subcellular localization of endogenous Dop1R1 and Dop2R in specific cell types in the mushroom body circuit. For cell-type-specific visualization of endogenous proteins, we employed reconstitution of split-GFP tagged to the receptor proteins. We detected dopamine receptors at both presynaptic and postsynaptic sites in multiple cell types. Quantitative analysis revealed enrichment of both receptors at the presynaptic sites, with Dop2R showing a greater degree of localization than Dop1R1. The presynaptic localization of Dop1R1 and Dop2R in dopamine neurons suggests dual feedback regulation as autoreceptors. Furthermore, we discovered a starvation-dependent, bidirectional modulation of the presynaptic receptor expression in the protocerebral anterior medial (PAM) and posterior lateral 1 (PPL1) clusters, two distinct subsets of dopamine neurons, suggesting their roles in regulating appetitive behaviors. Our results highlight the significance of the co-expression of the two opposing dopamine receptors in the spatial and conditional regulation of dopamine responses in neurons.
