The shared and unique neural correlates of personal semantic, general semantic, and episodic memory
Abstract
One of the most common distinctions in long-term memory is that between semantic (i.e., general world knowledge) and episodic (i.e., recollection of contextually specific events from one’s past). However, emerging cognitive neuroscience data suggest a surprisingly large overlap between the neural correlates of semantic and episodic memory. Moreover, personal semantic memories (i.e., knowledge about the self and one’s life) have been studied little and do not easily fit into the standard semantic-episodic dichotomy. Here, we used fMRI to record brain activity while 48 participants verified statements concerning general facts, autobiographical facts, repeated events, and unique events. In multivariate analysis, all four types of memory involved activity within a common network bilaterally (e.g., frontal pole, paracingulate gyrus, medial frontal cortex, middle/superior temporal gyrus, precuneus, posterior cingulate, angular gyrus) and some areas of the medial temporal lobe. Yet the four memory types differentially engaged this network, increasing in activity from general to autobiographical facts, from autobiographical facts to repeated events, and from repeated to unique events. Our data are compatible with a component process model, in which declarative memory types rely on different weightings of the same elementary processes, such as perceptual imagery, spatial features, and self-reflection.
Editor's evaluation
There has been much theoretical and empirical work focused on the distinctions between episodic and semantic memory. The current work is important because it provides convincing and compelling evidence that this two-part model is not sufficient to explain the range of memory retrieval modes, particularly when considering personal semantic memory. This will be of great interest to memory researchers and will become a benchmark for future studies of autobiographical memory.
https://doi.org/10.7554/eLife.83645.sa0Introduction
One of the most fundamental distinctions in human long-term memory is that between semantic and episodic (Greenberg and Verfaellie, 2010; Squire, 2009; Tulving, 1972; Tulving, 1983; Tulving, 2002). Semantic memory refers to one’s non-personal, general knowledge of the world (e.g., I know that yoga is a relaxing form of exercise), whereas episodic memory concerns the recollection of contextually specific events from one’s personal past (I remember arriving quite late to my yoga class this weekend, which made my teacher angry). This distinction is classic (Herrmann, 1982; Renoult and Rugg, 2020) and remains crucial for cognition and neuroscience today. Importantly, although these two putative memory systems have long been recognized as ‘partially overlapping’ (Tulving, 1972) and interacting (Greenberg and Verfaellie, 2010), they have largely been investigated via separate research traditions.
In recent years, however, emerging cognitive neuroscience data have suggested a surprisingly large overlap between the neural correlates of semantic and episodic memory. For example, when one compares the functional neuroimaging findings from the semantic memory literature (a ‘general semantic network’; Binder, 2016; Binder et al., 2009; Binder and Desai, 2011) to those from the episodic memory literature (an ‘episodic core recollection network’; Rugg and Vilberg, 2013; Svoboda et al., 2006), it becomes evident that the two networks share the midline frontal, middle temporal, parahippocampal, ventral parietal, and midline posterior regions (Renoult et al., 2019). Although based on the previous literature one might expect that the hippocampus would be much more strongly associated with episodic memory, and the anterior temporal lobe with semantic memory (Lambon Ralph et al., 2017), recent research suggests otherwise: The hippocampus can facilitate the acquisition and retrieval of a rich semantic network (Blumenthal et al., 2017; Cutler et al., 2019; Klooster et al., 2020; Sheldon and Moscovitch, 2012), partly through relational processing (Duff et al., 2019) or pattern completion (Solomon and Schapiro, 2020). Anterior hippocampal atrophy features in neurodegenerative diseases affecting semantic and episodic memory alike (Chapleau et al., 2016). Similarly, the lateral anterior temporal lobe may also be involved in episodic recollection, as shown by its recruitment when successfully learning word pairs (de Chastelaine et al., 2016; Renoult et al., 2019).
The considerable overlap between the two has sparked a rethinking of the classic semantic-episodic dichotomy (Renoult et al., 2019). A major impediment, though, has been that a large proportion of the existing data come from indirect comparisons of semantic and episodic memory between different experiments. As mentioned above, this is partly due to semantic and episodic memory being investigated in somewhat separate fields of study: comprehension of the world through language or object identification for example (Binder and Desai, 2011; Kumar, 2021; Lambon Ralph et al., 2017) vs. memory retrieval to think about the past, and particularly, personal events (Maguire, 2001; Svoboda et al., 2006). Memory researchers sometimes control for semantic or basic linguistic processes, but rarely fully match the semantic and episodic aspects or compare them. This may stem from the difficulty in minimizing any differences between semantic and episodic memory on task demands, including retrieval times (Renoult and Rugg, 2020), and other cognitive operations (e.g., control; Vatansever et al., 2021).
Another critical issue is that several types of declarative memory do not fit easily into the standard semantic-episodic dichotomy. This is the case for ‘personal semantics’, which involves knowledge of one’s personal past (Conway, 2005; Grilli and Verfaellie, 2014; Grilli and Verfaellie, 2015; Martinelli et al., 2013; Renoult et al., 2012). Personal semantics lives conceptually between (or, perhaps, across) the boundaries of semantic and episodic memory. It is personal (like episodic memories), but detached from its context of acquisition (like semantic memories). Personal semantics includes personal factual knowledge, such as autobiographical facts (e.g., I am adept at yoga), and knowledge of repeated personally experienced events, including contextual details that have been abstracted across several instances (e.g., my yoga routine when going to the gym). Many early descriptions assumed that personal semantics was part of semantic memory (Cermak and O’Connor, 1983; Kopelman et al., 1989), but more recent evaluations suggest that this view was too simple: whereas some forms of personal semantics—such as autobiographical facts—appear to have neural correlates similar to semantic memory, others—such as memories of repeated events—have neural correlates that are more similar to those of episodic memory. For instance, in amnesic patients, memories of unique and repeated episodes are often impaired together, whereas knowledge of general and personal facts are typically better preserved (reviewed in Renoult et al., 2012).
Personal semantics is an understudied form of memory relative to semantic and episodic memory, even though it has been reported to be the most common form of autobiographical memory elicited in free and cued recall (Barsalou, 1988), and in brain stimulation studies (Curot et al., 2017). Personal semantics play an important role in the retrieval of specific events (Conway, 1987; Conway and Pleydell-Pearce, 2000; Haque and Conway, 2001), and such facilitation can vary with the type of personal semantics (e.g., repeated events induce a greater facilitation than autobiographical facts; Sheldon et al., 2020). The conceptualization of personal semantics is grounded in the close proximity between semantic and episodic memory (as reviewed above; Duff et al., 2019; Renoult et al., 2019). For instance, some general semantic concepts, such as knowledge about unique entities like famous individuals, can be ‘autobiographically significant’ and are tightly associated with episodic memories (Lambert, 2020; Renoult et al., 2015; Westmacott et al., 2004; Westmacott and Moscovitch, 2003).
Despite the apparent importance of personal semantics and the notable interest generated by a taxonomy of personal semantics (Renoult et al., 2012), few functional neuroimaging studies have directly compared personal semantics to either semantic or episodic memory, and even fewer have compared different types of personal semantics to one another or personal semantics to both semantic and episodic memory. On the one hand, these have indicated some differences across general semantic, personal semantic, and episodic memory: Autobiographical facts have been associated with greater activity in the left medial frontal cortex and retrosplenial cortex than general facts (Maguire and Frith, 2003), but have not differed in lateral temporal activity (Maguire and Frith, 2003; Maguire and Mummery, 1999). Repeated events have elicited less activity than unique events in the frontal pole, parahippocampal gyrus, posterior cingulate, and precuneus (Ford et al., 2011; Holland et al., 2011; Levine et al., 2004), but not differed in hippocampal activity (notably, Addis et al., 2004a; Addis et al., 2004b). On the other hand, many existing data are compatible with the idea that these different types of memories involve different levels of activity within a common network. For instance, several neuroimaging studies have reported a graded increase in activity across semantic memories, autobiographical facts, and episodic memories in medial prefrontal, temporal polar, and retrosplenial cortex (Maguire, 2001; Maguire and Frith, 2003; Maguire and Mummery, 1999). In a recent event-related potential study (Renoult et al., 2016) that compared semantic memory (i.e., general facts), two types of personal semantics (i.e., autobiographical facts and repeated events) and episodic memory (i.e., unique events), a similar graded pattern occurred. Both types of personal semantics produced intermediate mean amplitudes for the N400, an index of semantic processing (Kutas and Federmeier, 2011), and for the late positive component, an index of episodic processing (Rugg and Curran, 2007), compared to general facts and unique events (Renoult et al., 2016). The two types of personal semantics did not differ from one another in this study (Renoult et al., 2016).
Given the questions about the relation between memory types across the semantic-episodic spectrum, here we used fMRI to directly compare brain activity during general semantic, episodic, and personal semantic processing within the same participants. They indicated whether closely matched sentences were true in four conditions: (1) facts about people in general (i.e., general facts, reflective of semantic memory), (2) personal events that happened once (i.e., unique events, reflective of episodic memory), (3) facts about themselves (i.e., autobiographical facts, a type of personal semantics), and (4) events that happened repeatedly (i.e., repeated events, a type of personal semantics). The design enabled us to make as close of a comparison as possible between memory conditions. For example, the stimuli differed minimally in wording across conditions, being adjusted only in self-reference (i.e., referring to the self in all conditions but general facts) and temporal specificity (general for both types of facts, somewhat more specific for repeated events, and very specific for unique events). Further, even though semantic and episodic retrieval typically involve different retrieval times, our comparison of these memory types is unbiased by response time differences between conditions (Renoult et al., 2016).
We leveraged multivariate analysis methods (i.e., partial least squares [PLS]; Krishnan et al., 2011; McIntosh et al., 2004a; McIntosh and Lobaugh, 2004b) to compare brain activity across these four memory conditions within a single analysis in a sample of 48 participants. Our analytical approach tested whether data in the spatial and temporal domain explained adequately two hypothesized relations between memory conditions: (1) a continuum of contextual specificity, and (2) a dissociation between knowledge of facts and recollection of events.
Although we expected memory types to be distinguishable, we also expected that the neural correlates of autobiographical facts would appear more similar to general facts whereas the neural correlates of repeated events would appear more similar to unique events (Renoult et al., 2012). Further, the relation between memory types could be best described as one of a continuum: They would engage predominantly a common set of regions from the core memory network, but with increased intensity from the least (i.e., general facts) to the most (i.e., unique events) contextually specific memory type. These relations would depend on the differential engagement of component processes, such as sensory-perceptual imagery, spatial and temporal features, and self-reflection, which should be observed at the cognitive and brain level.
In a behavioral study, we considered three key component processes that could dissociate the four memory types: self-relevance (expecting it to be lower for general facts than all personal forms of memory), visual details (expecting a linear increase), and the integration of details within a scene (expecting it to be low for general/autobiographical facts and high for repeated/unique events). Accordingly, brain regions involved in visuospatial processing and imagery, like the precuneus, and in self-reflection, like the medial prefrontal cortex, should be more tightly associated with memories of unique events, and minimally associated with general factual knowledge (Renoult et al., 2012). Similarly, brain regions known to have a crucial role in spatial processing and in representing scenes, such as the hippocampus, parahippocampal cortex, and retrosplenial cortex, should show greater activity for memories of unique and repeated events than for autobiographical and general facts. The visual details and scene components may depend on hippocampal processes, like relational (Duff et al., 2019) or constructive processes (Hassabis and Maguire, 2007; Schacter and Addis, 2007), to some extent, as the association with a diverse source of personal information becomes stronger from general facts to unique events (Sheldon et al., 2020; Sui and Humphreys, 2015).
In this study, we aimed to go beyond dichotomies commonly used in memory research (e.g., semantic vs. episodic, anterior vs. posterior brain regions, different vs. identical) to examine the multidimensional and complex relations across the spectrum in declarative memory, and importantly do so through direct comparisons. Our operationalization captures the prototypical definitions of several memory types, in close alignment with a taxonomy of personal semantics (Renoult et al., 2012), and possible characteristic function in daily life. Additionally, the analyses aim to uncover patterns that could act like heuristics to characterize declarative memory function. Critically, however, our additional focus on component processes in the behavioral study (i.e., amount of visual details, ability to evoke a scene, self-relevance) relies on the theoretical perspective that relations between memory types can be explained through the information accessed and cognitive processes engaged. Thus, it is implicit to our approach that the relations across memory types are not rigid and could be altered depending on task or personal goal (e.g., Grilli and Verfaellie, 2016). This study seeks to develop a framework suitable to bridge the divide in research about semantic and episodic aspects in declarative memory, and offers a complementary approach to explore the multiplicity of factors that coalesce to define the mnesic experience.
Results
Behavioral study
A sample of 106 participants rated their subjective experience during memory retrieval, using the same paradigm as the fMRI study, but were not scanned. Repeated-measures ANOVA showed that the main effect of memory was significant for all dependent variables (ps < .001). Self-relevance was lowest for general facts compared to all personal forms of memory, and lower for personal semantics (i.e., autobiographical facts and repeated events) than unique events (see Table 1 and Figure 1A). Additionally, the amount of visual detail increased from general facts to autobiographical facts to repeated events to unique events (see Table 1 and Figure 1B).
The conjunction of details within a spatial context, or a scene, is sometimes perceived as integral to the recollection of events (Hassabis and Maguire, 2009). From that perspective, visual details and scene imagery can be dissociable constructs. A smaller proportion of general facts evoked a scene compared to the three personal memory types (see Table 2 and Figure 2C). Similarly, a smaller proportion of autobiographical facts elicited images of a scene compared to repeated events and unique events. Repeated events and unique events did not differ in the proportion of memories perceived as scenes (see Appendix 1 for the statistical tests of vague/nothing and object responses).
fMRI study
Non-rotated PLS with a priori contrast
We used a non-rotated PLS to test two theoretically plausible relations between the four memory conditions: a linear contrast (−3, –1, 1, 3) and one comparing general/autobiographical facts and repeated/unique events (−1, –1, 1, 1; abbreviated to facts vs. events subsequently). A linear contrast would be consistent with the continuum perspective of personal semantics (see Box 3 in Renoult et al., 2012), which would predict an increase in activity from general facts to autobiographical facts, from autobiographical facts to repeated events, and from repeated events to unique events. The increase in visual details (described above) followed precisely this pattern. Similarly, personal relevance increased from general facts to personal semantics (autobiographical facts and repeated events) to unique events, suggesting similar dynamics between component processes (e.g., contextual specificity may increase along with personal relevance). The facts vs. events contrast would favor the view of personal semantics as a subtype of general semantics (see Box 2 in Renoult et al., 2012). Of all personal semantics, autobiographical facts correspond best with this view due to its abstraction from events, its more objective quality than other forms of personal knowledge (e.g., trait knowledge), and the feeling of ‘knowing’ the ‘facts’ rather than recollecting events (i.e., ‘noetic’ consciousness; Tulving, 2002). Repeated events would instead group with unique events as ‘event memory’ due to the common construction of a scene (Rubin and Umanath, 2015). Indeed, participants in the behavioral study perceived scenes as frequently for repeated and unique events. However, it is less clear how one would accommodate the greater number of scenes evoked for autobiographical than general facts in a way that aligns with that perspective. Thus, the conjunction of the visualization of scenes, amount of visual details, and personal relevance agrees most with a continuum of contextual specificity.
The linear contrast and facts vs. events contrast were significant (ps < .001), explaining 48.78% and 51.22% of the cross-block covariance respectively. Brain scores guide the interpretation of PLS results. A participant’s brain score for each task is derived from the multiplication of a voxel’s BOLD signal with how much it contributes to the latent variable (LV; i.e., its salience); the values from all voxels at all lags are then all summed together (see Figures 3a and 4a; Krishnan et al., 2011). Brain scores indicate how well each participant expressed the brain and task relation represented by the LV for each of the memory conditions. The temporal ‘brain scores’ show that the conditions were maximally dissociated at the seventh lag, that is the seventh brain volume after the first acquisition or 8.4 s post cue onset, during the response screen (see Figures 3c and 4c and Appendix 4—figure 1). The maximal dissociation suggests this lag characterizes best the LV (see Appendices 2 and 3 for information on additional lags).
The linear contrast showed that activity increased from general to autobiographical facts, from autobiographical facts to repeated events, and from repeated to unique events bilaterally in the large regions of the frontal cortex (frontal pole, paracingulate gyrus, frontal medial cortex), precuneus, posterior cingulate cortex, retrosplenial cortex, angular gyrus, and with activity of the right middle frontal gyrus, left parahippocampal gyrus, left hippocampus, and left middle and superior temporal gyrus (see Figures 3 and 5, Table 3, and Appendix 2 for additional lags). Activity progressively decreased from general to autobiographical facts, from autobiographical facts to repeated events, and from repeated to unique events in areas of the right frontal inferior gyrus, superior parietal lobule, supramarginal gyrus, and bilateral lateral occipital cortex. In supplementary analyses, the brain scores of each memory condition differed from one another (see Appendix 2).
The facts vs. events contrast was similar to the linear contrast (see Figures 4 and 5, Table 4, and Appendix 3 for additional lags) with the first set of regions (i.e., frontal pole, precuneus, etc.) being associated with greater activity for events than facts, and the second set of regions (i.e., right frontal inferior gyrus, etc.) being associated with reduced activity for events than facts. In supplementary analyses, the statistical comparison of brain scores showed that general and autobiographical facts did not differ in how well they expressed the ‘facts’ portion of the LV, and repeated and unique events did not differ in how well they expressed the ‘events’ portion of the LV (see Appendix 3).
Discussion
Recent progress in cognitive neuroscience has reignited interest in the classic semantic-episodic distinction (Renoult et al., 2019) and in memory types that may fall between or cut across it (Grilli and Verfaellie, 2014; Renoult et al., 2012). In this study, we directly compared four types of memory: one prototypical of semantic memory, one prototypical of episodic memory, and two intermediate (i.e., two types of personal semantics). We closely matched the four memory conditions: We varied the stimuli only in self-relevance (i.e., not self-relevant for general facts and self-relevant for other conditions) and temporal specificity (atemporal/general for both types of facts, more specific for repeated events, and very specific for unique events), in keeping with the distinctions across these four memory types. The general facts condition was thus operationalized as concerning knowledge of people in general (versus the self for the other conditions) and what they generally do (versus what they do at specific times). In that respect, the general facts condition takes the typical operationalization of general semantic memory as reflecting general knowledge of the world. In future investigations, one could consider comparing knowledge of the self to knowledge of specific individuals, which would allow one to evaluate a more specific aspect of semantic memory, but may be associated with other challenges (e.g., either systematically comparing the self to a specific individual, limiting generalizability, or thinking about a different individual in different trials, which would add a task-switching element). All conditions peaked at around the same time in key fMRI analyses.
Personal semantic, general semantic, and episodic memory had both shared and unique neural correlates. The shared neural correlates were revealed when contrasting the four memory conditions with a control condition (see Appendix 4). Activity in several regions of the ‘core memory network’ (Addis et al., 2016; Burianova and Grady, 2007; Rugg and Vilberg, 2013; Svoboda et al., 2006) dissociated the four memory conditions from the control condition, including in the inferior/middle frontal gyrus, caudate, lingual gyrus, parahippocampal gyrus, and hippocampus bilaterally, and the left middle/superior temporal gyrus.
In contrast, the unique neural correlates were evident when examining the four memory conditions on their own. The non-rotated PLS converges with the data-driven PLS (see Appendix 4) to suggest the facts vs. events contrast dominates to explain the spatiotemporal relations across memory conditions, although the difference in covariance explained between the two LVs of the non-rotated PLS was slight. In fact, both a priori contrasts captured aspects of the spatiotemporal relations adequately. The percentage of signal change (see Figure 5) illustrates the complementarity of the two perspectives to encapsulate the relation between memory conditions. That is, activity increased (or decreased) continuously across memory types, but the extent of the increase (or decrease) confers greater similarity between general and autobiographical facts, and between repeated and unique events. Thus, several regions showed a relatively small increase in activity from general facts to autobiographical facts, a relatively large increase from autobiographical facts to repeated events, and a relatively small increase from repeated events to unique events; these include the precuneus, posterior cingulate, angular gyrus and middle frontal gyrus bilaterally, and left parahippocampal gyrus, left hippocampus, and left middle/superior temporal gyrus (see Appendix 2—figure 1 and Appendix 3—figure 1). [We obtained comparable non-rotated PLS results while including only voxels within the default mode and medial temporal networks from Barnett et al., 2021: 49.56% crossblock covariance (p < .001) for the linear contrast, and 50.44% crossblock covariance (p < .001) for the facts vs. events contrast. Within the selected networks, the same regions contributed to dissociate the memory conditions, and temporal brain scores peaked at lag 7. This supplementary analysis reinforces the importance of regions within the core memory network to determine the relation between memory conditions (see Appendix 2—figure 1 and Appendix 3—figure 1), even though we found additional contributors at the whole brain level.] Activity instead decreased in a commensurate manner predominantly in the right hemisphere, particularly the frontal pole, inferior frontal gyrus, and supramarginal cortex. These findings are compatible with a continuum perspective of declarative memory, because quantitative rather than qualitative variations in brain activity suffice to characterize the relation between these memory types (Renoult et al., 2012).
The different types of cues used in our experiment were used to trigger different ‘retrieval modes’ in our participants, ‘a necessary condition for retrieval’ (Tulving, 1983) that is maintained as a tonic state during a retrieval task (Rugg and Wilding, 2000). The behavioral data revealed the sentence cues induced typical phenomenological experience associated with these memory types. Self-relevance was rated lowest for general facts compared to all personal forms of memory, and lower for personal semantics (i.e., autobiographical facts and repeated events) than unique events. Additionally, the amount of visual details increased from general facts to autobiographical facts to repeated events to unique events. This is consistent with previous studies. For example, as compared to unique events, repeated events are generally remembered less vividly: they are associated with reduced temporal specificity, personal significance, emotionality, and amount of details (e.g., Addis et al., 2004b; Holland et al., 2011; Levine et al., 2004). Lastly, the four memory conditions differed in the proportion of scenes that came to mind during retrieval. A smaller proportion of general facts and autobiographical facts were categorized as scenes compared to repeated events and unique events, which did not differ in scene responses. This is consistent with the idea that both memories of unique and repeated events share a spatial organization that gives them their ‘basic context’, as well as a first person perspective, detailed visual imagery (Hassabis and Maguire, 2007; Nadel, 1991; Robin, 2018; Robin et al., 2016; Rubin, 2022; Rubin and Umanath, 2015). Thus, scenes are thought to be a dominant and integral feature of events (Hassabis and Maguire, 2007; Nadel, 1991; Robin, 2018; Robin et al., 2016; Rubin, 2022; Rubin and Umanath, 2015) in a way that has not been argued for ‘facts’. Although context can shape semantic processing (Yee and Thompson-Schill, 2016), the representation of general and experience-far autobiographical facts (Grilli and Verfaellie, 2016) may rely less on entities within a context or the context itself and more or as much on the conceptual representation of individual entities, such as objects and words, than repeated and unique events. Facts, in particular personal facts, may evoke episodes and scenes along with them, as in autobiographically significant concepts (Renoult et al., 2015; Westmacott et al., 2004; Westmacott and Moscovitch, 2003), for example, a person could automatically recall going to a gift store when trying to decide what is their favorite gift. Nevertheless, ‘scenes’ would not be an integral component to general/autobiographical facts in the same way that they would be for repeated/unique events (Rubin, 2022; Rubin et al., 2019; Rubin and Umanath, 2015). In this study, the importance of visuospatial processes (in subjective ratings and corresponding brain regions) was not commensurate with characteristics of the stimuli, which differed little across conditions and primarily increased in temporal specificity (e.g., general facts: ‘Most people wear jeans.’; autobiographical facts: ‘Sometimes I wear jeans.’; repeated events: ‘When at work, I have worn jeans.’; unique events: ‘Yesterday, I wore jeans.’).
The importance of situational or contextual elements featured strongly in the neuroimaging data as in the behavioral data. The core network, also known as the default mode network, has been subdivided into an anterior temporal network linked to ‘entities’ (Ranganath and Ritchey, 2012; Reagh and Ranganath, 2018) or ‘conceptual remembering’ (Sheldon et al., 2019) and a posterior medial network linked to ‘situational models’ (Ranganath and Ritchey, 2012; Reagh and Ranganath, 2018) or ‘perceptual remembering’ (Sheldon et al., 2019). Although these networks process different kinds of information, neither is strictly dedicated to semantic or episodic memory (Reagh and Ranganath, 2018; Sheldon et al., 2019). For instance, knowledge can facilitate the search and construction of events (Irish and Piguet, 2013) and semantic memory can integrate contextual information (e.g., Greenberg et al., 2009; Sheldon and Moscovitch, 2012). Accordingly, in our study the dissociation between general/autobiographical facts and repeated/unique events did not have a clear posterior medial to anterior temporal demarcation (i.e., posterior medial activity for events and anterior temporal activity for facts). Instead, regions primarily within the posterior medial network (i.e., angular gyrus, posterior cingulate gyrus, precuneus, and parahippocampal gyrus; Ritchey et al., 2015) dissociated memory conditions, whereas those within the anterior temporal network (i.e., frontal orbital cortex, inferior anterior temporal gyrus, temporal pole, bilateral amygdala, and perirhinal cortex; Ritchey et al., 2015) did not. Indeed, events contained greater contextual information, as suggested by the increased proportion of scenes they evoked, as compared to factual memories. Further, cues were more temporally specific for repeated/unique events than general/autobiographical facts. Consistent with this, many regions of the posterior medial network were associated with greater activity for repeated/unique events than general/autobiographical facts (similar to Ford et al., 2011; Levine et al., 2004; Maguire and Mummery, 1999), and showed a linear increase from the most general type of memory (i.e., general facts) to the most specific memory (i.e., unique events). Therefore, activity in regions associated with visuospatial processing (e.g., precuneus) and scenes (e.g., medial temporal regions) coheres with behavioral data to support the prominence of contextual specificity in determining the relation across memory types. Activity in medial frontal regions is in harmony with ratings of visual details and scene perception, likewise increasing along a continuum of contextual specificity (see Figure 5d). However, this anterior portion of the medial frontal cortex may correspond best to self-processing rather than ‘situational’ processing or mental time travel (Lieberman et al., 2019). If activity in the medial frontal cortex in our study reflected exclusively self-processing, one would expect a greater proximity between autobiographical facts and repeated events on the basis of subjective ratings of self-relevance. The additional concordance of medial frontal cortex with a continuum of contextual specificity could be a corollary of the strong links between aspects of self-relevance and episodic simulation (Grysman et al., 2013; King et al., 2022; Tulving, 2002; Verfaellie et al., 2019), in addition to this region’s role in modulating recollection (McCormick et al., 2020), for example through engaging schema-related information (Gilboa and Marlatte, 2017).
Taken together, our data correspond with a continuum perspective of declarative memory, with the different memory types varying in magnitude of activation within a common network of brain regions. What underlies this overlap in the neural substrates of semantic and episodic memory? A parsimonious explanation is that semantic and episodic memory rely on similar elementary component processes (Cabeza and Moscovitch, 2013; Larsen, 1992; Moscovitch, 1992; Rajah and McIntosh, 2005; Renoult et al., 2012; Rubin, 2022). All types of memories would depend on a similar network of brain regions but with different weighting of certain nodes in the network. The identification of the relative contribution of different component processes is a critical next step. Some of the characteristics that would influence differences in hippocampal activity and other regions of the core memory network include: the number of details (Thakral et al., 2020), their association (Duff et al., 2019; Solomon and Schapiro, 2020), their integration within a scene (Nadel, 1991; Robin, 2018; Robin et al., 2016; Rubin and Umanath, 2015) or within a situational model (Reagh and Ranganath, 2018; Summerfield et al., 2010), their coarseness and precision (Craik, 2020; Ekstrom and Yonelinas, 2020), their type and modality (e.g., perceptual, spatial, temporal, social; Binder and Desai, 2011; Grilli and Verfaellie, 2016; Sheldon et al., 2019), their stability (Auger and Maguire, 2018), as well as their projection into a temporally distant time (Andrews-Hanna et al., 2010), the open-endedness of the representation (Sheldon and Moscovitch, 2012), the demands on pattern separation to construct unique representations or identify distinguishing features (Rolls and Kesner, 2006; Schapiro et al., 2017), and the likelihood of eliciting a specific event (Renoult et al., 2015; Westmacott et al., 2004; Westmacott and Moscovitch, 2003). For instance, episodic memory would typically rely to a greater degree than semantic memory on rich sensory-perceptual imagery, complex situational models or scenes, spatial and temporal features, and self-reflection. Accordingly, instead of activating different networks of brain regions, semantic and episodic processes may activate a similar network but with different degrees of magnitude, or recruit these brain regions in a complementary manner (Sherman et al., 2023). How each component is involved would also depend on the task at hand (e.g., Gurguryan and Sheldon, 2019); each component could be more or less engaged regardless of the memory type (e.g., semantic details can be thought of in rich detail, in relation to the self, or in relation to a spatial context). Therefore, there would be a ‘neural-psychological representation correspondence’ (Moscovitch and Gilboa, 2022) that includes elements of consciousness (e.g., feeling of being transported in time; Tulving, 2002) and that transcends categories of memory. Our neuroimaging data, and complementary behavioral data obtained outside the scanner, are compatible with this component process view and inconsistent with strictly separated memory systems. The operationalization of different types of personal semantics and their inclusion in a model of declarative memory does not promote fragmentation. Rather, a taxonomy of personal semantics offers an opportunity to explore what brings all forms of memory together and what can sometimes pull them apart.
Materials and methods
fMRI study participants
Request a detailed protocolFifty-three recruited participants (35 women, 18 men) were aged 24.89 years on average (SD = 4.51; range: 19–34) and attained a mean of 16.43 years of education (SD = 2.42). This sample size was the largest that was possible to achieve. The sample size is larger than similar studies (e.g., N ~12–28; Addis et al., 2011; Burianova and Grady, 2007; Ford et al., 2011; Holland et al., 2011). No formal power analysis was conducted. Participants responded to ads on university campuses and on social media. Candidates were retained if they were right-handed, native English speakers, free of any contraindication for MRI (e.g., ferromagnetic metal, back pain, claustrophobia), aged between 18 and 35 years, and had not experienced head injury, or neurological and psychiatric disorders. We excluded three participants because of an inadvertent phase encoding switch, one for an incidental finding, and one for ineligibility. Participants received a compensation of 30 CAD. The study received REB approval at the University of Ottawa (H08-16-32) and the Royal Ottawa Mental Health Centre (ROH; 2016023).
Behavioral study participants
Request a detailed protocolThe total sample included 181 participants (143 women, 34 men, 2 non-binary; 2 missing values); they were 18.79 years old on average (SD = 1.58; range: 17–34; 2 missing values) and had attained a mean of 12.67 years of education (SD = 1.02; 3 missing values). The possible small differences between proximal memory types (e.g., Addis et al., 2004b; Maguire and Mummery, 1999; Renoult et al., 2016) justified the large sample size. We recruited participants from a pool of students who received a credit toward their introductory or research methods course. The ad specified the eligibility criteria, which were the same as the fMRI study apart from those for MRI safety. We excluded participants who disclosed information that conflicted with the criteria (n for primary reason listed): 18–35 years of age (n = 1), right-handed (n = 2), normal or corrected-to-normal vision (n = 1), no neurological or psychiatric disorder (past/present) or no loss of consciousness lasting more than 10 min (n = 26), and native English speakers (n = 35). We also excluded 1 participant for being inattentive during testing (i.e., looking at a cellphone during the task), and 9 for implausible data (i.e., always responding ‘yes’) or incomplete data (e.g., entire task or questionnaire). After exclusions we had a total of 106 participants (87 women, 19 men) with a mean age of 18.74 (SD = 1.05, range 18–23) and 12.67 years of education on average (SD = 0.97). The study received REB approval at the University of Ottawa (H08-16-32).
fMRI task and procedure
Request a detailed protocolAll tasks described below were administered via E-Prime 2.0 (Psychology Software Tools, 2012). We optimized the sentence verification task used in an electrophysiological study (Foster et al., 2012; Renoult et al., 2016) for fMRI. The four experimental conditions (general facts, autobiographical facts, repeated events, unique events) consisted of the same 70 main clauses (material available in Appendix 5). The conditions differed in two aspects: (1) The tense changed from past tense for unique events, to present perfect for repeated events, to present for facts (general and autobiographical). The type of awareness associated with semantic memory is indeed thought to be centered in the present, whereas episodic recollection is oriented toward the past (Tulving, 2001; Tulving, 2002). (2) We added distinct cue words that preceded each condition and gave different degrees of temporal specificity. We used 6–7 cues per condition. In the unique events condition, we used specific time cues (last night, last week-end, this morning, this week, today, yesterday) to promote access to specific instances of events (e.g., ‘Yesterday, I took a picture’). In the repeated events condition, we used script-like cues (when alone, when at a clinic, when at work, when on the bus, when on vacation, when shopping, when with friends), and constrained their temporal scope by asking participants to verify sentences by thinking about events that happened repeatedly within the last year (e.g., ‘When shopping, I have taken a picture’). In the autobiographical facts condition, we used general time cues (everyday, often, rarely, sometimes, usually, very often) for participants to report what is usual for them (‘Very often, I take pictures’). For the general facts condition, the first person personal pronoun (I) and the 6 cues were replaced by six distinct third person perspectives (everyone, few people, many people, most people, no one, some people), and participants had to report what they thought was generally true for people in their country (‘Few people take pictures’). The task involved pressing one of two buttons to produce a ‘yes’ or ‘no’ response to indicate whether the statements were true.
The cue (e.g., last weekend) was presented for ~2 s, followed with the main clause (e.g., I went to the pharmacy) for ~4 s. Participants responded after each statement during a response screen that lasted ~3.5 s and which displayed the response options. The separate response screen minimized the contribution of response-related motor activity during the experimental tasks (see Appendix 5 for the analysis of response time). Participants completed an odd/even task during a jittered interval that lasted from 0 to 12 s (mean of 4.6 s; adapted from Madore et al., 2016). Participants indicated whether a digit was even using the same response options and buttons as the main task (i.e., yes, no). Each digit was shown in letters for 2 s; thus, participants performed the task for up to six digits (see Figure 6). An odd/even task is frequently used in autobiographical memory and future thinking research (Parlar et al., 2018; Svoboda and Levine, 2009; Thakral et al., 2020) to reveal the core memory network (Stark and Squire, 2001). We obtained duration for the intervals from Optseq2, with some adaptations (Dale, 1999).
We blocked the trials of a given memory condition together within each run. We selected a mixed design to minimize switch costs and to repeat the instructions briefly prior to the series of trials. We asked participants to think about what is usually true for people in general in this country (for general facts) or usually true for oneself (for autobiographical facts), and whether events happened repeatedly within the last year (for repeated events) or at a specific time within the last week (for unique events). Each of the seven runs included the four memory conditions, each comprising of 10 trials. A run lasted 10.6 min. We attributed the stimuli to a run to maximize the likelihood of obtaining a ‘yes’ response for each memory condition within each run. The likelihood was determined based on the frequency of yes responses per item in Renoult et al., 2016, and pilot data. The aim of the piloting was to obtain a comparable number of yes and no responses (in other words approximately 35 in each condition; see Appendix 5 for the description and analysis of the proportion of yes responses). The attribution of stimuli to a run was fixed. All participants received the same randomized order of the memory conditions, but a different randomized order of stimuli within each memory block. The stimuli were displayed in Arial in size 30, in white color over a black background. The task was presented visually on a mirror mounted over the head coil, and responses were made by pressing one of two buttons (for yes or no) on an MR safe response box.
All data were acquired within a single session, except for one participant who completed the study in two sessions because of a scanner issue. Participants practiced with a short version of the task outside and inside the scanner. In a post-scan interview, participants described briefly what they were thinking about during a few trials. Scanner time was 90 min. For the other steps, starting with consent and ending with debriefing, the study required an additional 60 min approximately.
Behavioral study task
Request a detailed protocolWe tested participants in groups of 1–4. They completed individually the sentence verification task (described above), but we replaced the control task with subjective ratings, and participants completed only two runs (i.e., 20 stimuli per memory condition). The stimuli were randomized such that each participants received 20 randomly selected stimuli per condition and all stimuli should be represented equally across all participants. After their yes/no response, participants performed a scene rating, details rating, and a self-relevance rating (no time limit). The order of the ratings was counterbalanced across participants. Participants indicated whether what they pictured in their mind was: (1) nothing/vague, (2) objects only, or (3) a whole scene (based on Palombo et al., 2018). Participants rated the amount of visual details that came to mind from 1 (none) to 5 (a lot; based on D’Argembeau and Van der Linden, 2006). We provided examples of visual details and emphasized the distinction between scenes and details. (‘Note that you could remember a lot of bits and pieces about each individual object or people without putting them into an integrated whole’.) We specified that participants should consider both the amount of details of individual objects or people and the overall number of objects and people. Participants also rated how closely their thoughts were related to themselves from 1 (very remote) to 5 (very close). We explained that ‘very close’ meant that the thoughts were directly self-related, ‘very remote’ signified those thoughts concerned strangers or people in general. Intermediate ratings applied to acquaintances. After the practice, the researcher monitored the participants’ attentiveness from a control room. After task completion, participants filled the demographic questionnaire and the Center for Epidemiologic Studies Depression Scale (Radloff, 1977). The study lasted 60 min.
fMRI image acquisition
Request a detailed protocolWe acquired the images on a Siemens Biograph mMR (Siemens Healthineers, Erlangen, Germany; Delso et al., 2011) with a 32-channel head coil (Ceresensa, London, Canada) at the Brain Imaging Centre (BIC) of the ROH. We collected the functional data with a multiband accelerated EPI sequence from CMRR that is sensitive to BOLD (Moeller et al., 2010; Xu et al., 2013; aligned to anterior and posterior commissure, TR = 1200 ms, TE = 33, flip angle = 65 degrees, FOV = 200 mm, voxel size = 2.5 mm3, slice thickness = 2.5 mm, 530 volumes per run, multiband factor = 6, covering the whole brain). The phase encoding alternated between anterior to posterior (for the first, third, fifth, seventh run) and posterior to anterior (for the second, fourth, sixth run).
Due to a technical error, the TE was 40 ms instead of the intended 33 ms for the second, fourth, and sixth run of the first 28 participants. For this reason, we opted for the field map-free method for distortion correction that is implemented in FMRIPREP (Esteban et al., 2018; Esteban et al., 2019) instead of correcting with the reverse phase encoding measurements. Moreover, the encoding phase direction was kept constant for subsequent participants (anterior to posterior) as alternating between phase encoding was originally intended for distortion correction (with reverse phase encoding), which would not be possible for the whole sample. Phase encoding or TE differences cannot explain differences between conditions. The task was divided into seven runs which each included the four memory conditions, and the run order was randomized across all participants.
The parameters for the anatomical scan, a T1-weighted pulse sequence (MPRAGE; Deichmann et al., 2000), of the first 28 participants had the following parameters: sagittal orientation, TR = 2530 ms, TE = 3.36 ms, TI = 1100 ms, flip angle = 7 degrees, slice thickness = 1 mm, FOV = 256 mm, voxel size = 1 mm3, with an acceleration factor of 2 using GRAPPA. For the latter group of 20 participants, we acquired a T1-weighted pulse sequence (MEMPRAGE; van der Kouwe et al., 2008) to enhance the quality of the T1w: sagittal orientation, TR = 2500 ms, TE 1 = 1.69 ms, TE 2 = 3.55 ms, TE 3 = 5.41, TE 4 = 7.27, flip angle = 10 degrees, slice thickness = 1 mm, FOV = 256 mm, voxel size = 1 mm3, with an acceleration factor of 2 using GRAPPA.
fMRI analyses
FMRIPREP pipeline
Request a detailed protocolThe MRI data were preprocessed using FMRIPREP (Esteban et al., 2018; Esteban et al., 2019) . The processing steps are described below verbatim as intended by FMRIPREP authors (https://fmriprep.readthedocs.io/; made available through CCO license).
"Results included in this manuscript come from preprocessing performed using fMRIPprep 1.2.3 (Esteban et al., 2018; Esteban et al., 2019), which is based on Nipype 1.1.6-dev (Gorgolewski et al., 2011; Gorgolewski et al., 2018; RRID:SCR_002502). Anatomical Data Preprocessing. The T1-weighted (T1w) image was corrected for intensity non-uniformity using N4BiasFieldCorrection (Tustison et al., 2010, ANTs 2.2.0), and used as T1w reference throughout the workflow. The T1w reference was then skull-stripped using antsBrainExtraction.sh (ANTs 2.2.0), using OASIS as target template. Brain surfaces were reconstructed using recon-all (FreeSurfer 6.0.1, RRID:SCR_001847, Dale et al., 1999), and the brain mask estimated previously was refined with a custom variation of the method to reconcile ANTs-derived and FreeSurfer-derived segmentations of the cortical gray matter (GM) of Mindboggle (RRID:SCR_002438, Klein et al., 2017). Spatial normalization to the ICBM 152 Nonlinear Asymmetrical template version 2009c (Fonov et al., 2009; RRID:SCR_008796) was performed through nonlinear registration with antsRegistration (ANTs 2.2.0, RRID:SCR_004757, Avants et al., 2008), using brain-extracted versions of both T1w volume and template. Brain tissue segmentation of cerebrospinal fluid (CSF), white matter (WM), and GM was performed on the brain-extracted T1w using fast (FSL 5.0.9, RRID:SCR_002823, Zhang et al., 2001). For each of the seven BOLD runs found per subject (across all tasks and sessions), the following preprocessing was performed. First, a reference volume and its skull-stripped version were generated using a custom methodology of fMRIPrep. A deformation field to correct for susceptibility distortions was estimated based on fMRIPrep’s fieldmap-less approach. The deformation field is that resulting from co-registering the BOLD reference to the same-subject T1w reference with its intensity inverted (Huntenburg, 2014; Wang et al., 2017). Registration is performed with antsRegistration (ANTs 2.2.0), and the process regularized by constraining deformation to be nonzero only along the phase-encoding direction, and modulated with an average fieldmap template (Treiber et al., 2016). Based on the estimated susceptibility distortion, an unwarped BOLD reference was calculated for a more accurate co-registration with the anatomical reference. The BOLD reference was then co-registered to the T1w reference using bbregister (FreeSurfer) which implements boundary-based registration (Greve and Fischl, 2009). Co-registration was configured with nine degrees of freedom to account for distortions remaining in the BOLD reference. Head-motion parameters with respect to the BOLD reference (transformation matrices, and six corresponding rotation and translation parameters) are estimated before any spatiotemporal filtering using mcflirt (FSL 5.0.9, Jenkinson et al., 2002). The BOLD time-series (including slice-timing correction when applied) were resampled onto their original, native space by applying a single, composite transform to correct for head-motion and susceptibility distortions. These resampled BOLD time-series will be referred to as preprocessed BOLD in original space, or just preprocessed BOLD. The BOLD time-series were resampled to MNI152NLin2009cAsym standard space, generating a preprocessed BOLD run in MNI152NLin2009cAsym space. First, a reference volume and its skull-stripped version were generated using a custom methodology of fMRIPrep. Several confounding time-series were calculated based on the preprocessed BOLD: framewise displacement (FD), DVARS, and three region-wise global signals. FD and DVARS are calculated for each functional run, both using their implementations in Nipype (following the definitions by Power et al., 2014). The three global signals are extracted within the CSF, the WM, and the whole-brain masks. Additionally, a set of physiological regressors were extracted to allow for component-based noise correction (CompCor, Behzadi et al., 2007). Principal components are estimated after high-pass filtering the preprocessed BOLD time-series (using a discrete cosine filter with 128 s cut-off) for the two CompCor variants: temporal (tCompCor) and anatomical (aCompCor). Six tCompCor components are then calculated from the top 5% variable voxels within a mask covering the subcortical regions. This subcortical mask is obtained by heavily eroding the brain mask, which ensures it does not include cortical GM regions. For aCompCor, six components are calculated within the intersection of the aforementioned mask and the union of CSF and WM masks calculated in T1w space, after their projection to the native space of each functional run (using the inverse BOLD-to-T1w transformation). The head-motion estimates calculated in the correction step were also placed within the corresponding confounds file. The BOLD time-series were resampled to surfaces on the following spaces: fsnative, fsaverage. All resamplings can be performed with a single interpolation step by composing all the pertinent transformations (i.e., head-motion transform matrices, susceptibility distortion correction when available, and co-registrations to anatomical and template spaces). Gridded (volumetric) resamplings were performed using antsApplyTransforms (ANTs), configured with Lanczos interpolation to minimize the smoothing effects of other kernels (Lanczos, 1964). Non-gridded (surface) resamplings were performed using mri_vol2surf (FreeSurfer). Many internal operations of fMRIPrep use Nilearn 0.4.2 (Abraham et al., 2014; RRID:SCR_001362), mostly within the functional processing workflow. For more details of the pipeline, see the section corresponding to workflows in fMRIPrep’s documentation."
FSL
Request a detailed protocolThe fMRIPrep output (in MNI152NLin2009cAsym space) was spatially smoothed using a Gaussian kernel of FWHM 5 mm and grand-mean intensity normalized using FEAT (FMRI Expert Analysis Tool) Version 6.00 from FSL (FMRIB’s Software Library, https://www.fmrib.ox.ac.uk; Jenkinson et al., 2012). We did not apply slice timing correction with fMRIPrep or FSL because of the rapid multi-band acquisition.
PLS
Request a detailed protocolWe used a multivariate approach, PLS correlation (Krishnan et al., 2011; McIntosh et al., 2004a; McIntosh and Lobaugh, 2004b), implemented in the PLSgui/PLScmd toolbox for Matlab (https://www.rotman-baycrest.on.ca/index.php?section=84; McIntosh et al., 2011). PLS is a technique developed for chemometrics (Krishnan et al., 2011) and widely adopted for neuroimaging use. Strengths of this analysis are that it is well suited for designs with multiple sets of measures and collinearity, and it mitigates power issues encountered in univariate analyses (O’Toole et al., 2007). It performs a singular value decomposition of the relation between two data matrices, X (brain) and Y (task design) to identify how tasks and voxels covary maximally together. PLS produces LVs that represent the similarities and differences in covariance patterns between the two matrices (akin to PCA eigenvectors). Saliences indicate the strength of the contribution of tasks and voxels to an LV (as indexed through bootstrap values, described below).
We specified that each trial began at cue onset and comprised 12 TRs (or 14.4 s) to encompass the typical time-window of a BOLD response (McIntosh et al., 2004a). We retained only yes responses like Renoult et al., 2016, because they presumably reflect access to information consistent with the memory condition. Memory accuracy is often difficult to assess for autobiographical memory (Cabeza and St Jacques, 2007), and so was not considered for any of the conditions. We retained trials that had 3–6 numbers for the control task, thus lasting 6–12 s. We assessed the significance of LVs (p < .05) via 1000 permutations (randomizing the labels of conditions without replacement). We tested the stability of each voxel’s contribution to the LV via 500 iterations of bootstrap estimation (resampling participants with replacement; Krishnan et al., 2011; McIntosh et al., 2004a; McIntosh and Lobaugh, 2004b). The threshold of ± 3 bootstrap ratio (equivalent to p < .001; as in Hirshhorn et al., 2012; Ziaei et al., 2016) was used to determine whether a voxel made a reliable contribution to the LV. A reliable voxel contributes to the overall task and brain pattern. The PLS tests the association between the task and all voxels at all TRs in a single analysis, and so does not require correction for multiple comparison (McIntosh and Lobaugh, 2004b). An additional threshold of a minimum of 80 voxels with a minimum distance of 10 voxels was used to facilitate the summary of findings in the results section and the tables (for a similar cluster size, see Bowen et al., 2019; Hirshhorn et al., 2012; Robin et al., 2015; Ziaei et al., 2016). The bootstrap percentile estimates are unreliable. Thus, we reported the standard error of the bootstrap estimation instead of the confidence intervals along with t-tests (see Appendices 2 and 3); the interpretation is similar.
Statistical analyses of brain scores and behavioral data
Request a detailed protocolWe compared the four memory conditions (general facts, autobiographical facts, repeated events, unique events) on brain scores, the proportion of ‘yes’ responses and response time during the fMRI task, and on mean self-relevance, mean visual details and proportion of trials associated with one of the three scene categories during the behavioral task. We followed up on significant main effects with paired samples t-tests, reporting Hedges’ g as the measure of effect size, and correcting each set of post hoc tests (i.e., six tests) with the Holm-Bonferroni procedure (Holm, 1979). We attributed the value equivalent to z ± 2.58 to bring univariate outliers closer to the mean. Scene ratings were excessively skewed (see Figure 2), but parametric tests gave similar results than nonparametric and are reported for simplicity. We applied a Greenhouse-Geisser correction (Greenhouse and Geisser, 1959) when the sphericity assumption was violated. All these analyses focused on trials associated with ‘yes’ responses (as in fMRI analyses) and were executed in SPSS v. 28 (Corp, 2021).
Open science statement
Request a detailed protocolThe instructions and stimuli are available in Appendix 5. End-stage data and some scripts are available on https://osf.io/ (https://osf.io/py5k6/). Additional information may be requested to the corresponding authors. fMRI standards guided the reporting in this paper (Poldrack et al., 2008).
Appendix 1
Behavioural study
Scene rating: nothing/vague
The four memory conditions differed in their proportion of memory that elicited nothing or a vague image, F(2.79, 293.34) = 6.82, p < .001, ηp2 = 0.06 (see Figure 2). A greater proportion of general facts (M = 0.16, SE = 0.02) evoked nothing or something vague compared to repeated events (M = 0.10, SE = 0.01), t(105) = 3.86, p < .001, g = 0.37, CI 95% [0.18, 0.57], and unique events (M = 0.10, SE = 0.01), t(105) = 3.14, p = .002, g = 0.30, CI 95% [0.11, 0.50]. Similarly, a greater proportion of autobiographical facts (M = 0.14, SE = 0.02) were associated with nothing or a vague image compared to repeated events, t(105) = 2.94, p = .004, g = 0.29, CI 95% [0.09, 0.48]. No other comparisons were significant after correction: general facts vs. autobiographical facts, t(105) = 1.47, p = .144, g = 0.14, CI 95% [–0.05, 0.33]; autobiographical facts vs. unique events, t(105) = 2.20, p = .030, g = 0.21, CI 95% [0.02, 0.40], and repeated events vs. unique events, t(105) = –0.24, p = .814, g = –0.02, CI 95% [–0.21, 0.17].
Scene rating: object
The four memory conditions differed in the proportion of memory perceived as an object during retrieval, F(3, 315) = 17.11, p < .001, ηp2 = 0.14 (see Figure 2). A greater proportion of general facts (M = 0.44, SE = 0.02) and autobiographical facts (M = 0.42, SE = 0.02) were perceived as objects compared to repeated events (M = 0.34, SE = 0.02) and unique events (M = 0.30, SE = 0.02): general facts vs. repeated events, t(105) = 4.17, p < .001, g = 0.40, CI 95% [0.21, 0.60]; general facts vs. unique events, t(105) = 5.94, p < .001, g = 0.57, CI 95% [0.37, 0.78]; autobiographical facts vs. repeated events, t(105) = 3.36, p = .001, g = 0.33, CI 95% [0.13, 0.52]; autobiographical facts vs. unique events, t(105) = 5.53, p < .001, g = 0.54, CI 95% [0.33, 0.74]. General facts did not differ from autobiographical facts, t(105) = 1.22, p = .226, g = 0.12, CI 95% [–0.07, 0.31], and repeated events did not differ from unique events, t(105) = 1.82, p = .071, g = 0.18, CI 95% [–0.02, 0.37]. Therefore, facts were more frequently associated with the visualization of isolated objects than events.
Appendix 2
Non-rotated PLS with a priori contrasts: linear contrast
Statistical comparison of brain scores
All memory conditions differed from one another: general facts vs. autobiographical facts, t(47) = –6.97, p < .001, g = −1.00, CI 95% [–1.34, –0.65]; general facts vs. repeated events, t(47) = –16.99, p < .001, g = –2.43, CI 95% [–2.99, –1.86]; general events vs. unique events, t(47) = –18.19, p < .001, g = –2.61, CI 95% [–3.20, –2.01]; autobiographical facts vs. repeated events, t(47) = –12.35, p < .001, g = –1.77, CI 95% [–2.22, –1.31]; autobiographical facts vs. unique events, t(47) = –16.02, p < .001, g = –2.29, CI 95% [–2.83, –1.75]; repeated events vs. unique events, t(47) = –6.53, p < .001, g = –0.94, CI 95% [–1.27, –0.59]. Thus, unique events were more robustly associated with activity as described in the main text than repeated events, and repeated events compared to autobiographical facts, and autobiographical facts compared to general facts.
Appendix 3
Non-rotated PLS with a priori contrasts: facts vs. events
Statistical comparison of brain scores
The brain scores of general and autobiographical facts did not differ from one another, t(47) = –0.72, p = .477, g = –0.10, CI 95% [–0.38, 0.18], and those of repeated and unique events did not differ from one another, t(47) = –0.65, p = .517, g = –0.09, CI 95% [–0.37, 0.19]. Hence, general and autobiographical facts did not differ in how well they expressed the ‘facts’ portion of the LV, and repeated and unique events did not differ in how well they expressed the ‘events’ portion of the LV. All other comparisons were significant: general facts and repeated events, t(47) = –15.53, p < .001, g = –2.22, CI 95% [–2.75, –1.69]; general facts and unique events, t(47) = –14.76, p < .001, g = –2.11, CI 95% [–2.62, –1.60]; autobiographical facts and repeated events, t(47) = –15.25, p < .001, g = –2.18, CI 95% [–2.70, –1.66]; autobiographical facts and unique events, t(47) = –14.97, p < .001, g = –2.14, CI 95% [–2.66, –1.63].
Appendix 4
Mean-centered PLS with memory and control condition
PLS results
PLS produces LVs; in this case, LVs were variables that explained a maximum of the covariance between the four memory conditions (general facts, autobiographical facts, repeated events, unique event) and the spatiotemporal aspects of brain activity (Abdi and Williams, 2013; Krishnan et al., 2011; McIntosh et al., 2004a; McIntosh and Lobaugh, 2004b). The first significant LV from the PLS analysis distinguished the four memory conditions from a control condition (i.e., odd/even judgments), explaining 84.94% of the cross-block covariance (p < .001, see Appendix 4—figure 1). The inclusion of a control condition—involving little memory processes like odd/even judgments—along with memory conditions in a PLS tends to pull out the memory network because the dissociation between the control and memory conditions explains a maximum of the covariance in the data (Addis et al., 2004a; Burianova and Grady, 2007; Sheldon and Levine, 2013; Spreng and Grady, 2010).
At lag 7, increased activity in regions from the ‘core memory network’ dissociated the memory conditions from the control condition, including large regions of the prefrontal cortex and parietal cortex bilaterally, the medial temporal lobe, and the left lateral temporal cortex. The voxels that contributed the most to this brain LV, named ‘saliences’, can be found in Appendix 4—table 1 and Appendix 4—table 2 (Abdi and Williams, 2013).
A second significant LV (p = .028) accounted for 6.41% of the covariance. As this LV is similar to the non-rotated PLS described in the main text (i.e., general/autobiographical facts vs. repeated/unique events), we do not discuss it further. No other LVs were significant, p > .05.
Appendix 5
Stimuli list
Response time
We entered response time in a repeated-measures ANOVA with memory (general facts, autobiographical facts, repeated events, unique events) and response (yes, no) as factors. Participants were faster to respond yes (M = 730.97, SE = 24.58) than to respond no (M = 757.38, SE = 27.25), F(1, 47) = 6.21, p = .016, ηp2 = 0.12. We followed up on a main effect of memory, F(3, 141) = 3.38, p = .020, ηp2 = 0.07, with paired samples t-tests corrected with a Holm-Bonferroni procedure. We computed the mean of yes and no responses for each condition prior to that step. Unique events (M = 724.35, SE = 25.85) had a faster response time than repeated events (M = 750.55, SE = 26.21), t(47) = 2.93, p = .005, g = 0.42, CI 95% [0.13, 0.71], and general facts (M = 753.92, SE = 25.43), t(47) = 2.75, p = .009, g = 0.39, CI 95% [0.10, 0.68], but not autobiographical facts (M = 747.89, SE = 27.21), t(47) = 2.15, p = .037, g = 0.31, CI 95% [0.02, 0.59]. None of the other comparisons were significant: general facts vs. autobiographical facts: t(47) = 0.62, p = .541, g = 0.09, CI 95% [–0.19, 0.37]; general facts vs. repeated events: t(47) = 0.31, p = .758, g = 0.04, CI 95% [–0.24, 0.33]; and autobiographical facts vs. repeated events: t(47) = –0.25, p = .804, g = –0.04, CI 95% [–0.32, 0.25]. The interaction between memory and response was not significant, F(3, 141) = 0.97, p = .411, ηp2 = 0.02. Nevertheless, as we included only yes responses in the fMRI analyses, we repeated the ANOVA with yes responses and keeping only the memory factor. The main effect of memory was not significant, F(2.56, 120.09) = 1.23, p = .302, ηp2 = 0.03, suggesting that all memory conditions produced similar response times when considering yes responses only. Even though seemingly similar to Renoult et al., 2016, for yes responses, participants waited until a response screen to produce their response and their speed does not reflect a true reaction time.
Proportion of yes responses
We entered the proportion of yes responses in a repeated-measures ANOVA with memory as a factor (general facts, autobiographical facts, repeated events, unique events). The main effect of memory was significant, F(2.01, 94.45) = 41.50, p < .001, ηp2 = 0.47 (see Appendix 5—figure 1 ). We followed up with paired sample t-tests that were corrected using a Holm-Bonferroni procedure. All t-tests were significant. As expected and as in Renoult et al., 2016, unique events (M = 0.42, SE = 0.01) had a smaller proportion of yes responses than general facts (M = 0.55, SE = 0.01), t(47) = 10.03, p < .001, g = 1.44, CI 95% [1.03, 1.84], autobiographical facts (M = 0.59, SE = 0.01), t(47) = 14.09, p < .001, g = 2.02, CI 95% [1.52, 2.51], and repeated events (M = 0.50, SE = 0.02) t(47) = 5.29, p < .001, g = 0.76, CI 95% [0.44, 1.07]. Further, repeated events had a smaller proportion of yes responses than general facts, t(47) = 2.22, p = .031, g = 0.32, CI 95% [0.03, 0.61], and autobiographical facts, t(47) = 4.24, p < .001, g = 0.61, CI 95% [0.30, 0.91]. The proportion of yes responses was larger for autobiographical facts than general facts, t(47) = –3.24, p = .002, g = –0.46, CI 95% [–0.76, –0.17]. In raw numbers, this translates into an M of 37.06 trials (SE = 0.77, range from 22 to 51) for general facts, M of 39.81 trials (SE = 0.76, range from 24 to 56) for autobiographical facts, M of 33.77 trials (SE = 1.34, range from 14 to 57) for repeated events, and M of 28.02 trials (SE = 0.70, range from 18 to 38) for unique events.
Data availability
End-stage data (i.e., PLS BSR nifti files) and some scripts (e.g., for event files) are available on OSF (https://osf.io/py5k6/). The authors did not receive approval from the ethics committee to deposit data in a public repository. Additional information may be requested to the corresponding authors. Deidentified data may be shared (i.e., converted dicom files to nifti without identifiers, defaced T1w, other data with minimal demographic/health information to avoid identification). Researchers will be asked to sign a confidentiality agreement and to describe briefly the purpose to ensure it fits with the general purpose of the study described in the consent form. No formal application will be required. Data may not be analyzed for commercial purposes.
-
Open Science FrameworkID py5k6. Personal Semantic, General Semantic, and Episodic Memory: Shared and Unique Neural Correlates.
References
-
BookPartial least squares methods: Partial least squares correlation and partial least square regressionIn: Reisfeld B, Mayeno AN, editors. Computational Toxicology. Humana Press. pp. 549–579.https://doi.org/10.1007/978-1-62703-059-5_23
-
Machine learning for neuroimaging with scikit-learnFrontiers in Neuroinformatics 8:14.https://doi.org/10.3389/fninf.2014.00014
-
Retrosplenial cortex indexes stability beyond the spatial domainThe Journal of Neuroscience 38:1472–1481.https://doi.org/10.1523/JNEUROSCI.2602-17.2017
-
BookThe content and organization of autobiographical memoryIn: Neisser U, Winograd E, editors. Remembering Reconsidered. Cambridge University Press. pp. 193–243.https://doi.org/10.1017/CBO9780511664014
-
The neurobiology of semantic memoryTrends in Cognitive Sciences 15:527–536.https://doi.org/10.1016/j.tics.2011.10.001
-
In defense of abstract conceptual representationsPsychonomic Bulletin & Review 23:1096–1108.https://doi.org/10.3758/s13423-015-0909-1
-
Age differences in the neural response to negative feedbackAging, Neuropsychology, and Cognition 26:463–485.https://doi.org/10.1080/13825585.2018.1475003
-
Common and unique neural activations in autobiographical, episodic, and semantic retrievalJournal of Cognitive Neuroscience 19:1520–1534.https://doi.org/10.1162/jocn.2007.19.9.1520
-
Functional neuroimaging of autobiographical memoryTrends in Cognitive Sciences 11:219–227.https://doi.org/10.1016/j.tics.2007.02.005
-
Memory systems, processing modes, and components: Functional neuroimaging evidencePerspectives on Psychological Science 8:49–55.https://doi.org/10.1177/1745691612469033
-
Atrophy in Alzheimer’s Disease and Semantic Dementia: an ALE meta-analysis of Voxel-Based Morphometry StudiesJournal of Alzheimer’s Disease 54:941–955.https://doi.org/10.3233/JAD-160382
-
The construction of autobiographical memories in the self-memory systemPsychological Review 107:261–288.https://doi.org/10.1037/0033-295x.107.2.261
-
Memory and the self☆Journal of Memory and Language 53:594–628.https://doi.org/10.1016/j.jml.2005.08.005
-
SoftwareIBM SPSS statistics for Macintosh, version 28.0IBM Corp.
-
Remembering: An activity of mind and brainAnnual Review of Psychology 71:1–24.https://doi.org/10.1146/annurev-psych-010419-051027
-
Memory scrutinized through electrical brain stimulation: A review of 80 years of experiential phenomenaNeuroscience & Biobehavioral Reviews 78:161–177.https://doi.org/10.1016/j.neubiorev.2017.04.018
-
Searching for semantic knowledge: A vector space semantic analysis of the feature generation taskFrontiers in Human Neuroscience 13:341.https://doi.org/10.3389/fnhum.2019.00341
-
Performance measurements of the Siemens mMR integrated whole-body PET/MR scannerJournal of Nuclear Medicine 52:1914–1922.https://doi.org/10.2967/jnumed.111.092726
-
Neurobiology of schemas and schema-mediated memoryTrends in Cognitive Sciences 21:618–631.https://doi.org/10.1016/j.tics.2017.04.013
-
Nipype: A flexible, lightweight and extensible neuroimaging data processing framework in pythonFrontiers in Neuroinformatics 5:13.https://doi.org/10.3389/fninf.2011.00013
-
Impaired category fluency in medial temporal lobe amnesia: the role of episodic memoryThe Journal of Neuroscience 29:10900–10908.https://doi.org/10.1523/JNEUROSCI.1202-09.2009
-
Interdependence of episodic and semantic memory: evidence from neuropsychologyJournal of the International Neuropsychological Society 16:748–753.https://doi.org/10.1017/S1355617710000676
-
On methods in the analysis of profile dataPsychometrika 24:95–112.https://doi.org/10.1007/BF02289823
-
Supporting the self-concept with memory: insight from amnesiaSocial Cognitive and Affective Neuroscience 10:1684–1692.https://doi.org/10.1093/scan/nsv056
-
The time travelling self: comparing self and other in narratives of past and future eventsConsciousness and Cognition 22:742–755.https://doi.org/10.1016/j.concog.2013.04.010
-
Sampling the process of autobiographical memory constructionEuropean Journal of Cognitive Psychology 13:529–547.https://doi.org/10.1080/09541440125757
-
Deconstructing episodic memory with constructionTrends in Cognitive Sciences 11:299–306.https://doi.org/10.1016/j.tics.2007.05.001
-
The construction system of the brainPhilosophical Transactions of the Royal Society B 364:1263–1271.https://doi.org/10.1098/rstb.2008.0296
-
The semantic-episodic distinction and the history of long-term memory typologiesBulletin of the Psychonomic Society 20:207–210.https://doi.org/10.3758/BF03334817
-
A simple sequentially rejective multiple test procedureScandinavian Journal of Statistics 6:65–70.
-
The pivotal role of semantic memory in remembering the past and imagining the futureFrontiers in Behavioral Neuroscience 7:27.https://doi.org/10.3389/fnbeh.2013.00027
-
Mindboggling morphometry of human brainsPLOS Computational Biology 13:e1005350.https://doi.org/10.1371/journal.pcbi.1005350
-
The hippocampus and semantic memory over timeBrain and Language 201:104711.https://doi.org/10.1016/j.bandl.2019.104711
-
The autobiographical memory interview: A new assessment of autobiographical and personal semantic memory in amnesic patientsJournal of Clinical and Experimental Neuropsychology 11:724–744.https://doi.org/10.1080/01688638908400928
-
Semantic memory: A review of methods, models, and current challengesPsychonomic Bulletin & Review 28:40–80.https://doi.org/10.3758/s13423-020-01792-x
-
The neural and computational bases of semantic cognitionNature Reviews Neuroscience 18:42–55.https://doi.org/10.1038/nrn.2016.150
-
Evaluation of noisy dataJournal of the Society for Industrial and Applied Mathematics Series B Numerical Analysis 1:76–85.https://doi.org/10.1137/0701007
-
BookPersonal context in autobiographical and narrative memoriesIn: Conway MA, Rubin DC, Spinnler H, Wagenaar WA, editors. Theoretical Perspectives on Autobiographical Memory. Springer Netherlands. pp. 53–71.https://doi.org/10.1007/978-94-015-7967-4_4
-
The functional neuroanatomy of episodic and semantic autobiographical remembering: A prospective functional MRI studyJournal of Cognitive Neuroscience 16:1633–1646.https://doi.org/10.1162/0898929042568587
-
Social, self, (situational), and affective processes in medial prefrontal cortex (MPFC): Causal, multivariate, and reverse inference evidenceNeuroscience & Biobehavioral Reviews 99:311–328.https://doi.org/10.1016/j.neubiorev.2018.12.021
-
Neuroimaging studies of autobiographical event memoryPhilosophical Transactions of the Royal Society of London B: Biological Sciences 356:1413.https://doi.org/10.1098/rstb.2001.0944
-
Informatics and data mining tools and strategies for the human connectome projectFrontiers in Neuroinformatics 5:4.https://doi.org/10.3389/fninf.2011.00004
-
Neural substrates of the self-memory system: New insights from a meta-analysisHuman Brain Mapping 34:1515–1529.https://doi.org/10.1002/hbm.22008
-
Memory and working-with-memory: A component process model based on modules and central systemsJournal of Cognitive Neuroscience 4:257–267.https://doi.org/10.1162/jocn.1992.4.3.257
-
Guidelines for reporting an fMRI studyNeuroImage 40:409–414.https://doi.org/10.1016/j.neuroimage.2007.11.048
-
The CES-D scale: A self-report depression scale for research in the general populationApplied Psychological Measurement 1:100306.https://doi.org/10.1177/014662167700100306
-
Overlap in the functional neural systems involved in semantic and episodic memory retrievalJournal of Cognitive Neuroscience 17:470–482.https://doi.org/10.1162/0898929053279478
-
Two cortical systems for memory-guided behaviourNature Reviews. Neuroscience 13:713–726.https://doi.org/10.1038/nrn3338
-
Personal semantics: at the crossroads of semantic and episodic memoryTrends in Cognitive Sciences 16:550–558.https://doi.org/10.1016/j.tics.2012.09.003
-
From knowing to remembering: The semantic–episodic distinctionTrends in Cognitive Sciences 23:1041–1057.https://doi.org/10.1016/j.tics.2019.09.008
-
In Progress in Brain Research45–64, Cortico-hippocampal systems involved in memory and cognition, In Progress in Brain Research, Elsevier, 10.1016/bs.pbr.2015.04.001.
-
The spatial scaffold: The effects of spatial context on memory for eventsJournal of Experimental Psychology. Learning, Memory, and Cognition 42:308–315.https://doi.org/10.1037/xlm0000167
-
Spatial scaffold effects in event memory and imaginationWiley Interdisciplinary Reviews. Cognitive Science 9:e1462.https://doi.org/10.1002/wcs.1462
-
A computational theory of hippocampal function, and empirical tests of the theoryProgress in Neurobiology 79:1–48.https://doi.org/10.1016/j.pneurobio.2006.04.005
-
A conceptual space for episodic and semantic memoryMemory & Cognition 50:464–477.https://doi.org/10.3758/s13421-021-01148-3
-
Retrieval processing and episodic memoryTrends in Cognitive Sciences 4:108–115.https://doi.org/10.1016/S1364-6613(00)01445-5
-
Event-related potentials and recognition memoryTrends in Cognitive Sciences 11:251–257.https://doi.org/10.1016/j.tics.2007.04.004
-
Brain networks underlying episodic memory retrievalCurrent Opinion in Neurobiology 23:255–260.https://doi.org/10.1016/j.conb.2012.11.005
-
The cognitive neuroscience of constructive memory: remembering the past and imagining the futurePhilosophical Transactions of the Royal Society of London. Series B, Biological Sciences 362:773–786.https://doi.org/10.1098/rstb.2007.2087
-
Complementary learning systems within the hippocampus: A neural network modelling approach to reconciling episodic memory with statistical learningPhilosophical Transactions of the Royal Society of London. Series B, Biological Sciences 372:20160049.https://doi.org/10.1098/rstb.2016.0049
-
A neurocognitive perspective on the forms and functions of autobiographical memory retrievalFrontiers in Systems Neuroscience 13:4.https://doi.org/10.3389/fnsys.2019.00004
-
Altering access to autobiographical episodes with prior semantic knowledgeConsciousness and Cognition 86:103039.https://doi.org/10.1016/j.concog.2020.103039
-
Multiple memory subsystems: Reconsidering memory in the mind and brainPerspectives on Psychological Science 17456916231179146.https://doi.org/10.1177/17456916231179146
-
Semantic search as pattern completion across a conceptTrends in Cognitive Sciences 24:95–98.https://doi.org/10.1016/j.tics.2019.12.003
-
Memory and brain systems: 1969-2009The Journal of Neuroscience 29:12711–12716.https://doi.org/10.1523/JNEUROSCI.3575-09.2009
-
The integrative self: How self-reference integrates perception and memoryTrends in Cognitive Sciences 19:719–728.https://doi.org/10.1016/j.tics.2015.08.015
-
BookEpisodic and semantic memoryIn: Tulving E, Donaldson W, editors. Organization of memory. Academic Press. pp. 382–402.
-
Episodic memory and common sense: How far apart? Philosophical Transactions of the Royal Society of LondonSeries B, Biological Sciences 356:1505–1515.https://doi.org/10.1098/rstb.2001.0937
-
Episodic memory: from mind to brainAnnual Review of Psychology 53:1–25.https://doi.org/10.1146/annurev.psych.53.100901.135114
-
N4ITK: improved N3 Bias CorrectionIEEE Transactions on Medical Imaging 29:1310–1320.https://doi.org/10.1109/TMI.2010.2046908
-
Self-related processing and future thinking: Distinct contributions of ventromedial prefrontal cortex and the medial temporal lobesCortex; a Journal Devoted to the Study of the Nervous System and Behavior 115:159–171.https://doi.org/10.1016/j.cortex.2019.01.028
-
The contribution of autobiographical significance to semantic memoryMemory & Cognition 31:761–774.https://doi.org/10.3758/BF03196114
-
Putting concepts into contextPsychonomic Bulletin & Review 23:1015–1027.https://doi.org/10.3758/s13423-015-0948-7
-
Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithmIEEE Transactions on Medical Imaging 20:45–57.https://doi.org/10.1109/42.906424
Article and author information
Author details
Funding
British Academy (SG142524)
- Louis Renoult
Natural Sciences and Engineering Research Council of Canada (RGPIN-2019-04596)
- Daniela J Palombo
Natural Sciences and Engineering Research Council of Canada
- Patrick SR Davidson
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We gratefully acknowledge the participants who generously took part in the study; Sara Trincao-Batra and Talia Chin for help with recruitment, testing or preparing the data for analysis; Melina Langevin and Andrew Wilson for collecting the data for the behavioral analysis; Kirandeep K Dogra for the validation of sample descriptives and analyses in SI; Emily Wang with help preparing tables, Emma Haight for feedback on the manuscript; Drs. Donna Rose Addis, Samuel Fynes-Clinton, Andra Smith for advice, and particularly Dr. Randy McIntosh for advice on many aspects of the PLS analyses. Preparation of this manuscript was supported by grants from Natural Sciences and Engineering Research Council of Canada (NSERC; to PSRD), from the British Academy (grant number SG142524 to LR), funds from the Faculty of Social Sciences of the University of Ottawa (to PSRD), an Ontario Graduate Scholarship (to AFNT). DJP is supported by an NSERC Discovery Grant (RGPIN-2019-04596).
Ethics
Human subjects: The study received REB approval at the University of Ottawa (H08-16-32), and the Royal Ottawa Mental Health Centre (ROH; 2016023).
Copyright
© 2023, Tanguay et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,757
- views
-
- 316
- downloads
-
- 5
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Movie-watching is a central aspect of our lives and an important paradigm for understanding the brain mechanisms behind cognition as it occurs in daily life. Contemporary views of ongoing thought argue that the ability to make sense of events in the ‘here and now’ depend on the neural processing of incoming sensory information by auditory and visual cortex, which are kept in check by systems in association cortex. However, we currently lack an understanding of how patterns of ongoing thoughts map onto the different brain systems when we watch a film, partly because methods of sampling experience disrupt the dynamics of brain activity and the experience of movie-watching. Our study established a novel method for mapping thought patterns onto the brain activity that occurs at different moments of a film, which does not disrupt the time course of brain activity or the movie-watching experience. We found moments when experience sampling highlighted engagement with multi-sensory features of the film or highlighted thoughts with episodic features, regions of sensory cortex were more active and subsequent memory for events in the movie was better—on the other hand, periods of intrusive distraction emerged when activity in regions of association cortex within the frontoparietal system was reduced. These results highlight the critical role sensory systems play in the multi-modal experience of movie-watching and provide evidence for the role of association cortex in reducing distraction when we watch films.
-
- Neuroscience
Dendrites are crucial for receiving information into neurons. Sensory experience affects the structure of these tree-like neurites, which, it is assumed, modifies neuronal function, yet the evidence is scarce, and the mechanisms are unknown. To study whether sensory experience affects dendritic morphology, we use the Caenorhabditis elegans' arborized nociceptor PVD neurons, under natural mechanical stimulation induced by physical contacts between individuals. We found that mechanosensory signals induced by conspecifics and by glass beads affect the dendritic structure of the PVD. Moreover, developmentally isolated animals show a decrease in their ability to respond to harsh touch. The structural and behavioral plasticity following sensory deprivation are functionally independent of each other and are mediated by an array of evolutionarily conserved mechanosensory amiloride-sensitive epithelial sodium channels (degenerins). Calcium imaging of the PVD neurons in a micromechanical device revealed that controlled mechanical stimulation of the body wall produces similar calcium dynamics in both isolated and crowded animals. Our genetic results, supported by optogenetic, behavioral, and pharmacological evidence, suggest an activity-dependent homeostatic mechanism for dendritic structural plasticity, that in parallel controls escape response to noxious mechanosensory stimuli.