A single exposure to altered auditory feedback causes observable sensorimotor adaptation in speech
Abstract
Sensory errors induce two types of behavioral changes: rapid compensation within a movement and longer-term adaptation of subsequent movements. Although adaptation is hypothesized to occur whenever a sensory error is perceived (including after a single exposure to altered feedback), adaptation of articulatory movements in speech has only been observed after repeated exposure to auditory perturbations, questioning both current theories of speech sensorimotor adaptation and the universality of more general theories of adaptation. We measured single-exposure or ‘one-shot’ learning in a large dataset in which participants were exposed to intermittent, unpredictable perturbations of their speech acoustics. On unperturbed trials immediately following these perturbed trials, participants adjusted their speech to oppose the preceding shift, demonstrating that learning occurs even after a single exposure to auditory error. These results provide critical support for current theories of sensorimotor adaptation in speech and align speech more closely with learning in other motor domains.
Editor's evaluation
The paper establishes the presence of a single-trial adaptation response to the perturbation of the first formant of a vowel in speech production, an effect that should be of interest to the sensorimotor community in general. The analysis is conducted on existing data from 6 published studies and the effects are shown in a convincing fashion. The paper also explores the relationship between the within-trial compensation and the next-trial adaptation.
https://doi.org/10.7554/eLife.73694.sa0Introduction
Auditory feedback plays a major role in both online execution and refinement of speech motor plans, as observed when the auditory feedback participants receive about their own speech is perturbed in real time (Houde and Jordan, 1998; Purcell and Munhall, 2006b; Tourville et al., 2008; Villacorta et al., 2007). Two types of behavior have been the primary focus of auditory perturbation studies in speech, which most typically alter a speaker’s vowel formants (the resonant frequencies of the vocal tract that distinguish vowels). First, when unpredictable perturbations are delivered, speakers produce a compensation response—an online, within-trial adjustment to oppose the perturbation (Purcell and Munhall, 2006b; Tourville et al., 2008). Second, consistent perturbations lead to sensorimotor adaptation—a learned change in speech behavior that is observable from the onset of a subsequent speech movement and which persists even after the perturbation is removed (Houde and Jordan, 1998; Purcell and Munhall, 2006a).
These behaviors are widely considered to be driven by sensory prediction errors (differences between expected and perceived sensory feedback), although models differ in the proposed mechanism by which this occurs. In the DIVA (Directions Into Velocities of Articulators) model (Tourville and Guenther, 2011), sensory prediction errors lead to feedback-based corrective motor commands (i.e., the within-trial compensation response) which are subsequently incorporated into the feedforward motor program used for future productions of the same syllables, creating the adaptation response (Kawato et al., 1987). An alternative theoretical account of adaptation (Houde and Nagarajan, 2011) suggests sensory prediction errors instead directly lead to updates of internal models in the sensorimotor control system, either to forward models predicting the sensory outcomes of actions (Bastian, 2006; Haith and Krakauer, 2013; Houde and Nagarajan, 2011; Krakauer and Mazzoni, 2011; Shadmehr et al., 2010), to the control policy guiding action (Hadjiosif et al., 2020), or to both (Wolpert et al., 1998; Wolpert and Kawato, 1998).
Both the compensation-based and internal-model hypotheses of sensorimotor adaptation predict that learning in speech occurs progressively, with sensory feedback from each utterance causing updates to feedforward commands, such that changes in speech production should be evident even after a single trial with altered auditory feedback. Such one-shot adaptation has been observed in limb control, where a visuomotor perturbation on an isolated trial affects reach direction on the following trial (Diedrichsen et al., 2005; Joiner et al., 2017; Ruttle, 2021). However, the occurrence of such one-shot adaptation has not been definitively established in speech. Although Cai et al., 2012, observed that first formant (F1) production in the first 50 ms of perturbed trials which closely followed another perturbed trial tended to oppose the preceding perturbation’s direction, more recent work explicitly testing for such single-trial effects did not find evidence of a measurable change (Daliri et al., 2020). This failure to find one-shot adaptation in speech questions both current theories of speech sensorimotor adaptation as well as the universality of domain-general theories (e.g., Houde and Nagarajan, 2011; Kawato et al., 1987; Hadjiosif et al., 2020).
Here, we aim to further investigate the mechanisms underlying sensorimotor adaptation by measuring one-shot adaptation in speech. To detect this potentially small effect, data from six prior studies (Niziolek et al., 2014; Niziolek and Guenther, 2013; Niziolek and Parrell, 2021; Parrell et al., 2017) were compiled for this analysis (131 total participants, 18–40 participants per study). In all studies, participants read aloud monosyllabic words while receiving real-time auditory playback of their speech. On a given trial, this feedback was either veridical (unperturbed trials) or unpredictably perturbed via an upward or downward shift in F1 (perturbed trials) (Figure 1A). Perturbed trials were used to calculate compensation responses, and unperturbed trials which occurred directly after a perturbed trial (post-perturbation trials) were used to calculate one-shot adaptation responses (see Figure 1B). We hypothesized that F1 values would be higher for trials that occurred directly after a downward perturbation and lower in trials that occurred directly after an upward perturbation, such that they echo the preceding compensation response.
This approach also allows us to test the feedback-command-based hypothesis of adaptation in speech, which suggests that there should be a correlation between the magnitude of compensation and subsequent one-shot adaptation at the trial level. While this correlation has been observed in reaching (Albert and Shadmehr, 2016), most studies have failed to identify such a clear relationship in speech (Daliri, 2021; Franken et al., 2019; Lester-Smith et al., 2020; Parrell et al., 2017; Raharjo et al., 2021), possibly because they did not use such a direct trial-to-trial measurement method. The presence of such a relationship at the trial level would be compatible with both the feedback-command-based and internal-model hypothesis of adaptation; alternatively, the absence of such a relationship would only support the internal-model hypothesis.
Results
Compensation
In the 150–250 ms time window after vowel onset, trials in which an upward F1 shift occurred (up-shifted trials) had reliably lower F1 values (–3.99±0.33 mels (SE)) than trials in which a downward F1 shift occurred (2.69±0.33 mels) (down-shifted trials) (β=–6.93, SE=0.66, p<0.001, d=0.21; Figure 2A, left panel). This was also reflected at the individual level; participants’ average F1 in the same time window was substantially lower across up-shifted trials (–2.75±1.56 mels) than down-shifted trials (4.40±1.25 mels) (paired t-test, t(130) = –7.00, p<0.001, d=0.91; Figure 2B, left panel). Normalized F1 was significantly different from 0 in both up-shifted trials (t(130) = –3.63, p<0.001, d=0.49) and down-shifted trials (t(130) = 7.24, p<0.0001, d=0.89). Additionally, a cluster-based permutation test showed significant differences from 0 starting at 100–125 ms after vowel onset for all trial types (Figure 2A, horizontal bars).
One-shot adaptation
Participants produced one-shot adaptation responses which paralleled the directional pattern seen in the compensation response, though at a lower magnitude. In the 0–100 ms time window after vowel onset, trials that occurred immediately after an upward F1 shift (post-up trials) had F1 values (–1.55±0.26 mels) that were reliably lower than trials that occurred immediately after a downward F1 shift (post-down trials, 0.59±0.27 mels) (β=–2.14, SE=0.53, p<0.001, d=0.079; Figure 2A, right panel). Likewise, participants’ average F1 was lower across post-up trials (–2.08±1.33 mels) than across post-down trials (0.82±1.39 mels) (paired t-test, t(130) = –2.98, p=0.0034, d=0.38; Figure 2B, right panel). Normalized F1 in post-up trials was significantly less than 0 in this time window (t(130) = –3.2, p=0.0016, d=0.38). While normalized F1 in post-down trials was numerically larger than 0, this difference was not significant in the 0–100 ms window (t(130) = 1.2, p=0.23, d=0.15); however, a cluster-based permutation test showed significant differences from 0 across the syllable for all trial types (Figure 2A, horizontal bars).
Relationship between behavioral responses
At the participant level, there was a significant positive relationship between compensation and one-shot adaptation (β=0.14, SE=0.058, p=0.015, η2=0.02), such that participants who produced larger compensation responses tended to adapt more (Figure 3A). Conversely, the trial-level model revealed no main effect of compensation response (β=–0.033, SE=–0.053, p=0.53) (Figure 3B). However, we did observe a small but significant interaction between shift magnitude and compensation response (β=0.16, SE=0.052, p=0.0023, η2=0.0009), such that higher shift magnitudes elicited a stronger effect of compensation on adaptation. Along with the finding that larger shift magnitudes led to larger one-shot adaptation responses (β=7.46, SE=3.34, p=0.03, η2=0.04), this suggests that trial-wise compensation may be predictive of adaptation only at larger shift magnitudes. Stronger evidence for a trial-level effect could be seen by correlating compensation and adaptation within each participant, which yielded a distribution of coefficients whose mean was significantly larger than 0 (mean r=0.21, 78/92 participants r>0, t=11.07, p<0.0001, d=1.6). There was no relationship between the strength of a participant’s correlation between adaptation and compensation and their overall adaptation magnitude (r=–0.005, t=–0.04, p=0.964); in other words, it was not the case that this correlation was only observed in participants who adapted.
Discussion
At both the trial and participant level, one-shot adaptation was detected in post-perturbation trials, where F1 values reliably opposed the perturbation in the previous trial. This shows that learning occurs continuously when the sensorimotor system detects a discrepancy between expected and perceived auditory feedback, as predicted by current models of sensorimotor adaptation in speech. While the magnitude of this one-shot adaptation may be small (1–2 mels), it is relatively substantial when accounting for the fact that a typical perturbation of ~100–150 mels causes an average F1 change of only 40–50 mels over the course of 100 or more trials (Katseff et al., 2012; MacDonald et al., 2010; Munhall et al., 2009; Purcell and Munhall, 2006a). Moreover, our estimate of one-shot adaptation is likely conservative for at least three reasons. First, all but one of the studies in our dataset presented multiple stimulus words in pseudorandom order; in ~53% of the trial pairs, participants pronounced different words on the perturbed and subsequent unperturbed trial. Although sensorimotor learning can generalize across words with the same vowel (Rochet-Capellan et al., 2012), such generalization is only partial, and a larger adaptation effect likely would have emerged with uniform word pairs. Second, our planned analysis evaluated adaptation during the first 100 ms of each vowel. Adaptation magnitude was greater (1.85±0.50 mels) during the 50–150 ms window, which excludes the consonant transition. Lastly, studies analyzed here used random, inconsistent perturbations across trials. Inconsistent perturbations are commonly used in studies of reaching adaptation in order to study learning that occurs after a single exposure (e.g., Diedrichsen et al., 2005; Joiner et al., 2017; Ruttle, 2021); however, such inconsistencies may decrease the rate of adaptation compared to consistent perturbations (Albert et al., 2021). One-shot adaptation in speech may therefore have an even greater magnitude in the typical case where perturbations are consistent across trials.
Though an individual’s average compensation magnitude was reliably predictive of their average one-shot adaptation, a trial-level relationship was present but less reliable: it was mediated by shift magnitude and, when examined at the individual level, present in some but not all participants. It is unclear whether these two behavioral responses have a direct feedforward relationship (as predicted by the DIVA model), or if the observed correlations could best be explained by compensation and one-shot adaptation occurring via separate mechanisms driven by the same sensory error (as may be predicted by internal-model hypotheses). However, the less reliable within-participant relationship may be more consistent with models of adaptation that rely on updates to internal models compared to models that use feedback corrections to update future feedforward commands. Similarly mixed results on the causal relationship between feedback commands and feedforward learning have been reported in the reaching literature (Albert and Shadmehr, 2016; Kim et al., 2021; Tseng et al., 2007).
Overall, these results provide evidence that a single exposure to altered auditory feedback induces ‘one-shot’ adaptation in the speech sensorimotor system. This is consistent with current models of adaptation in speech specifically and in human movement more broadly; within these frameworks, one-shot adaptation is an effect that may continually build upon itself to create more enduring adaptation responses. Further comparison of single-trial vs. longer-timescale sensorimotor learning in the same individuals is warranted to strengthen this claim. The expected relationship between compensation and adaptation was observed reliably at the participant level and somewhat less reliably at the trial level. Our results provide evidence that adaptation in speech may operate in a similar manner as in other motor domains. As a well-learned natural behavior that relies primarily on implicit learning, speech offers a unique, ecologically valid paradigm to further our understanding of the underlying mechanisms driving sensorimotor adaptation.
Materials and methods
Participants
We reanalyzed data from six previous studies examining online compensation responses to formant frequency alterations with similar speech stimuli and perturbation schedules. Data were included if participants met inclusion criteria for their respective studies and if the formant shifts they received were opposite or near-opposite each other in 2D formant space (separated by an angle of 180±20° when plotted together in F1/F2 space). Data from 91 participants met these criteria; 40 of these participants contributed to two of the included studies. All participants were native speakers of American English and reported no history of speech, hearing, or neurological disorders. Informed consent and consent to publish was obtained for all participants. The experimental protocols were approved by the Institutional Review Board of the institutions from which data were collected: the University of Wisconsin–Madison, the Massachusetts Institute of Technology, the University of California, San Francisco, and the University of California, Berkeley. The University of Wisconsin–Madison Minimal Risk Research IRB approved our procedures to analyze the previously collected data (MRR IRB 2017-1509).
Auditory perturbation
Request a detailed protocolDetails of the six studies are provided in Table 1. In all studies, participants spoke aloud monosyllabic English words containing the vowel /ɛ/ (as in head), which were presented as text on a screen. Simultaneously, participants heard real-time auditory feedback of their speech through headphones. On a pseudorandom subset of trials (25–50%), auditory feedback was altered with one of two real-time feedback perturbation systems, Audapter (Cai et al., 2008; Tourville et al., 2013) or Feedback Utility for Speech Production (FUSP) (Katseff et al., 2012; Parrell et al., 2017; Figure 1). Briefly, linear predictive coding (LPC) was used to model the vowel portion of the signal and apply a formant shift in real time during speech. Unaltered trials (50–75% of trials) underwent the same processing pipeline but with no alteration to the formants, such that auditory feedback in all trials had the same (minimal) delay. The magnitude and direction of the applied formant shift varied slightly across studies. Studies 1, 2, 3, and 4 shifted F1 upward and downward at a consistent magnitude (in mels or Hz) that was applied to all participants. Studies 5 and 6 each calculated participant-specific shift magnitudes for both F1 and F2 (in mels or Hz) along a vector pointing from the target vowel /ɛ/ to adjacent vowels /ɪ/ (as in hid) and /æ/ (as in had). For these studies, only the F1 portion of the vector was considered in the analysis; perturbations that increased F1 (/ɛ/ to /æ/) were considered ‘up’ shifts and perturbations that decreased F1 (/ɛ/ to /ɪ/) were considered ‘down’ shifts. All formant values were converted into mels for purposes of this analysis.
Behavioral measures and statistical analysis
Request a detailed protocolOur primary measure of interest was one-shot adaptation, an adaptive response that persists in the trial following an isolated perturbation. In order to examine whether one-shot adaptation is related to feedback-based corrections on the previous trial, we additionally measured the online compensation response. These behavioral responses were examined at both the trial level and the participant level.
Trials with a vowel duration of less than 100 ms were excluded from analysis (<1%). Two participants were excluded from the analysis as outliers (average compensation or one-shot response >4 SD from mean).
Compensation
Request a detailed protocolAt the trial level, compensation response was operationalized as the mean normalized F1 produced during the 150–250 ms time window of trials in which a perturbation occurred (perturbation trials). More specifically, participant- and word-specific baseline F1 trajectories were first calculated from the F1 trajectories of unperturbed trials (baseline trials). The F1 trajectory of each perturbation trial was then normalized by subtracting the word-specific baseline mean F1 trajectory from it. The compensation response for each perturbation trial was then defined as the mean F1 value within 150–250 ms after vowel onset, after the typical onset latency of compensation. A 200–300 ms time window was originally planned for this analysis; however, only 46% of produced vowels had a duration of at least 300 ms, whereas 80% of vowels lasted until the end of the 150–250 ms time window.
Average compensation response was also calculated at the participant level, operationalized as a participant’s mean normalized F1 across the 150–250 ms window of their perturbation trials. Again, the F1 trajectory of each perturbation trial was normalized via a participant- and word-specific baseline. Then for each participant, two average F1 trajectories were calculated: one trajectory that averaged the normalized trajectories across all trials containing an upward perturbation and one trajectory that averaged across all trials containing a downward perturbation. The participant’s average compensation response for each perturbation direction (up and down) was calculated as the mean F1 value in the 150–250 ms time window after vowel onset of these averaged perturbation trajectories.
In the trial level analysis, a linear mixed model was employed to investigate the effect of perturbation direction on compensation response: Compensation response ~ perturbation direction + (1 | participant) + (1 | study). Effect size was calculated by dividing β by the residual standard deviation. At the participant level, a paired t-test was used to evaluate the distribution of participants’ mean compensation response to upward perturbations vs. downward perturbations. Additional one-sample t-tests were conducted for each perturbation type against a mean of 0. Cohen’s d was calculated to determine effect size. Examining the entire 0–250 ms window, a cluster-based permutation test was used to find clusters of time points in which the compensation response for each condition differed from 0 and, separately, from each other (Maris and Oostenveld, 2007).
One-shot adaptation
Request a detailed protocolAt the trial level, one-shot adaptation response was calculated as the mean normalized F1 produced in the first 100 ms of unperturbed trials that occurred directly after a perturbed trial (post-perturbation trials). Again, participant- and word-specific baseline trajectories were calculated, though using F1 trajectories from unperturbed trials that directly followed another unperturbed trial (baseline trials). The F1 trajectories of each post-perturbation trial were then normalized by subtracting the word-specific baseline mean F1 trajectory. The one-shot adaptation response for each post-perturbation trial was calculated as the mean F1 value in the first 100 ms of the normalized trajectory. Only F1 values from the initial 100 ms of the vowel were included, limiting the influence of auditory-based feedback control mechanisms, which have a latency of 100–150 ms in speech (Cai et al., 2012; Parrell et al., 2017; Tourville et al., 2008).
At the participant level, the one-shot adaptation response was calculated as a participant’s mean normalized F1 in the first 100 ms of their average post-perturbation trial F1 trajectory. Again, the F1 trajectory of each post-perturbation trial was normalized via a participant- and word-specific baseline. Then, for each participant, two average F1 trajectories were calculated: one trajectory that averaged the normalized trajectories across all trials that occurred after an upward perturbation and one trajectory that averaged across all trials that occurred after a downward perturbation. The participant’s average one-shot adaptation response for each perturbation direction (up and down) was calculated as the mean F1 value in the first 100 ms of these averaged post-perturbation trajectories.
At the trial level, a linear mixed model was employed to investigate the effect of perturbation direction on one-shot adaptation: One-shot adaptation response ~ perturbation direction + (1 | participant) + (1 | study). Effect size was calculated by dividing β by the residual standard deviation. At the participant level, a paired t-test was implemented to assess the distribution of participants’ mean one-shot adaptation response to upward perturbations vs. downward perturbations. Additional one-sample t-tests were conducted for each post-perturbation type against a mean of 0. Cohen’s d was calculated to determine effect size and conduct a power estimation. As in the compensation analysis, a cluster-based permutation test identified clusters of time points in which the adaptation response for each condition differed from 0 and, separately, from each other.
Relationship between behavioral responses
Request a detailed protocolIn order to assess the relationship between compensation and the one-shot adaptation that followed it, we fitted a linear mixed effects model to one-shot adaptation with compensation, perturbation magnitude, and perturbation condition as fixed factors and with participant as a random intercept. To maintain a standardized magnitude measure between the two perturbation directions, compensation and one-shot adaptation responses from upward-shifted trials were multiplied by –1, removing the directional difference between up- and down-perturbation conditions. Separate analyses were conducted at the participant level (averaging across all trials) and at the individual trial level. To avoid problems in the linear models caused by predictors of very different scales, each perturbation magnitude was normalized by dividing by the mean of all perturbation magnitudes across participants. Study was not included as a separate random intercept in the model as it introduced singularity to the model due to its collinearity with participant and shift magnitude.
At the trial level, compensation response was intended to be included as a random slope by participant, however, this slope was removed because the model failed to converge. As a separate test of the within-subject relationship between compensation and one-shot adaptation, a one-sample t-test was conducted on participant correlations between their compensation and adaptation responses (sign-corrected). Pearson’s r was calculated for each participant, correlating compensation with subsequent adaptation at the trial level. A Fisher transformation was used to convert the correlation coefficients into z-scores prior to running the one-sample t-test; the mean was converted back to an r value for interpretation here.
All statistical analysis was conducted in R (R Development Core Team, 2020). Linear mixed effects models and their simplest explanatory models (calculated via stepwise regression) were generated using the lme4 package (Bates et al., 2015). Statistical significance of the final model was assessed with the lmerTest package, which uses the Satterthwaite method to estimate degrees of freedom (Kuznetsova et al., 2017). Power analyses for t-tests were conducted with the pwr package (Champely, 2020). Correlation between compensation and one-shot adaptation was then assessed with a Pearson’s r correlation coefficient using the MuMIn package (Barton, 2020). Effect sizes were calculated using the effectsize package (Ben-Shachar et al., 2020). Data and analysis code is available at https://github.com/blab-lab/postMan, (Hantzsch, 2022a copy archived at swh:1:rev:6cf539d0662552f27d1560a250285e49edde82c4). Some of the functions rely on additional code available at https://github.com/carrien/free-speech, (Hantzsch, 2022b copy archived at swh:1:rev:e065de8fa8c49ac9795f1865df5d171f0869666a).
Data availability
Data and analysis code are available on GitHub at https://github.com/blab-lab/postMan, (copy archived at swh:1:rev:6cf539d0662552f27d1560a250285e49edde82c4).
References
-
The neural feedback response to error as a teaching signal for the motor learning systemThe Journal of Neuroscience 36:4832–4845.https://doi.org/10.1523/JNEUROSCI.0159-16.2016
-
An implicit memory of errors limits human sensorimotor adaptationNature Human Behaviour 5:920–934.https://doi.org/10.1038/s41562-020-01036-x
-
Learning to predict the future: the cerebellum adapts feedforward movement controlCurrent Opinion in Neurobiology 16:645–649.https://doi.org/10.1016/j.conb.2006.08.016
-
Fitting linear mixed-effects models using lme4Journal of Statistical Software 67:i01.https://doi.org/10.18637/jss.v067.i01
-
Effectsize: Estimation of effect size indices and standardized parametersJournal of Open Source Software 5:2815.https://doi.org/10.21105/joss.02815
-
ConferenceA system for online dynamic perturbation of formant trajectories and results from perturbations of the mandarin triphthong /iauProceedings of the 8th International Seminar on Speech Production. pp. 65–68.
-
Compensatory responses to formant perturbations proportionally decrease as perturbations increaseJournal of Speech, Language, and Hearing Research 63:3392–3407.https://doi.org/10.1044/2020_JSLHR-19-00422
-
A computational model for estimating the speech motor system’s sensitivity to auditory prediction errorsJournal of Speech, Language, and Hearing Research 64:1841–1854.https://doi.org/10.1044/2021_JSLHR-20-00484
-
Neural correlates of reach errorsThe Journal of Neuroscience 25:9919–9931.https://doi.org/10.1523/JNEUROSCI.1874-05.2005
-
Consistency influences altered auditory feedback processingQuarterly Journal of Experimental Psychology 72:2371–2379.https://doi.org/10.1177/1747021819838939
-
PreprintDid We Get Sensorimotor Adaptation Wrong? Implicit Adaptation as Direct Policy Updating Rather than Forward-Model-Based LearningDid We Get Sensorimotor Adaptation Wrong? Implicit Adaptation as Direct Policy Updating Rather than Forward-Model-Based LearningbioRxiv.https://doi.org/10.1101/2020.01.22.914473
-
Model-based and model-free mechanisms of human motor learningAdvances in Experimental Medicine and Biology 782:1–21.https://doi.org/10.1007/978-1-4614-5465-6_1
-
Speech production as state feedback controlFrontiers in Human Neuroscience 5:82.https://doi.org/10.3389/fnhum.2011.00082
-
Temporal specificity of the initial adaptive response in motor adaptationPLOS Computational Biology 13:e1005438.https://doi.org/10.1371/journal.pcbi.1005438
-
A hierarchical neural-network model for control and learning of voluntary movementBiological Cybernetics 57:169–185.https://doi.org/10.1007/BF00364149
-
Human sensorimotor learning: adaptation, skill, and beyondCurrent Opinion in Neurobiology 21:636–644.https://doi.org/10.1016/j.conb.2011.06.012
-
Lmertest package: Tests in linear mixed effects modelsJournal of Statistical Software 82:13.https://doi.org/10.18637/jss.v082.i13
-
The relation of articulatory and vocal auditory-motor control in typical speakersJournal of Speech, Language, and Hearing Research 63:3628–3642.https://doi.org/10.1044/2020_JSLHR-20-00192
-
Compensations in response to real-time formant perturbations of different magnitudesThe Journal of the Acoustical Society of America 127:1059–1068.https://doi.org/10.1121/1.3278606
-
Nonparametric statistical testing of EEG- and MEG-dataJournal of Neuroscience Methods 164:177–190.https://doi.org/10.1016/j.jneumeth.2007.03.024
-
Talkers alter vowel production in response to real-time formant perturbation even when instructed not to compensateThe Journal of the Acoustical Society of America 125:384–390.https://doi.org/10.1121/1.3035829
-
Vowel category boundaries enhance cortical and behavioral responses to speech feedback alterationsThe Journal of Neuroscience 33:12090–12098.https://doi.org/10.1523/JNEUROSCI.1008-13.2013
-
ConferenceSensorimotor adaptation in speech and its effects on auditory monitoring. Program No. 631.14Neuroscience Meeting Planner. Washington, DC: Society for Neuroscience, 2014.
-
Responses to auditory feedback manipulations in speech may be affected by previous exposure to auditory errorsJournal of Speech, Language, and Hearing Research 64:2169–2181.https://doi.org/10.1044/2020_JSLHR-20-00263
-
Impaired feedforward control and enhanced feedback control of speech in patients with cerebellar degenerationThe Journal of Neuroscience 37:9249–9258.https://doi.org/10.1523/JNEUROSCI.3363-16.2017
-
Adaptive control of vowel formant frequency: evidence from real-time formant manipulationThe Journal of the Acoustical Society of America 120:966–977.https://doi.org/10.1121/1.2217714
-
Compensation following real-time manipulation of formants in isolated vowelsThe Journal of the Acoustical Society of America 119:2288–2297.https://doi.org/10.1121/1.2173514
-
SoftwareR: A language and environment for statistical computing, version 2.6.2R Foundation for Statistical Computing, Vienna, Austria.
-
Speech compensation responses and sensorimotor adaptation to formant feedback perturbationsThe Journal of the Acoustical Society of America 149:1147–1161.https://doi.org/10.1121/10.0003440
-
Nonhomogeneous transfer reveals specificity in speech motor learningJournal of Neurophysiology 107:1711–1717.https://doi.org/10.1152/jn.00773.2011
-
Implicit motor learning within three trialsScientific Reports 11:1627.https://doi.org/10.1038/s41598-021-81031-y
-
Error correction, sensory prediction, and adaptation in motor controlAnnual Review of Neuroscience 33:89–108.https://doi.org/10.1146/annurev-neuro-060909-153135
-
The DIVA model: A neural theory of speech acquisition and productionLanguage and Cognitive Processes 26:952–981.https://doi.org/10.1080/01690960903498424
-
ConferenceExploring auditory-motor interactions in normal and disordered speechICA 2013 Montreal.https://doi.org/10.1121/1.4800684
-
Sensory prediction errors drive cerebellum-dependent adaptation of reachingJournal of Neurophysiology 98:54–62.https://doi.org/10.1152/jn.00266.2007
-
Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perceptionThe Journal of the Acoustical Society of America 122:2306–2319.https://doi.org/10.1121/1.2773966
-
Multiple paired forward and inverse models for motor controlNeural Networks 11:1317–1329.https://doi.org/10.1016/s0893-6080(98)00066-5
-
Internal models in the cerebellumTrends in Cognitive Sciences 2:338–347.https://doi.org/10.1016/s1364-6613(98)01221-2
Article and author information
Author details
Funding
National Institutes of Health (DC014520)
- Caroline A Niziolek
National Institutes of Health (DC017091)
- Benjamin Parrell
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
This work was funded by National Institutes of Health grants R01 DC017091 (BP) and R00 DC014520 (CAN).
Ethics
Informed consent and consent to publish was obtained for all participants. The experimental protocols were approved by the Institutional Review Board of the institutions from which data were collected: the University of Wisconsin-Madison, the Massachusetts Institute of Technology, the University of California, San Francisco, and the University of California, Berkeley. The University of Wisconsin-Madison Minimal Risk Research IRB approved our procedures to analyze the previously collected data (MRR IRB 2017-1509).
Copyright
© 2022, Hantzsch et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,067
- views
-
- 303
- downloads
-
- 12
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
Complex macro-scale patterns of brain activity that emerge during periods of wakeful rest provide insight into the organisation of neural function, how these differentiate individuals based on their traits, and the neural basis of different types of self-generated thoughts. Although brain activity during wakeful rest is valuable for understanding important features of human cognition, its unconstrained nature makes it difficult to disentangle neural features related to personality traits from those related to the thoughts occurring at rest. Our study builds on recent perspectives from work on ongoing conscious thought that highlight the interactions between three brain networks – ventral and dorsal attention networks, as well as the default mode network. We combined measures of personality with state-of-the-art indices of ongoing thoughts at rest and brain imaging analysis and explored whether this ‘tri-partite’ view can provide a framework within which to understand the contribution of states and traits to observed patterns of neural activity at rest. To capture macro-scale relationships between different brain systems, we calculated cortical gradients to describe brain organisation in a low-dimensional space. Our analysis established that for more introverted individuals, regions of the ventral attention network were functionally more aligned to regions of the somatomotor system and the default mode network. At the same time, a pattern of detailed self-generated thought was associated with a decoupling of regions of dorsal attention from regions in the default mode network. Our study, therefore, establishes that interactions between attention systems and the default mode network are important influences on ongoing thought at rest and highlights the value of integrating contemporary perspectives on conscious experience when understanding patterns of brain activity at rest.
-
- Neuroscience
Gamma oscillations in brain activity (30–150 Hz) have been studied for over 80 years. Although in the past three decades significant progress has been made to try to understand their functional role, a definitive answer regarding their causal implication in perception, cognition, and behavior still lies ahead of us. Here, we first review the basic neural mechanisms that give rise to gamma oscillations and then focus on two main pillars of exploration. The first pillar examines the major theories regarding their functional role in information processing in the brain, also highlighting critical viewpoints. The second pillar reviews a novel research direction that proposes a therapeutic role for gamma oscillations, namely the gamma entrainment using sensory stimulation (GENUS). We extensively discuss both the positive findings and the issues regarding reproducibility of GENUS. Going beyond the functional and therapeutic role of gamma, we propose a third pillar of exploration, where gamma, generated endogenously by cortical circuits, is essential for maintenance of healthy circuit function. We propose that four classes of interneurons, namely those expressing parvalbumin (PV), vasointestinal peptide (VIP), somatostatin (SST), and nitric oxide synthase (NOS) take advantage of endogenous gamma to perform active vasomotor control that maintains homeostasis in the neuronal tissue. According to this hypothesis, which we call GAMER (GAmma MEdiated ciRcuit maintenance), gamma oscillations act as a ‘servicing’ rhythm that enables efficient translation of neural activity into vascular responses that are essential for optimal neurometabolic processes. GAMER is an extension of GENUS, where endogenous rather than entrained gamma plays a fundamental role. Finally, we propose several critical experiments to test the GAMER hypothesis.