Language
Language processing covers how people produce speech and how they understand what they hear and read. Its central dispute, across production and comprehension alike, is between staged models, in which each level of processing finishes its work before passing a single result on, and interactive or cascaded models, in which levels work in parallel and influence each other (Goldrick, n.d.; Wagers & Dillon, 2025). In speaking, a staged model of word production competes with interactive models; a review concludes that the truth lies between them (Levelt et al., 1999; Goldrick, n.d.). In recognising spoken words, researchers disagree on whether knowledge of words feeds back to the perception of speech sounds (Norris et al., 2018). In understanding sentences, single-analysis “garden-path” models compete with constraint-based models, and the role of prediction is contested: a measure of word predictability called surprisal explains some reading difficulty but not all (Wagers & Dillon, 2025; van Schijndel & Linzen, 2021), and a well-known prediction effect failed to replicate (Nieuwland et al., 2018).
History
The production debate grew from two empirical traditions that disagreed. Speech errors, such as saying “rat” for “cat”, favoured interaction between levels, while reaction-time data from Levelt, Roelofs and Meyer were fitted well by staged, discrete models (Goldrick, n.d.). Levelt, Roelofs and Meyer’s 1999 theory divides word production into stages, is implemented as a computer model called WEAVER++, and was tested mainly with the time people take to name pictures (Levelt et al., 1999). Dell’s 1986 model, the main interactive alternative, allows activation to flow back from sounds to words (Nozari & Pinet, 2020).
In sentence comprehension, the garden-path model holds that readers commit to a single analysis of a sentence at each point, and must reanalyse when it proves wrong; constraint-based models describe comprehension as the simultaneous interaction of several levels of representation (Wagers & Dillon, 2025). Traxler describes three later developments that move away from purely bottom-up parsing: anticipation of upcoming words, Bayesian or “noisy-channel” inference, in which readers weigh what they perceive against what is likely to have been meant, and “good-enough” parsing, in which readers settle for a shallow interpretation (Traxler, 2014).
Core concepts
Speaking a word
To say a word, a speaker must select it from memory and retrieve its sounds. All major models agree that words other than the target are partly activated along the way; they differ on feedback. Only models that allow feedback, such as Dell’s, activate other words through shared sounds (Nozari & Pinet, 2020). Despite large behavioural, brain-imaging and electrophysiological literatures, it remains unclear how the production system handles these co-activated items, and a review identifies three common problems in how the evidence is interpreted (Nozari & Pinet, 2020).
Discrete two-step models and fully cascading models differ in two testable predictions: whether distractors from the same category cause interference, and whether the sound forms of more than one word become available at once (Bölte et al., 2015).
Recognising spoken words
Spoken-word recognition is split on feedback. Magnuson and colleagues argue that activation feeding back from the word level to the level of speech sounds helps recognition. Norris, McQueen and Cutler argue that such feedback is unnecessary and contradicted by behavioural evidence (Norris et al., 2018), and that the opposing argument is tied to one class of model, misses the point about parsimony and ignores crucial data (Norris et al., 2018).
Understanding sentences
Surprisal is a measure of how unexpected a word is in its context, computed from the probability a language model assigns to it. Levy argued that surprisal theory, first proposed by Hale in 2001, is equivalent to reallocating resources across parallel probabilistic analyses of a sentence, which ties it to constraint-based parallel models (Levy, 2008). Readers also use prior beliefs in interpretation: comprehenders misinterpret anomalous sentences in the direction of what is plausible (Traxler, 2014).
Regular and irregular past tense
How people form the past tense of English verbs became a test case between rules and associations. Pinker and Ullman’s words-and-rules account holds that irregular forms (“went”) are stored in declarative memory, while regular forms (“walked”) are computed by a rule using the procedural system (Pinker & Ullman, 2002). Single-route accounts, associated with connectionism, hold that both kinds come from one associative mechanism (Yoon, 2023).
Questions, controversies, and new developments
Staged or cascading production?
This question is contested. Goldrick’s review concludes that both the strictly discrete and the fully interactive positions are wrong: activation does cascade, and some feedback flows from sounds to words, but both are limited, and feedback from words to meaning is absent or insignificant (Goldrick, n.d.).
The mixed-error effect is the most cited evidence for interaction: errors that are related to the target both in meaning and in sound, such as “rat” for “cat”, occur more often than the sum of purely semantic and purely phonological errors would predict. The effect is itself inconsistent, with null results in spontaneous, experimentally induced and aphasic error corpora (Goldrick, n.d.). Goldrick argues that it needs only a minimal step beyond a discrete system, cascading activation, not full feedback, and that very strong cascading predicts patterns the data do not show (Goldrick, n.d.). Roelofs, defending the staged model, is reported to answer that mixed errors arise from mistakenly selecting two words, not from feedback (Bölte et al., 2015).
Experiments with pictures give inconsistent results. A facilitation effect of phonologically related distractor pictures reported by Morsella and Miozzo was not replicated by Jescheniak and colleagues, and pictures from the same category produced facilitation, interference or no effect in different studies (Bölte et al., 2015). Semantic interference in picture-word tasks can be read as competition when a word is selected, as staged models say, or as an effect in an output buffer after selection, as cascading models allow, so the effect does not settle the debate (Bölte et al., 2015). Bölte and colleagues found that distractor pictures activate their own word forms, which they say is hard to reconcile with discrete serial models (Bölte et al., 2015).
Can surprisal explain garden paths?
A garden-path sentence leads the reader into a wrong analysis and causes a slowdown when the error is detected. Surprisal from a fully parallel parser predicts that garden-path effects exist, but drastically underpredicts their size and their relative severity across sentence types; van Schijndel and Linzen conclude that prediction alone may not replace mechanisms of reanalysis (van Schijndel & Linzen, 2021). A 2026 preprint reports that language models fine-tuned for the purpose do capture human garden-path slowdowns through surprisal, offered as an existence proof against that conclusion (Yoshida et al., 2026). With 409 surprisal estimates and 368 readers, Timkey and colleagues found that surprisal explains early effects of syntactic disambiguation but not the added cost of rereading, so it captures routine structure-building but not the detection and correction of errors (Timkey et al., 2026).
What shape is the predictability effect?
Surprisal theory predicts that reading time rises with the logarithm of a word’s improbability. Across six reading datasets, Shain and colleagues found a logarithmic effect, which favours probabilistic-inference accounts over accounts in which readers pre-activate likely words (Shain et al., 2024). Brothers and Kuperberg found a linear relation, contradicting surprisal theory and favouring proportional pre-activation (Brothers & Kuperberg, 2021). The function linking predictability to reading time is contested.
Do readers predict specific words?
DeLong and colleagues (2005) reported that the brain’s N400 response, an electrical signal sensitive to how expected a word is, differed already at the article before a predictable noun (“a” versus “an”), suggesting that readers pre-activate the sound of the upcoming noun. A nine-lab preregistered replication with 334 participants reproduced the effect at the noun but not at the article (Nieuwland et al., 2018). Evidence for routine pre-activation of word sounds, one pillar of predictive accounts, thus failed to replicate.
Rules or analogy in the past tense?
Evidence on the past tense points both ways, and the question is contested.
- In an ERP study, violations of regular past tenses and of phrase structure produced left anterior negativities, a brain response, while irregular violations did not; the authors read this as distinct processing of regulars and irregulars (Newman et al., 2007).
- An N400 priming study also found a regular-irregular dissociation, but argued that it fits single-system models better than dual-system ones (Justus et al., 2008).
- In stroke patients, deficits with the regular past tense were associated with damage to regions linked to articulatory sequencing and phonological short-term memory, not with grammatical difficulty (Meteyard et al., 2013).
- A behavioural study of children’s past tenses of novel verbs concluded that regular forms are explained by analogy over stored examples, not a formal rule (Blything et al., 2018).
Whether modern neural networks resolve the debate is an open question (Yoon, 2023).
Replication record
| Finding | Replication result |
|---|---|
| Article-level N400 prediction effect (DeLong et al., 2005) | Failed in a nine-lab preregistered replication, N = 334; the noun effect replicated (Nieuwland et al., 2018) |
| Mixed-error effect | Inconsistent, with null results in several error corpora (Goldrick, n.d.) |
| Phonological facilitation from distractor pictures | Not replicated by Jescheniak and colleagues (Bölte et al., 2015) |
Broader connections
The past-tense debate is a central case in the dispute between rules and associations described in Connectionism. Language and emotion are argued to be interactive or even constitutive of each other rather than separate, with the evidence favouring the constitutive view (Satpute & Lindquist, 2021). The storage of irregular forms in declarative memory ties the words-and-rules account to the memory systems described in Memory.
Further reading
- Goldrick (n.d.): a review of the staged-versus-interactive debate in production.
- Nozari and Pinet (2020): how production models handle co-activated words.
- Traxler (2014): prediction, noisy-channel and good-enough accounts of comprehension.
- Nieuwland et al. (2018): the large replication of the article prediction effect.
Known gaps
- The primary papers of the staged side of the production debate (Roelofs, 2004, 2007) and of Dell (1986) could not be read; that side is known here through reviews, including second-hand reports of Roelofs’s arguments.
- Language acquisition, reading and bilingualism were outside the research.
References
- Blything, R. P., Ambridge, B., & Lieven, E. V. M. (2018). Children's Acquisition of the English Past-Tense: Evidence for a Single-Route Account From Novel Verb Production Data. Cognitive Science, 42(Suppl 2), 621-639 (Europe PMC record, PMID 29327384). https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=EXT_ID:29327384%20AND%20SRC:MED&format=json&resultType=core abstract only
- Bölte, J., Böhl, A., Dobel, C., & Zwitserlood, P. (2015). Investigating the flow of information during speaking: the impact of morpho-phonological, associative, and categorical picture distractors on picture naming. Frontiers in Psychology 6:1540. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2015.01540/pdf
- Brothers, T., & Kuperberg, G. R. (2021). Word predictability effects are linear, not logarithmic: Implications for probabilistic models of sentence comprehension. Journal of Memory and Language (via Europe PMC, PMC7584137). https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=PMCID:PMC7584137&format=json&resultType=core abstract only
- Goldrick, M. (n.d.). Limited Interaction in Speech Production: Chronometric, Speech Error, and Neuropsychological Evidence. Northwestern University (author-hosted preprint, Department of Linguistics; no journal or year printed on the page). https://faculty.wcas.northwestern.edu/matt-goldrick/publications/pdfs/goldrickLimInteract.pdf
- Justus, T., Larsen, J., de Mornay Davies, P., & Swick, D. (2008). Interpreting dissociations between regular and irregular past-tense morphology: evidence from event-related potentials. Cognitive, Affective & Behavioral Neuroscience. https://www.ebi.ac.uk/europepmc/webservices/rest/search?format=json&resultType=core&query=EXT_ID:18589508%20AND%20SRC:MED abstract only
- Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999). A theory of lexical access in speech production. Behavioral and Brain Sciences 22(1), 1-38 (Cambridge University Press). https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/abs/theory-of-lexical-access-in-speech-production/7E4A98E8791AB85397761DAAB35288AA abstract only
- Levy, R. (2008). Expectation-based syntactic comprehension. Cognition 106, 1126-1177. https://www.mit.edu/~rplevy/papers/levy-2008-cognition.pdf
- Meteyard, L., Price, C. J., Woollams, A. M., & Aydelott, J. (2013). Lesions impairing regular versus irregular past tense production. NeuroImage: Clinical. https://www.ebi.ac.uk/europepmc/webservices/rest/search?format=json&resultType=core&query=EXT_ID:24273726%20AND%20SRC:MED abstract only
- Newman, A. J., Ullman, M. T., Pancheva, R., Waligura, D. L., & Neville, H. J. (2007). An ERP study of regular and irregular English past tense inflection. NeuroImage. https://www.ebi.ac.uk/europepmc/webservices/rest/search?format=json&resultType=core&query=EXT_ID:17070703%20AND%20SRC:MED abstract only
- Nieuwland, M. S., et al. (2018). Large-scale replication study reveals a limit on probabilistic prediction in language comprehension. eLife 7, e33468. https://eprints.whiterose.ac.uk/130281/1/elife_33468_v2.pdf
- Norris, D., McQueen, J. M., & Cutler, A. (2018). Commentary on "Interaction in Spoken Word Recognition Models". Frontiers in Psychology. https://pmc.ncbi.nlm.nih.gov/articles/PMC6129619/
- Nozari, N., & Pinet, S. (2020). A critical review of the behavioral, neuroimaging, and electrophysiological studies of co-activation of representations during word production. Journal of Neurolinguistics 53 (accepted manuscript, Johns Hopkins University). https://www.cmu.edu/dietrich/psychology/nozarilab/papers/2020NozariPinet.pdf
- Pinker, S., & Ullman, M. T. (2002). The past and future of the past tense. Trends in Cognitive Sciences. https://www.ebi.ac.uk/europepmc/webservices/rest/search?format=json&resultType=core&query=EXT_ID:12457895%20AND%20SRC:MED abstract only
- Satpute, A. B., & Lindquist, K. A. (2021). At the Neural Intersection Between Language and Emotion. Affective Science (via Europe PMC PMC9382959). https://europepmc.org/article/PMC/PMC9382959 abstract only
- Shain, C., Meister, C., Pimentel, T., Cotterell, R., & Levy, R. (2024). Large-scale evidence for logarithmic effects of word predictability on reading time. Proceedings of the National Academy of Sciences (via Europe PMC, PMC10927576). https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=PMCID:PMC10927576&format=json&resultType=core abstract only
- Timkey, W., Huang, K.-J., Oh, B.-D., Prasad, G., Arehalli, S., Linzen, T., & Dillon, B. (2026). Eye movements reveal a dissociation between prediction and structural processing difficulty in language comprehension. Proceedings of the National Academy of Sciences (open access, CC BY). https://tallinzen.net/media/papers/timkey_et_al_2026_pnas.pdf
- Traxler, M. J. (2014). Trends in syntactic parsing: anticipation, Bayesian estimation, and good-enough parsing. Trends in Cognitive Sciences, 18(11), 605-611 (via PMC6814003). https://pmc.ncbi.nlm.nih.gov/articles/PMC6814003
- van Schijndel, M., & Linzen, T. (2021). Single-Stage Prediction Models Do Not Explain the Magnitude of Syntactic Disambiguation Difficulty. Cognitive Science 45, e12988. https://par.nsf.gov/servlets/purl/10286106
- Wagers, M., & Dillon, B. (2025). Sentence Processing. Open Encyclopedia of Cognitive Science (MIT Press / Knowledge Futures). https://oecs.knowledgefutures.org/pub/mn7mjhx9
- Yoon, T. (2023). The Status Quo of the English Past-Tense Debate. Lingua Humanitatis (via OpenAlex abstract). https://doi.org/10.16945/inahsl.25.2.3 abstract only
- Yoshida, R., Isono, S., Someya, T., Oseki, Y., & Kuribayashi, T. (2026). An Existence Proof for Neural Language Models That Can Explain Garden-Path Effects via Surprisal. arXiv:2604.18293 (preprint). https://arxiv.org/abs/2604.18293