Judgment and decision-making
Judgment is the estimation of quantities and likelihoods, such as how probable an event is; decision-making is the choice between options whose outcomes are uncertain. Three accounts dominate. The heuristics-and-biases programme of Tversky and Kahneman holds that people rely on a few mental shortcuts that usually work but produce systematic, predictable errors (Tversky & Kahneman, 1974). Gigerenzer’s fast-and-frugal programme holds that simple heuristics, which deliberately ignore part of the information, are often efficient and accurate in the environments where people use them (Gigerenzer & Gaissmaier, 2011). Dual-process theory explains biases as the default output of fast intuitive processes that slower deliberation fails to correct (Evans & Stanovich, 2013). The two heuristic programmes clashed directly in 1996 over whether the “biases” are errors at all (Gigerenzer, 1996; Kahneman & Tversky, 1996). Large replication projects since 2014 show that most core findings hold in direction but often with smaller effects, and some fail (Klein et al., 2014; Klein et al., 2018). Loss aversion, the claim that losses weigh more than equal gains, is robust in aggregate but disputed in interpretation (Brown et al., 2024; Gal & Rucker, 2018).
History
Heuristics and biases
Tversky and Kahneman’s 1974 paper proposed three heuristics. Representativeness judges probability by resemblance to a typical case; availability judges frequency by how easily examples come to mind; and adjustment from an anchor starts from an initial value and adjusts it insufficiently. Each is economical and usually effective but leads to systematic and predictable errors (Tversky & Kahneman, 1974). Kahneman and Tversky later described the programme’s aim as understanding the processes behind both valid and invalid judgments, with heuristics often useful and only sometimes leading to characteristic errors (Kahneman & Tversky, 1996).
The 1996 exchange
Gigerenzer argued that the heuristics-and-biases programme fails on two counts (Gigerenzer, 1996). Its heuristics are too vague: they explain both too little and too much, because one of them can be fitted after the fact to almost any result. And its norms are too narrow: the conjunction rule of probability, for example, is applied to the Linda problem without regard to its content and to single events, where Gigerenzer holds it does not straightforwardly apply. Gigerenzer also argued that frequency formats, which present information as counts rather than probabilities, remove many biases (Collins, 2019). Kahneman and Tversky replied that Gigerenzer misrepresented their position, and that judgments of frequency are also subject to large systematic biases (Kahneman & Tversky, 1996). They pointed out that their first demonstration of the conjunction effect used frequency judgments, contradicting Gigerenzer’s claim that conjunction violations are confined to subjective probabilities (Kahneman & Tversky, 1996). Gigerenzer in turn said they had misrepresented Gigerenzer’s position, and that the real issue was building process models that predict when the illusions appear and disappear (Gigerenzer, 1996).
Core concepts
Fast-and-frugal heuristics
Gigerenzer and Gaissmaier define heuristics as efficient processes that ignore part of the available information (Gigerenzer & Gaissmaier, 2011). They describe the cognitive-illusions programme as having arisen in contrast to theories of optimisation, and argue that representativeness and availability are not testable models, since they specify neither a process nor the conditions under which a heuristic succeeds or fails (Gigerenzer & Gaissmaier, n.d.).
Anchoring
In anchoring, an arbitrary number shown before an estimate pulls the estimate toward it. Many Labs 1, a replication of 13 effects across many samples, found anchoring effects very large but varying across samples, possibly because samples knew different amounts about the quantities to be estimated (Klein et al., 2014).
Framing
A framing effect is a change in choice caused by how equivalent options are described. In risky-choice framing, the classic case being the “Asian disease” problem, the same outcomes are described either as gains or as losses. It is a replicated effect of about d = 0.5 to 0.6 (d expresses a difference in standard deviations), with size depending on the design (Kühberger, 2023).
Conjunction fallacy and base-rate neglect
The conjunction fallacy is judging a combination of two events more likely than one of them alone, as in Tversky and Kahneman’s Linda problem. Base-rate neglect is ignoring how common something is in general when judging a particular case. Presenting problems as natural frequencies rather than probabilities improves Bayesian reasoning, the correct use of base rates, but how much depends on numeracy, so the improvement is less general than often claimed (Chapman & Liu, 2009). A meta-analysis found that natural frequencies raise correct answers to about 24 percent, from about 4 percent with probabilities, leaving about three quarters of people still wrong (Weber et al., 2018).
Prospect theory and loss aversion
Prospect theory, Kahneman and Tversky’s 1979 account of choice under risk, includes loss aversion: losses loom larger than gains of the same size (Gal & Rucker, 2018). A meta-analysis of 607 estimates from 150 articles published between 1992 and 2017 gives a mean loss-aversion coefficient of 1.955 (95% interval 1.820 to 2.102): losses weigh about twice as much as equal gains (Brown et al., 2024).
Questions, controversies, and new developments
Do the classic findings replicate?
The classic findings mostly replicate in direction, often with smaller effects, and some fail.
| Finding | Replication result |
|---|---|
| Numeric anchoring | Many Labs 1: four anchoring effects replicated with effect sizes larger than the original (original d = 0.93; replications d ≈ 1.2 to 2.4), varying across samples; the authors say the original underestimated anchoring (Klein et al., 2014). A meta-analysis of 2,601 effect sizes finds classic anchoring large and robust to correction for publication bias (Schley & Weingarten, 2026); anchoring is described as among the largest and easiest effects to replicate, with contradictory findings on its moderators (Röseler & Schütz, 2022) |
| Incidental anchors (numbers in the environment) | Failed in Many Labs 2: d = 0.04, against an original 0.30 (Klein et al., 2018). Incidental anchoring, random-number anchors, incentives and debiasing show reduced or null effects in meta-analysis (Schley & Weingarten, 2026) |
| Gain/loss framing (“Asian disease”) | Replicated at about half the original size: d = 0.60, against 1.13 (Klein et al., 2014). Bias-corrected meta-analytic d = 0.52, varying with the manipulation (Steiger & Kühberger, 2018; Kühberger, 2023) |
| Cheap-versus-costly item framing | Replicated at less than half the original size (Klein et al., 2018) |
| Ease of retrieval (availability) | Medium average effect for the standard paradigm, which correction for publication bias may cut by up to a third; variants give smaller, often reversed effects (Weingarten & Hutchinson, 2017). Not observed in a probability sample of US adults, nor in undergraduates (Yeager et al., 2019) |
| Linda conjunction fallacy | Preregistered close replication, N = 1,032: replicated (d ≈ 0.5); the “James” vignette showed no effect, so the effect depends on the vignette (Chandrashekar et al., 2021) |
| Conjunction fallacy and incentives | Meta-analysis, n = 3,276: a small positive effect of incentives on correct answers (Yechiam & Zeif, 2023) |
| Base-rate neglect | Generalises beyond problems with extreme base rates, but people split into two groups rather than varying continuously (Stengård & Juslin, 2022) |
| Affect and risk (Rottenstreich and Hsee) | Reversed in Many Labs 2: d = −0.08, against an original 0.74 (Klein et al., 2018) |
| Prospect-theory choice patterns | 19-country replication: 94% of items and 12 of 13 theoretical contrasts replicated, with weaker effects (Ruggeri et al., 2020) |
In a probability sample of US adults, six of seven classic social-psychology and heuristics effects replicated, but with notably smaller effects than in meta-analyses of student samples (Yeager et al., 2019). The reflection effect, the reversal of risk preferences between gains and losses, was the weakest part of the prospect-theory replication: one of its contrasts replicated in only 16 percent of countries, and the combined reflection effect in 73 percent, while the other effects replicated in all 19 (Ruggeri et al., 2020).
Is loss aversion real?
Loss aversion is robust in aggregate but contested in interpretation. Gal and Rucker conclude that current evidence does not support losses being more impactful than gains on balance (Gal & Rucker, 2018). Yechiam argues that early utility studies show that very large losses are overweighted but smaller losses often are not, and that some findings were misrepresented as loss aversion (Yechiam, 2018).
Mrkva and colleagues address these critiques, together with Ert and Erev’s and Gal’s claim that loss aversion is a fallacy (Mrkva et al., 2020). Across five samples totalling 17,720 people, they found everyone loss averse, though less so with more knowledge of the domain, which they read as support for an account in which preferences are constructed at the moment of choice (Mrkva et al., 2020). They doubt that loss aversion is a fallacy or is fully explained by status quo bias, risk aversion or reliance on educated laboratory samples, and report that at least ten articles separated loss aversion from status quo bias by using choices between two lotteries (Mrkva et al., 2020). The question remains contested.
Heuristics: errors or adaptations?
Whether the biases show flawed reasoning or an inappropriate standard is the core of the Gigerenzer–Kahneman and Tversky dispute and is not settled. Natural frequencies reduce base-rate neglect, as Gigerenzer predicted, but most people still fail with them (Weber et al., 2018), and the benefit depends on numeracy (Chapman & Liu, 2009). Small incentives improve conjunction judgments only slightly (Yechiam & Zeif, 2023).
Dual-process explanations
Evans and Stanovich defend a “default-interventionist” account of judgment: fast, autonomous Type 1 processes give a default response, which Type 2 processes, defined by hypothetical thinking and working-memory load, may override (Evans & Stanovich, 2013). Melnikoff and Bargh call the typology of two process types an unsupported myth (Melnikoff & Bargh, 2018b). The dispute is covered in Dual-process theory.
Broader connections
The argument over narrow norms parallels the dispute over the standard of correct reasoning, and probability-based accounts of both draw on Bayesian models of cognition. The replication projects behind the table above are discussed in Replicability and generality.
Further reading
- Tversky and Kahneman (1974): the founding paper of the heuristics-and-biases programme.
- Gigerenzer (1996) and Kahneman and Tversky (1996): the two sides of the 1996 exchange.
- Gigerenzer and Gaissmaier (2011): a review of fast-and-frugal heuristics.
- Mrkva et al. (2020): the loss-aversion dispute and a large test of it.
Known gaps
- Kahneman and Tversky (1979), the original prospect-theory paper, and the full text of Gal and Rucker (2018) could not be read.
- Both sides of the 1996 Gigerenzer–Kahneman and Tversky exchange were read in full.
References
- Brown, A. L., Imai, T., Vieider, F. M., & Camerer, C. F. (2024). Meta-analysis of Empirical Estimates of Loss Aversion. Journal of Economic Literature, 62(2), 485-516 (American Economic Association). https://www.aeaweb.org/doi/10.1257/jel.20221698
- Chandrashekar, S. P., Cheng, B. L., Cheng, Y. H., Fong, C. L., Leung, Y. C., Wong, Y. T., & Feldman, G. (2021). Frequency estimation and semantic ambiguity do not eliminate conjunction bias, when it occurs: Replication and extension of Mellers, Hertwig, and Kahneman (2001). Meta-Psychology, 5, MP.2020.2474. https://open.lnu.se/index.php/metapsychology/article/view/2474
- Chapman, G. B., & Liu, J. (2009). Numeracy, frequency, and Bayesian reasoning. Judgment and Decision Making. https://doi.org/10.1017/s1930297500000681 abstract only
- Collins, J. (2019). Gigerenzer versus Kahneman and Tversky: The 1996 face-off. Jason Collins blog (blog.jcx.au). https://blog.jcx.au/posts/gigerenzer-versus-kahneman-and-tversky-the-1996-face-off
- Evans, J. S., & Stanovich, K. E. (2013). Dual-Process Theories of Higher Cognition: Advancing the Debate. Perspectives on Psychological Science (via Europe PMC record). https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=DOI:10.1177/1745691612460685&resultType=core&format=json
- Gal, D., & Rucker, D. D. (2018). The Loss of Loss Aversion: Will It Loom Larger Than Its Gain? Journal of Consumer Psychology, 28(3), 497-516 (Wiley); abstract as returned by the Crossref API. https://api.crossref.org/works/10.1002/jcpy.1047 abstract only
- Gigerenzer, G. (1996). On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky (1996). Psychological Review, 103(3), 592-596 (American Psychological Association). https://www.csc2.ncsu.edu/faculty/mpsingh/local/Social/f25/wrap/readings/Gigerenzer-on-Kahneman+Tversky-1996.pdf
- Gigerenzer, G., & Gaissmaier, W. (2011). Heuristic decision making. Annual Review of Psychology (via Europe PMC record). https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=DOI:10.1146/annurev-psych-120709-145346&resultType=core&format=json
- Gigerenzer, G., & Gaissmaier, W. (n.d.). Denken und Urteilen unter Unsicherheit: Kognitive Heuristiken. Universitaet Heidelberg, Enzyklopaedie der Psychologie online chapter (Enz_06_Heuristiken). https://www.psychologie.uni-heidelberg.de/ae/allg/enzykl_denken/Enz_06_Heuristiken.pdf
- Kahneman, D., & Tversky, A. (1996). On the Reality of Cognitive Illusions. Psychological Review, 103(3), 582-591 (American Psychological Association). https://www.csc2.ncsu.edu/faculty/mpsingh/local/Social/f25/wrap/readings/Kahneman+Tversky-cognitive-illusions-1996.pdf
- Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B. Jr., Bahnik, S., Bernstein, M. J., Bocian, K., et al. (2014). Investigating variation in replicability: A "Many Labs" replication project. Social Psychology, 45(3), 142-152 (accepted version via LSE Research Online). https://researchonline.lse.ac.uk/id/eprint/65158/
- Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., et al. (2018). Many labs 2: investigating variation in replicability across samples and settings. Advances in Methods and Practices in Psychological Science, 1(4), 443-490 (Leiden repository copy). https://scholarlypublications.universiteitleiden.nl/handle/1887/74652 unverified claims
- Kühberger, A. (2023). A systematic review of risky-choice framing effects. EXCLI Journal, 22, 1012-1031 (read via Europe PMC, PMC10620856). https://www.ebi.ac.uk/europepmc/webservices/rest/PMC10620856/fullTextXML
- Melnikoff, D. E., & Bargh, J. A. (2018b). The Mythical Number Two. Trends in Cognitive Sciences, 22(4), 280-293 (Cell Press/Elsevier). https://acmelab.yale.edu/sites/default/files/melnikoff_bargh_2018_mythical_number_2_0.pdf
- Mrkva, K., Johnson, E. J., Gächter, S., & Herrmann, A. (2020). Moderating Loss Aversion: Loss Aversion Has Moderators, But Reports of its Death are Greatly Exaggerated. Journal of Consumer Psychology, 30(3), 407-428 (Wiley); published-version PDF hosted by University of St. Gallen. https://imo.unisg.ch/wp-content/uploads/2020/12/01_jcpy.1156.pdf
- Röseler, L., & Schütz, A. (2022). Hanging the Anchor Off a New Ship: A Meta-Analysis of Anchoring Effects. PsyArXiv preprint. https://doi.org/10.31234/osf.io/wf2tn abstract only unverified claims
- Ruggeri, K., et al. (2020). Replicating patterns of prospect theory for decision under risk. Nature Human Behaviour, 4, 622-633 (copy hosted at gwern.net). https://gwern.net/doc/psychology/cognitive-bias/2020-ruggeri.pdf
- Schley, D. R., & Weingarten, E. (2026). Fifty Years of Anchoring Effects: A Theoretical Reintegration and Meta-Analysis. Management Science (INFORMS); abstract read through the OpenAlex API record (doi 10.1287/mnsc.2023.03238; OSF preprint 10.31234/osf.io/teq7k_v2). https://doi.org/10.1287/mnsc.2023.03238 abstract only unverified claims
- Steiger, A., & Kühberger, A. (2018). A Meta-Analytic Re-Appraisal of the Framing Effect. Zeitschrift für Psychologie. https://doi.org/10.1027/2151-2604/a000321 abstract only unverified claims
- Stengård, E., & Juslin, P. (2022). On the generality and cognitive basis of base-rate neglect. Cognition. https://doi.org/10.1016/j.cognition.2022.105160 abstract only unverified claims
- Tversky, A., & Kahneman, D. (1974). Judgment under Uncertainty: Heuristics and Biases. Science, 185(4157), 1124-1131. https://www.csc2.ncsu.edu/faculty/mpsingh/local/Social/f25/wrap/readings/Tversky+Kahneman-heuristics-biases-1974.pdf
- Weber, P., Binder, K., & Krauss, S. (2018). Why Can Only 24% Solve Bayesian Reasoning Problems in Natural Frequencies: Frequency Phobia in Spite of Probability Blindness. Frontiers in Psychology (read via Europe PMC, PMC6194348). https://www.ebi.ac.uk/europepmc/webservices/rest/PMC6194348/fullTextXML
- Weingarten, E., & Hutchinson, J. W. (2017). Does Ease Mediate the Ease-of-Retrieval Effect? A Meta-Analysis. Psychological Bulletin (author copy hosted by the Wharton School, University of Pennsylvania). https://faculty.wharton.upenn.edu/wp-content/uploads/2017/12/Weingarten-Hutchinson-PsychBull_July2017.pdf
- Yeager, D. S., Krosnick, J. A., Visser, P. S., Holbrook, A. L., & Tahk, A. M. (2019). Moderation of classic social psychological effects by demographics in the U.S. adult population: New opportunities for theoretical advancement. Journal of Personality and Social Psychology (abstract via Europe PMC, PMC6918461). https://www.ebi.ac.uk/europepmc/webservices/rest/search?query=PMCID:PMC6918461&format=json&resultType=core abstract only
- Yechiam, E. (2018). Acceptable losses: the debatable origins of loss aversion. Psychological Research (Springer), doi 10.1007/s00426-018-1013-8. https://www.Gwern.net/doc/statistics/bias/2018-yechiam.pdf
- Yechiam, E., & Zeif, D. (2023). The effect of incentivization on the conjunction fallacy in judgments: a meta-analysis. Psychological Research. https://doi.org/10.1007/s00426-023-01837-5 abstract only unverified claims