Planning fallacy explained

The planning fallacy is a phenomenon in which predictions about how much time will be needed to complete a future task display an optimism bias and underestimate the time needed. This phenomenon sometimes occurs regardless of the individual's knowledge that past tasks of a similar nature have taken longer to complete than generally planned.^[1] ^[2] The bias affects predictions only about one's own tasks. On the other hand, when outside observers predict task completion times, they tend to exhibit a pessimistic bias, overestimating the time needed. The planning fallacy involves estimates of task completion times more optimistic than those encountered in similar projects in the past.

The planning fallacy was first proposed by Daniel Kahneman and Amos Tversky in 1979.^[3] ^[4] In 2003, Lovallo and Kahneman proposed an expanded definition as the tendency to underestimate the time, costs, and risks of future actions and at the same time overestimate the benefits of the same actions. According to this definition, the planning fallacy results in not only time overruns, but also cost overruns and benefit shortfalls.^[5]

Empirical evidence

For individual tasks

In a 1994 study, 37 psychology students were asked to estimate how long it would take to finish their senior theses. The average estimate was 33.9 days. They also estimated how long it would take "if everything went as well as it possibly could" (averaging 27.4 days) and "if everything went as poorly as it possibly could" (averaging 48.6 days). The average actual completion time was 55.5 days, with about 30% of the students completing their thesis in the amount of time they predicted.^[6]

Another study asked students to estimate when they would complete their personal academic projects. Specifically, the researchers asked for estimated times by which the students thought it was 50%, 75%, and 99% probable their personal projects would be done.^[7]

13% of subjects finished their project by the time they had assigned a 50% probability level;
19% finished by the time assigned a 75% probability level;
45% finished by the time of their 99% probability level.

A survey of Canadian tax payers, published in 1997, found that they mailed in their tax forms about a week later than they predicted. They had no misconceptions about their past record of getting forms mailed in, but expected that they would get it done more quickly next time.^[8] This illustrates a defining feature of the planning fallacy: that people recognize that their past predictions have been over-optimistic, while insisting that their current predictions are realistic.

For group tasks

Carter and colleagues conducted three studies in 2005 that demonstrate empirical support that the planning fallacy also affects predictions concerning group tasks. This research emphasizes the importance of how temporal frames and thoughts of successful completion contribute to the planning fallacy.

Proposed explanations

Kahneman and Tversky originally explained the fallacy by envisaging that planners focus on the most optimistic scenario for the task, rather than using their full experience of how much time similar tasks require.^[9]
Roger Buehler and colleagues account for the fallacy by examining wishful thinking; in other words, people think tasks will be finished quickly and easily because that is what they want to be the case.
In a different paper, Buehler and colleagues suggest an explanation in terms of the self-serving bias in how people interpret their past performance. By taking credit for tasks that went well but blaming delays on outside influences, people can discount past evidence of how long a task should take. One experiment found that when people made their predictions anonymously, they do not show the optimistic bias. This suggests that the people make optimistic estimates so as to create a favorable impression with others,^[10] which is similar to the concepts outlined in impression management theory.
Another explanation proposed by Roy and colleagues is that people do not correctly recall the amount of time that similar tasks in the past had taken to complete; instead people systematically underestimate the duration of those past events. Thus, a prediction about future event duration is biased because memory of past event duration is also biased. Roy and colleagues note that this memory bias does not rule out other mechanisms of the planning fallacy.^[11]
Sanna and colleagues examined temporal framing and thinking about success as a contributor to the planning fallacy. They found that when people were induced to think about a deadline as distant (i.e., much time remaining) vs. rapidly approaching (i.e., little time remaining), they made more optimistic predictions and had more thoughts of success. In their final study, they found that the ease of generating thoughts also caused more optimistic predictions.^[12]
One explanation, focalism, proposes that people fall victim to the planning fallacy because they only focus on the future task and do not consider similar tasks of the past that took longer to complete than expected.^[13]
As described by Fred Brooks in The Mythical Man-Month, adding new personnel to an already-late project incurs a variety of risks and overhead costs that tend to make it even later; this is known as Brooks's law.
The "authorization imperative" offers another possible explanation: much of project planning takes place in a context which requires financial approval to proceed with the project, and the planner often has a stake in getting the project approved. This dynamic may lead to a tendency on the part of the planner to deliberately underestimate the project effort required. It is easier to get forgiveness (for overruns) than permission (to commence the project if a realistic effort estimate were provided). Such deliberate underestimation has been named by Jones and Euske "strategic misrepresentation".^[14]
Apart from psychological explanations, the phenomenon of the planning fallacy has also been explained by Taleb as resulting from natural asymmetry and from scaling issues. The asymmetry results from random events giving negative results of delay or cost, not evenly balanced between positive and negative results. The scaling difficulties relate to the observation that consequences of disruptions are not linear, that as size of effort increases the error increases much more as a natural effect of inefficiencies of larger efforts' ability to react, particularly efforts that are not divisible in increments. Additionally this is contrasted with earlier efforts being more commonly on-time (e.g. the Empire State Building, The Crystal Palace, the Golden Gate Bridge) to conclude it indicates inherent flaws in more modern planning systems and modern efforts having hidden fragility. (For example, that modern efforts – being computerized and less localized invisibly – have less insight and control, and more dependencies on transportation.)^[15]
Bent Flyvbjerg and Dan Gardner write that planning on government-funded projects is often rushed so that construction can begin as soon as possible to avoid later administrations undoing or cancelling the project. They say a longer planning period tends to result in faster and cheaper construction.^[16]

Methods for counteracting

Segmentation effect

The segmentation effect is defined as the time allocated for a task being significantly smaller than the sum of the time allocated to individual smaller sub-tasks of that task. In a study performed by Forsyth in 2008, this effect was tested to determine if it could be used to reduce the planning fallacy. In three experiments, the segmentation effect was shown to be influential. However, the segmentation effect demands a great deal of cognitive resources and is not very feasible to use in everyday situations.^[17]

Implementation intentions

Implementation intentions are concrete plans that accurately show how, when, and where one will act. It has been shown through various experiments that implementation intentions help people become more aware of the overall task and see all possible outcomes. Initially, this actually causes predictions to become even more optimistic. However, it is believed that forming implementation intentions "explicitly recruits willpower" by having the person commit themselves to the completion of the task. Those that had formed implementation intentions during the experiments began work on the task sooner, experienced fewer interruptions, and later predictions had reduced optimistic bias than those who had not. It was also found that the reduction in optimistic bias was mediated by the reduction in interruptions.

Reference class forecasting

Reference class forecasting predicts the outcome of a planned action based on actual outcomes in a reference class of similar actions to that being forecast.

Real-world examples

The Sydney Opera House was expected to be completed in 1963. A scaled-down version opened in 1973, a decade later. The original cost was estimated at $7 million, but its delayed completion led to a cost of $102 million.^[12]

The Eurofighter Typhoon defense project took six years longer than expected, with an overrun cost of 8 billion euros.^[12]

The Big Dig which undergrounded the Boston Central Artery was completed seven years later than planned,^[18] for $8.08 billion on a budget of $2.8 billion (in 1988 dollars).^[19]

The Denver International Airport opened sixteen months later than scheduled, with a total cost of $4.8 billion, over $2 billion more than expected.^[20]

The Berlin Brandenburg Airport is another case. After 15 years of planning, construction began in 2006, with the opening planned for October 2011. There were numerous delays. It was finally opened on October 31, 2020. The original budget was €2.83 billion; current projections are close to €10.0 billion.

Olkiluoto Nuclear Power Plant Unit 3 faced severe delay and a cost overrun. The construction started in 2005 and was expected to be completed by 2009, but completed only in 2023.^[21] ^[22] Initially, the estimated cost of the project was around 3 billion euros, but the cost has escalated to approximately 10 billion euros.^[23]

California High-Speed Rail is still under construction, with tens of billions of dollars in overruns expected, and connections to major cities postponed until after completion of the rural segment.

Notes and References

If you don't want to be late, enumerate: Unpacking Reduces the Planning Fallacy. Journal of Experimental Social Psychology. 40. 5. 586–598. 15 October 2003. 10.1016/j.jesp.2003.11.001. Kruger. Justin. Evans. Matt.
10.1002/1099-0992(200011/12)30:6<873::AID-EJSP22>3.0.CO;2-U . Overcoming the planning fallacy through willpower: Effects of implementation intentions on actual and predicted task-completion times. European Journal of Social Psychology. 30. 6. 873–888. 2000. Koole. Sander. Van't Spijker. Mascha. 1871/17588. https://web.archive.org/web/20191129203246/https://research.vu.nl/ws/portalfiles/portal/1681741/Koole+European+Journal+of+Social+Psychology+30+2000+u.pdf. 2019-11-29. free.
Pezzo. Mark V.. Litman. Jordan A.. Pezzo. Stephanie P.. On the distinction between yuppies and hippies: Individual differences in prediction biases for planning future tasks . Personality and Individual Differences. 41. 7. 2006. 1359–1371. 0191-8869. 10.1016/j.paid.2006.03.029.
Kahneman. Daniel. Tversky. Amos. 1977. Intuitive prediction: Biases and corrective procedures. https://web.archive.org/web/20130908065829/http://www.dtic.mil/dtic/tr/fulltext/u2/a047747.pdf. live. September 8, 2013. Decision Research Technical Report PTR-1042-77-6. In Book: Judgment Under Uncertainty: Heuristics and Biases. Science. 185. 4157. Kahneman. Daniel. Tversky. Amos. 1982. 978-0511809477. Kahneman. Daniel. 414–421. Intuitive prediction: Biases and corrective procedures. 10.1017/CBO9780511809477.031. 17835457. Slovic. Paul. Tversky. Amos.
Lovallo . Dan . Daniel . Kahneman . July 2003 . Delusions of Success: How Optimism Undermines Executives' Decisions . Harvard Business Review . 81 . 7 . 56–63. 12858711 .
10.1037/0022-3514.67.3.366 . Buehler . Roger . Dale Griffin . Michael Ross . 1994 . Exploring the "planning fallacy": Why people underestimate their task completion times . Journal of Personality and Social Psychology . 67 . 366–381 . 3. 4222578 .
10.1080/14792779343000112 . Buehler . Roger . Dale Griffin . Michael Ross . 1995 . It's about time: Optimistic predictions in work and love . European Review of Social Psychology . 6 . 1–32.
Book: Buehler, Roger . Dale Griffin . Johanna Peetz . 2010 . The Planning Fallacy: Cognitive, Motivational, and Social Origins . Advances in Experimental Social Psychology . 43 . 1–62 . 2012-09-15 . 10.1016/s0065-2601(10)43001-4. 9780123809469 .
Buehler, Roger; Griffin, Dale, & Ross, Michael (2002). "Inside the planning fallacy: The causes and consequences of optimistic time predictions". In Thomas Gilovich, Dale Griffin, & Daniel Kahneman (Eds.), Heuristics and biases: The psychology of intuitive judgment, pp. 250–270. Cambridge, UK: Cambridge University Press.
Pezzo . Stephanie P. . Pezzo . Mark V. . Stone . Eric R. . 2006. The social implications of planning: How public predictions bias future plans . Journal of Experimental Social Psychology . 2006 . 2. 221–227 . 10.1016/j.jesp.2005.03.001.
Roy. Michael M.. Christenfeld. Nicholas J. S.. McKenzie. Craig R. M.. Underestimating the Duration of Future Events: Memory Incorrectly Used or Memory Bias?. Psychological Bulletin. en. 131. 5. 738–756. 10.1037/0033-2909.131.5.738. 16187856. 2005. 10.1.1.525.3506.
Sanna. Lawrence J.. Parks. Craig D.. Chang. Edward C.. Carter. Seth E.. The Hourglass Is Half Full or Half Empty: Temporal Framing and the Group Planning Fallacy.. Group Dynamics: Theory, Research, and Practice. 2005 . 9. 3. 173–188. 10.1037/1089-2699.9.3.173.
10.1037/0022-3514.78.5.821 . Focalism: A source of durability bias in affective forecasting. Journal of Personality and Social Psychology. 78. 5. 821–836. 2000. Wilson. Timothy D.. Wheatley. Thalia. Meyers. Jonathan M.. Gilbert. Daniel T.. Axsom. Danny. 10821192.
Jones. Larry R. Euske. Kenneth J . Strategic misrepresentation in budgeting. Journal of Public Administration Research and Theory. October 1991. 1. 4. 437–460. https://web.archive.org/web/20121216015031/http://jpart.oxfordjournals.org/content/1/4/437. dead. 2012-12-16. 11 March 2013.
Book: Taleb , Nassim . Antifragile: Things That Gain from Disorder . 2012 . Random House Publishing . 978-1-4000-6782-4 . registration .
https://www.bostonglobe.com/2021/04/01/opinion/bidens-transportation-projects-succeed-think-slow-act-fast/ For infrastructure projects to succeed, think slow and act fast
Allocating time to future tasks: The effect of task segmentation on planning fallacy bias. June 2008. Memory & Cognition. 10.3758/MC.36.4.791. 18604961. 36. 4. 791–798 . Forsyth . D. K.. free.
Web site: No Light at the End of his Tunnel: Boston's Central Artery/Third Harbor Tunnel Project. 1 February 1995. 7 November 2014. Project on Government Oversight. https://web.archive.org/web/20141108000402/http://www.pogo.org/our-work/reports/90s/tr-bigdig-19950201.html. 8 November 2014. dead.
News: Glen . Johnson . Governor seeks to take control of Big Dig inspections . Boston Globe . July 13, 2006 . July 13, 2006 . https://web.archive.org/web/20070311201155/http://www.boston.com/news/local/massachusetts/articles/2006/07/13/governor_seeks_to_take_control_of_big_dig_inspections . March 11, 2007.
Web site: Denver International Airport. September 1995. 7 November 2014. United States General Accounting Office.
News: Lehto . Essi . Buli . Nora . 2022-03-16 . Finland starts much-delayed nuclear plant, brings respite to power market . en . Reuters . 2023-04-23.
News: Lehto . Essi . 2023-04-15 . After 18 years, Europe's largest nuclear reactor starts regular output . en . Reuters . 2023-04-23.
News: Buli . Nora . 2021-08-23 . Finland's Olkiluoto 3 nuclear reactor faces another delay . en . Reuters . 2023-04-23.