Superforecasting

Superforecasters looking out three hundred days were more accurate than regular forecasters looking out one hundred days.

Superforecasters looking out three hundred days were more accurate than regular forecasters looking out one hundred days. Superforecasters are real. The Good Judgment Project, a forecasting tournament sponsored by IARPA, discovered that some individuals consistently outperform others in predicting geopolitical events. These "superforecasters" beat not only average forecasters but also prediction markets and even professional intelligence analysts with access to classified information. Characteristics of superforecasters: High cognitive abilities and knowledge Active open-mindedness Granular thinking Regular belief updating Strong teamwork skills Probabilistic thinking Ability to break down complex problems Superforecasters are not infallible, but they demonstrate that accurate forecasting is a skill that can be cultivated and improved with practice and the right mindset.

Regular forecasters scored higher on intelligence and knowledge tests than about 70% of the population. Superforecasters did better, placing higher than about 80% of the population. Intelligence matters, but only to a point. While superforecasters tend to score higher on intelligence and knowledge tests, these factors alone do not explain their superior performance. Many highly intelligent and knowledgeable individuals fail to make accurate predictions. The key difference lies in how superforecasters use their cognitive abilities: They actively seek out diverse perspectives They constantly question their own assumptions They focus on process rather than outcomes They are willing to admit mistakes and change their minds This suggests that while a certain level of intelligence and knowledge is necessary for good forecasting, what truly sets superforecasters apart is their approach to thinking and decision-making.

For superforecasters, beliefs are hypotheses to be tested, not treasures to be guarded. Embracing uncertainty is key. Superforecasters cultivate a mindset of active open-mindedness, which involves: Constantly seeking out information that might prove their beliefs wrong Welcoming criticism and alternative viewpoints Adjusting their beliefs in light of new evidence Avoiding ideological commitments that might blind them to contrary information This approach helps superforecasters avoid common cognitive biases such as confirmation bias and overconfidence. By treating their beliefs as provisional hypotheses rather than fixed truths, they remain flexible and responsive to changing circumstances.

Superforecasters often think in terms of precise probability estimates, like 63% versus 65%, rather than vague terms like "likely" or "unlikely." Precision enhances accuracy. Superforecasters distinguish between fine degrees of uncertainty, often using probability estimates down to single percentage points. This granular thinking forces them to: Carefully consider the strength of their evidence Avoid vague language that can mask uncertainty Make more precise and testable predictions Benefits of granular thinking: Allows for more nuanced updates as new information emerges Facilitates clearer communication about levels of certainty Enables more accurate aggregation of multiple forecasts By thinking in…