Why might forecasting research and implementation be high impact?

Governments and other important institutions frequently have to make complex, high-stakes decisions based on judgement calls, often from just a handful of people. There’s reason to believe that human judgements can be flawed in a number of ways, but can be substantially improved using more systematic processes and techniques. One of the most promising areas we’ve seen is using more rigorous forecasting methods to make better predictions about important future events. Improving the quality of foresight and decision-making in important institutions could improve our ability to solve almost all other problems.

We’d like to help form a new community of researchers and practitioners who develop and implement these techniques. We’re especially keen to help people who want to work on the areas most relevant to global catastrophic risks, such as nuclear security, AI, and biorisk.

Note that we’re not talking about the popular ‘nudge’ work in behavioural sciences, which is focused on making small improvements to personal behaviours. Rather, we’re interested in neglected work relevant to high-stakes decisions like whether to go to war, such as Tetlock’s research into forecasting.

What does this path involve?

There are two main options in this path:

1. Developing better forecasting and decision-making techniques, and testing those that already exist.
2. Applying the most effective techniques in important organisations, especially those working on catastrophic risks.

Developing better techniques and testing existing ones:
This means doing research to:

• Develop new techniques and approaches to improve judgement and decision-making, and then testing them.
• Getting stronger evidence about whether techniques that already exist are actually effective and in what circumstances, such as calibration training, structured analytic techniques, methods of aggregating expert judgements like Roger Cooke’s Classical Model for Structured Expert Judgement, and the Delphi method.

Practically speaking, this probably means trying to get a position at a behavioural science research lab interested in working on these kinds of questions (which would very likely require getting a PhD in psychology or related area of behavioural science).

Getting the best proven techniques adopted in high-impact areas:
Someone trying to get proven techniques implemented might start by working in the types of organisations for which improved decision-making is especially important. This is because knowing which changes will have the biggest impact and which are most feasible will require a deep understanding of the practical constraints and incentives of different groups working on important problems.

Alternatively, you could also try to test and implement improved decision-making techniques in a range of organisations as a consultant (for example, at The Behavioural Insights Team, ideas42, Hubbard Decision Research, Good Judgment, and Hypermind).

You can also consider being an advocate for the adoption of better practices across government and organisations, or for improved decision-making more generally by working as a journalist or public intellectual.

Read more about what these options look like in our problem profile on improving institutional decision-making.

Examples of people pursuing this path

How to assess your fit?

To assess if this path might be a good fit for you, consider these questions:

• Might you be able to get a job in a relevant area of government?
• Do you know how to influence choices within a bureaucracy?
• On the research path, do you have a chance of getting into a relevant PhD at a top 30 school?
• On the research path, do you have a chance at making a contribution to one of the relevant research questions? For instance, are you highly interested in the topic, and sometimes have ideas for questions to look into? Are you able to work independently for many days at a time? Are you able to stick with or lead a research project over many years? Read more about predicting success in research.

How to enter

The first step is to gain relevant expertise. This is most naturally done by working on relevant techniques in a lab like Tetlock’s, or studying other important decision-making processes in a graduate programme. However, you could also take a more practical route by starting your career in government and policy, and learning about the science on the side.

Once you have the expertise, you can either try to make progress on key research questions in the field, or work with an important organisation to improve their processes. We can introduce you to people working on this.

This is a nascent field that could become much bigger, and now is an exciting time to get involved.

Recommended organisations

• AI Impacts works on forecasting progress in machine intelligence and predicting its likely impacts. See current vacancies.
• The Decision Lab is a socially conscious applied research firm that is dedicated to empowering the world to make better decisions. See current vacancies.
• Good Judgment was cofounded by Professor Philip Tetlock. This for-profit company maintains a global network of elite ‘superforecasters’ who collaborate to tackle clients’ forecasting questions with unparalleled accuracy.
• Metaculus is a community dedicated to generating accurate predictions about future real-world events by aggregating the collective wisdom, insight, and intelligence of its participants. See current vacancies.
• Open Philanthropy uses an approach inspired by effective altruism to identify high-impact giving opportunities across a wide range of problem areas, shares this research freely online, and uses it to advise top philanthropists on where to give. See current vacancies. Disclaimer of conflict of interest: we have received a grant from Open Philanthropy.
• The Quantified Uncertainty Research Institute aims to advance forecasting and epistemics to improve the long-term future of humanity, which it does by conducting research and making software.

Want one-on-one advice on pursuing this path?

Because this is one of our priority paths, if you think this path might be a great option for you, we’d be especially excited to advise you on next steps, one-on-one. We can help you consider your options, make connections with others working in the same field, and possibly even help you find jobs or funding opportunities.

APPLY TO SPEAK WITH OUR TEAM

Find jobs in forecasting research and implementation

If you think you might be a good fit for this path, see our curated list of job opportunities on our job board.

Learn more

Top recommendations

• Prof Tetlock on predicting catastrophes, why to keep your politics secret, and when experts know more than you
• Podcast: Accurately predicting the future is central to absolutely everything. Professor Tetlock has spent 40 years studying how to do it better
• Superforecasting: The Art and Science of Prediction by Philip Tetlock and Dan Gardner (2016)

Further recommendations