Wisdom of Crowds in Predicting and Forecasting

Image Credit: slgckgc (Flickr)

Nobel Prizes, Election Outcomes and Sports Championships – Prediction Markets Try to Foresee the Future

Who will win Nobel Prizes in 2022? Wikipedia posits a handful of contenders for Physiology or Medicine, about 20 different possible winners for the Peace Prize and several dozen potential winners of the Literature Prize. But since the Swedish Academy never announces nominees in advance, there are few insights indicating who will win, or even if the eventual winner is on a given list.

Are there ways to predict the future winners?

The Delphi approach, named after the oracle in ancient Greece, gathers multiple rounds of opinions from a group of experts to generate a prediction. Gambling firms provide betting odds on the likelihood that specific competitors will win. Crowdsourced competitions, such as the Yahoo Soccer World Cup “Pick-Em,” have participants predict individual contest winners and then aggregate the results.

Another approach is a prediction market that provides insight into what people expect will happen in the future by creating a stock market-like environment to capture the “wisdom of the crowd.” Groups and crowds often are collectively smarter than individuals when many independent opinions are combined.

This article was republished  with permission from The Conversation, a news site dedicated to sharing ideas from academic experts. It represents the research-based findings and thoughts of Daniel O’Leary, Professor of Accounting and Information Systems, University of Southern California.

As an accounting and information systems professor at the University of Southern California, I investigate issues related to the crowd both in my research and in my teaching. Here’s how prediction markets harness what the crowd thinks to forecast the future.

The Wisdom of the Market

In prediction markets, participants buy and sell stocks. Each stock’s price is tied to a different event happening in the future. Information about the future is captured in the stock prices.

For instance, in a prediction market focused on the Nobel Peace Prize, maybe Greta Thunberg is trading at $0.10 while Pope Francis is trading at $0.15, and the stocks for the entire group of candidates add up to sum to $1. The prices reflect the traders’ aggregated beliefs about the probability of their winning – a higher price means a higher perceived likelihood of winning.

Examples of Prediction Markets

Anyone can get in on the prediction game by trading on one of these markets or even just checking out which stocks are up or down.

Market nameURLAffiliated university
Iowa Electronic Marketshttps://iemweb.biz.uiowa.edu/University of Iowa
PredictIthttps://www.predictit.org/University of Wellington
Hollywood Stock Exchangehttps://www.hsx.com/N/A
Polymarkethttps://polymarket.com/marketsN/A
Table: The Conversation, CC-BY-ND  Get the data

Prediction markets have various ways of setting stock prices. The Iowa Electronic Markets took following approach during the 2020 U.S. presidential election:

  • Stock DEM2020 pays off $1 if the Democratic candidate wins, and $0 otherwise,
  • Stock REP2020 pays off $1 if the Republican candidate wins, and $0 otherwise.

The stock prices capture the probabilities of each candidate winning, in two mutually exclusive events. If the price of DEM2020 is $0.52, then that is treated as the probability of that event occurring – a 52% chance. If DEM2020 is $0.52, then REP2020 is $0.48.

Prediction markets may use real money, or they can use play money. Google’s market used what it called “Goobles,” while the Hollywood Stock Exchange uses Hollywood Dollars. The Iowa Electronic Markets and PredictIt, both sponsored by universities, use real money. Researchers have found that there are no differences in the performance of markets using real money versus those using play money.

Although using play money makes it possible for many people to participate, one potential challenge for prediction markets that don’t use real money is gaining and maintaining interested participants. Despite using different devices to keep up engagement, such as leader boards indicating who has accumulated the biggest portfolio, there is literally no money on the table to keep participants interested in the market.

Market participants who know more about the game might better predict winners. Image Credit: Marco verch (Flickr)

Participants Bring Their Knowledge to the Market

Prediction markets and crowdsourcing do not function in a vacuum.

Researchers have found that information about events finds its way into the prediction processes from various sources. For example, when I analyzed the relationship between the betting odds and the Yahoo Pick-Em crowd’s guesses for the 2014 FIFA World Cup, I found that there was no statistical difference between the proportion of correct guesses in each. My conclusion is that either the crowd’s guesses incorporated the betting odds information or the crowd’s guesses added up to the same result by some other means.

Generally, prediction markets use play money or are run by non-profit universities to study markets, elections and human decision making. Although gambling houses can take bets for many activities, external prediction markets are more restricted in the activities they can be used to investigate, and are typically limited to elections. However, internal prediction markets – run within a corporation, for instance – can explore almost any topic of interest.

Typically, prediction markets function better with informed participants. Although using so-called inside information is illegal in some markets, including the New York Stock Exchange, there generally are no such limitations in prediction markets, or other crowdsourcing approaches. If those with inside information were to participate in a prediction market, it would likely lead to more accurate stock prices, as insiders make trades informed by their knowledge. However, if others find out that a participant has inside information, then they may very well try to gain access to that info, follow the insider’s actions or even decide to leave the unfair market.

The accuracy of prediction markets depends on many factors, including who is in the market, what their biases are and how heterogeneous the participants are. Accuracy can also depend on how many people are in the market – more is generally better – and the extent to which they are informed about the events of interest.

Researchers have found that prediction markets have outperformed polls in presidential elections roughly 75% of the time. But accurate results are not guaranteed. For example, prediction markets did not correctly predict that Donald Trump would win the U.S. presidency in 2016.

Who Will be in Stockholm for the Ceremony?

In 2011, Harvard University economics faculty had a real-money prediction market site, referred to as “the world’s most accurate prediction market.” The site had been used for predicting the Nobel Prize in Economics, but Harvard advised the site to shut down.

I couldn’t find any current public prediction markets active for the 2022 Nobel Prizes.

For the moment, perhaps the closest to participating in a Nobel prediction market would be to place a bet at one of the gambling houses that takes bets on the Nobel Prizes. Or find a Nobel Prize Pick-Em site, propose such an event to an existing prediction market or build your own prediction market using some of the available software.

If you know of one, let me know, I want to play.

Leave a Reply