Good Judgment Open vs Metaculus

Good Judgment Open (GJ Open) was launched in 2015 as the public-facing forecasting portal of Good Judgment Inc, a commercial spin-off originating from the landmark Good Judgment Project (GJP). Co-founded by Wharton professors Philip Tetlock and Barbara Mellers alongside UC Berkeley professor Don Moore, the platform stems from research funded by the US Intelligence Advanced Research Projects Activity (IARPA) Aggregative Contingent Estimation (ACE) tournament, which demonstrated that well-calibrated crowd ensembles systematically outperformed professional intelligence analysts.

Unlike financial orderbook prediction exchanges that rely on real-money or cryptocurrency pricing, GJ Open operates as a non-monetary, probability-based forecasting engine. Participants submit percentage probabilities on complex geopolitical, macroeconomic, public health, and environmental questions. Individual predictions are tracked over time and evaluated using Brier accuracy scores—a mathematical metric measuring probabilistic calibration and resolution accuracy.

Full profile: Good Judgment Open →

Metaculus was founded in November 2015 by three scientists at UC Santa Cruz: astrophysicist Anthony Aguirre, astronomer Greg Laughlin, and data scientist Max Wainwright. Aguirre had co-founded the Future of Life Institute the previous year — the organization that famously published the open letter signed by Stephen Hawking and Elon Musk calling for a pause on certain AI research. Metaculus was conceived as a companion instrument: if FLI was going to warn about existential risks, it needed a rigorous way to aggregate what the best thinkers actually believed the probabilities were. The founding insight was different from prediction markets in one essential way. On Polymarket or Kalshi, you risk money. On Metaculus, you risk your reputation. Aguirre's argument was that reputation, properly tracked and scored, produces calibration without the distortions that financial incentives introduce — and that some of the most important questions facing humanity are too long-horizon for any market to price.

The platform grew slowly through the late 2010s, primarily in the effective altruism and rationalist communities — people who took probabilistic reasoning seriously as a practice rather than a theory. COVID-19 changed the scale. When the pandemic began in early 2020, Metaculus launched dedicated epidemiological forecasting tracks. The platform's aggregate predictions on case counts, mortality rates, and vaccine timelines were referenced by public health researchers and, eventually, by organizations that had previously treated crowd forecasting as a curiosity. By 2022, Metaculus had received $5.6 million in grants from Open Philanthropy and over $300,000 from Effective Altruism Funds. Total funding exceeded $8.5 million from Coefficient Giving by 2023.

Full profile: Metaculus →