🐻⬇️🏀

Team models: held-out predictions

Every point is one game, predicted before it was played: each week's games are predicted by models refit on the season's earlier games only (modeling/evaluate_models.py, the same cohort as the leaderboard). The x axis is each model's implied margin: the league's points scale times the log-odds of its held-out home win probability (NCAA 7.25, NBA and WNBA 8.75, G League and EuroLeague 12.75, EuroCup 11.25). Only the margin and points families predict a native spread, and receipts evaluated before 2026-11-22 converted their spreads at 11 points per log-odd, so on those seasons an NCAA margin model's implied margin is 7.25/11 of its spread (fit slope near 1.3). Points open the game's box score where its box is stored, else that day's games. End-of-season fits are never plotted here. Model catalog · Player models · RAPM debugger.

Predicted (implied) vs actual margin

Home minus away; the dashed line is y = x, solid lines are each model's least-squares fit (slope under 1: the model's margins are too wide). Hover a point for the game; click it to open it.

Error over the season

Log loss on the winner (−ln of the winner's predicted probability), Brier, margin MAE and accuracy (a 50% pick counts half), averaged over each day's held-out games. Lower is better except accuracy.

Which seasons have held-out predictions

Plotted: seasons with a comparable full-season evaluation and its point set. The first three weeks of every season are training only (no predictions). Preseason priors are retrospective: when they were written is not recorded.

LeagueSeasons plottedRangeGamesProtocolNot plotted
NCAAM 38 1988-1989 to 2025-2026 154,630 weekly refits on shared v2 matchup states, retrospective preseason priors; weekly refits, no preseason prior; weekly refits, retrospective preseason prior blend 2026-2027 has not had enough games yet: results start once three weeks of games are in (the first holdout week is predicted from 21 days of earlier games)
NCAAW 22 2004-2005 to 2025-2026 90,438 weekly refits on shared v2 matchup states, retrospective preseason priors; weekly refits, no preseason prior; weekly refits, retrospective preseason prior blend 2026-2027 has not had enough games yet: results start once three weeks of games are in (the first holdout week is predicted from 21 days of earlier games)
NCAAMD2 6 2020-2021 to 2025-2026 18,730 weekly refits on shared v2 matchup states, retrospective preseason priors; weekly refits, retrospective preseason prior blend 2026-2027 has not had enough games yet: results start once three weeks of games are in (the first holdout week is predicted from 21 days of earlier games); 2019-2020: point set not built yet; 2018-2019: point set not built yet; 2017-2018: point set not built yet; 2016-2017: point set not built yet; 2015-2016: point set not built yet; 2014-2015: point set not built yet; 2013-2014: point set not built yet; 2012-2013: point set not built yet
NCAAWD2 0 - 0 - 2026-2027 has not had enough games yet: results start once three weeks of games are in (the first holdout week is predicted from 21 days of earlier games); 2025-2026: point set not built yet; 2024-2025: point set not built yet; 2023-2024: point set not built yet; 2022-2023: point set not built yet; 2021-2022: point set not built yet; 2020-2021: point set not built yet; 2019-2020: point set not built yet; 2018-2019: point set not built yet; 2017-2018: point set not built yet; 2016-2017: point set not built yet; 2015-2016: point set not built yet; 2014-2015: point set not built yet; 2013-2014: point set not built yet; 2012-2013: point set not built yet
NCAAMD3 0 - 0 - 2026-2027 has not had enough games yet: results start once three weeks of games are in (the first holdout week is predicted from 21 days of earlier games); 2025-2026: point set not built yet; 2024-2025: point set not built yet; 2023-2024: point set not built yet; 2022-2023: point set not built yet; 2021-2022: point set not built yet; 2020-2021: point set not built yet; 2019-2020: point set not built yet; 2018-2019: point set not built yet; 2017-2018: point set not built yet; 2016-2017: point set not built yet; 2015-2016: point set not built yet; 2014-2015: point set not built yet; 2013-2014: point set not built yet; 2012-2013: point set not built yet
NCAAWD3 0 - 0 - 2026-2027 has not had enough games yet: results start once three weeks of games are in (the first holdout week is predicted from 21 days of earlier games); 2025-2026: point set not built yet; 2024-2025: point set not built yet; 2023-2024: point set not built yet; 2022-2023: point set not built yet; 2021-2022: point set not built yet; 2020-2021: point set not built yet; 2019-2020: point set not built yet; 2018-2019: point set not built yet; 2017-2018: point set not built yet; 2016-2017: point set not built yet; 2015-2016: point set not built yet; 2014-2015: point set not built yet; 2013-2014: point set not built yet; 2012-2013: point set not built yet
NBA 31 1996-1997 to 2026-2027 32,833 weekly refits on shared v2 matchup states, retrospective preseason priors; weekly refits, no preseason prior; weekly refits, retrospective preseason prior blend -
WNBA 0 - 0 - 2026: point set not built yet; 2025: point set not built yet; 2024: point set not built yet; 2023: point set not built yet; 2022: point set not built yet; 2021: point set not built yet; 2020: point set not built yet; 2019: point set not built yet; 2018: point set not built yet; 2017: point set not built yet; 2016: point set not built yet; 2015: point set not built yet; 2014: point set not built yet; 2013: point set not built yet; 2012: point set not built yet; 2011: point set not built yet; 2010: point set not built yet; 2009: point set not built yet; 2008: point set not built yet; 2007: point set not built yet; 2006: point set not built yet; 2005: point set not built yet; 2004: point set not built yet; 2003: point set not built yet; 2002: point set not built yet; 2001: point set not built yet; 2000: point set not built yet; 1999: point set not built yet; 1998: point set not built yet; 1997: point set not built yet
GLEAGUE 0 - 0 - 2026-2027 has not had enough games yet: results start once three weeks of games are in (the first holdout week is predicted from 21 days of earlier games); 2025-2026: point set not built yet; 2024-2025: point set not built yet; 2023-2024: point set not built yet; 2022-2023: point set not built yet; 2021-2022: point set not built yet; 2020-2021: point set not built yet; 2019-2020: point set not built yet; 2018-2019: point set not built yet; 2017-2018: point set not built yet; 2016-2017: point set not built yet; 2015-2016: point set not built yet; 2014-2015: point set not built yet; 2013-2014: point set not built yet; 2012-2013: point set not built yet; 2011-2012: point set not built yet; 2010-2011: point set not built yet; 2009-2010: point set not built yet; 2008-2009: point set not built yet; 2007-2008: point set not built yet; 2006-2007: point set not built yet; 2005-2006: point set not built yet; 2004-2005: point set not built yet
EUROLEAGUE 0 - 0 - 2026-2027: point set not built yet; 2025-2026: point set not built yet; 2024-2025: point set not built yet; 2023-2024: point set not built yet; 2022-2023: point set not built yet; 2021-2022: point set not built yet; 2020-2021: point set not built yet; 2019-2020: point set not built yet; 2018-2019: point set not built yet; 2017-2018: point set not built yet; 2016-2017: point set not built yet; 2015-2016: point set not built yet; 2014-2015: point set not built yet; 2013-2014: point set not built yet; 2012-2013: point set not built yet; 2011-2012: point set not built yet; 2010-2011: point set not built yet; 2009-2010: point set not built yet; 2008-2009: point set not built yet; 2007-2008: point set not built yet
EUROCUP 0 - 0 - 2026-2027: point set not built yet; 2025-2026: point set not built yet; 2024-2025: point set not built yet; 2023-2024: point set not built yet; 2022-2023: point set not built yet; 2021-2022: point set not built yet; 2020-2021: point set not built yet; 2019-2020: point set not built yet; 2018-2019: point set not built yet; 2017-2018: point set not built yet; 2016-2017: point set not built yet; 2015-2016: point set not built yet; 2014-2015: point set not built yet; 2013-2014: point set not built yet; 2012-2013: point set not built yet; 2011-2012: point set not built yet; 2010-2011: point set not built yet; 2009-2010: point set not built yet; 2008-2009: point set not built yet; 2007-2008: point set not built yet