๐Ÿปโฌ‡๏ธ๐Ÿ€

2025-2026 NCAAMD2 Model Performance

2026-2027 has not had enough games yet: results start once three weeks of games are in (the first holdout week is predicted from 21 days of earlier games). Showing 2025-2026, the newest season with results.

Every ranked model predicted the same 3618 games (2025-11-24 to 2026-04-05, 19 weekly windows) out of sample: each week's games were predicted by models fit only on the season's earlier games. 89 of 3707 games are left out because a model had no rating for a team yet.

Model Catalog

Model Performance Leaderboard

Ranked by full-season AUC. The final week is the season's last 7 played days (1 games, 2026-03-30 to 2026-04-05), predicted from every earlier game: a small sample that shows the latest form.

# Model AUC Acc Brier LogLoss AUC final wk Acc final wk
1 Points Off/Def Points Off/Def Raw points regression with separate offensive and defensive team parameters. More โ†’ 0.804 72.1% 0.184 0.546 - 100.0%
2 Margin Margin Linear team-strength model fit on point differential instead of binary wins. More โ†’ 0.802 72.2% 0.183 0.544 - 100.0%
3 Margin Recency Margin Recency Margin regression with exponential recency weights on newer games. More โ†’ 0.801 72.3% 0.184 0.545 - 100.0%
4 Points Off/Def Recency Points Off/Def Recency Off/def points regression with exponential recency weights. More โ†’ 0.800 72.1% 0.185 0.550 - 100.0%
5 Core Ensemble Core Ensemble Equal-logit blend of Elo, recency BT, recency margin, log-adjusted pyth, and points off/def. More โ†’ 0.796 71.5% 0.185 0.547 - 100.0%
6 Recency Ensemble Recency Ensemble Equal-logit blend of Elo, recency BT, recency margin, log-adjusted pyth, and recency points off/def. More โ†’ 0.796 71.5% 0.185 0.547 - 100.0%
7 Adjusted Context Blend Adjusted Context Blend Experimental context-heavy win model blending strong team components with rest and venue context. More โ†’ 0.790 72.2% 0.193 0.584 - 100.0%
8 Adjusted Efficiency Adjusted Efficiency Opponent-adjusted efficiency model with separate offensive and defensive components. More โ†’ 0.785 71.0% 0.195 0.579 - 100.0%
9 Log Adjusted Log Adjusted Log-scale adjusted efficiency model that downweights blowout leverage. More โ†’ 0.784 70.9% 0.195 0.580 - 100.0%
10 Dynamic Bradley-Terry Dynamic Bradley-Terry Time-evolving paired-comparison model with latent team strength drift. More โ†’ 0.769 69.7% 0.196 0.576 - 100.0%
11 Avg Margin Baseline Avg Margin Baseline Predict from simple average scoring margin in the training window. More โ†’ 0.766 69.5% 0.197 0.576 - 100.0%
12 Bradley-Terry Bradley-Terry Static logistic paired-comparison model with one team strength parameter. More โ†’ 0.764 69.0% 0.198 0.579 - 100.0%
13 Elo Elo Streaming paired-comparison rating with recency baked into sequential updates. More โ†’ 0.762 68.5% 0.200 0.583 - 100.0%
14 Bradley-Terry Recency Bradley-Terry Recency Static Bradley-Terry with exponential recency weights on newer games. More โ†’ 0.758 69.0% 0.201 0.589 - 100.0%
15 Pythagorean Pythagorean Pythagorean win expectation from raw points scored and allowed. More โ†’ 0.756 69.5% 0.204 0.592 - 100.0%
16 Home Team Baseline Home Team Baseline Always favor the home team with a fixed prior. More โ†’ 0.601 60.1% 0.240 0.672 - 100.0%
- Efficiency Efficiency Tempo-adjusted efficiency version of Pythagorean ratings. More โ†’
not compared: predicted 0 of 3707 games
- - - - - -

Methodology

Out-of-sample windows

  • The season is split into 7-day windows ending on its last played day
  • Each window is predicted by models refit on all earlier games of the season
  • The first window starts after 21 days of games
  • Every model is scored on the same games; a model that cannot predict most of them is listed as not compared

Elo / Bradley-Terry

  • Elo: the published league Elo (preseason priors and carryover where configured), frozen at the window start
  • Bradley-Terry: static logistic fit on the earlier games
  • Recency variants weight games with a 30-day half-life

Pythagorean and margin models

  • Raw, adjusted and log-adjusted Pythagorean from scores; efficiency from box-score possessions
  • Margin: ridge regression on point margin with a learned home advantage
  • Ensembles average the log-odds of five families

Baselines

  • Home Team: the home team wins 60% (50% at neutral sites)
  • Avg Margin: the higher average margin so far wins
  • Models should beat these to add value