How Our 2016 MLB Predictions Work

During last year’s MLB playoffs, we introduced our baseball Elo ratings and used them to take a look at the best teams going into the playoffs and the World Series. Today we’re publishing two interactives using similar ratings: our 2016 MLB Predictions, which preview upcoming games and show the chances that each team will make the playoffs or win the World Series, and the Complete History Of MLB, which charts the successes and failures of every franchise throughout history.

Thanks to Retrosheet, we’ve collected game results and box scores back to 1871 and used them to create an Elo-based rating system and predictive model for baseball that incorporates home-field advantage, margin of victory, travel, rest and — most importantly — starting pitchers. The ratings are also adjusted for park and era effects and account for the fact that favorites are more likely to win in the postseason than in the regular season.

Elo is a simple but elegant system that can be tuned and customized endlessly to incorporate available data. In our baseball Elo system, each team has a rating (the average is about 1500), and after every game, the winning team gains some Elo points while the losing team loses the same number of points. The number of points exchanged is based on the chances our model gave each team to win the game and the margin of victory; a win by a big underdog results in a bigger exchange of Elo points than a win by a favorite, and the larger the margin of victory, the larger the exchange.

Before every game, we also adjust each team’s rating based on whether it has home-field advantage, how far it’s traveled to the game, how many days of rest it’s had and which pitcher is slated to start.

Home-field advantage is worth 24 Elo points in our model, and travel and rest adjustments are worth up to about 5 points each; these three components are combined into the “Home field, travel and rest” section in the image above.³²

Starting pitcher adjustments can have a substantial impact on pre-game team ratings and win probabilities. For example, in June of 2000, Pedro Martinez was worth about 109 Elo points to the Red Sox each time he started, which is the equivalent of a 15 percent boost to their chances of winning the game. This means Martinez was worth 109 points more than the average starting pitcher on his team (or even a bit more, since his starts were already incorporated into the team’s overall rating).

To generate these pitcher adjustments, we’re using a version of Bill James’s game scores proposed by Tangotiger (and slightly modified by us) to isolate pitching performances. After each game, the starting pitcher’s game score is calculated as:

47.4 + 1.5*outs + strikeouts – 2*walks – 2*hits – 3*runs – 4*homeruns

We maintain a running average of these game scores for each pitcher to produce his overall pitcher score. Here’s a list of the pitchers with the highest peak scores in history, the dates when they peaked and their corresponding Elo bonus:

Pitchers in the table above are listed only once, at their absolute peak. If we listed multiple peaks per player, Martinez, Greg Maddux, Randy Johnson and Roger Clemens would occupy 18 of the top 20 spots.

In addition to scores for each pitcher, we maintain a pitching score for every team — these are based on the game scores of every starting pitcher on that team. Each pitcher’s Elo adjustment is relative to his team’s pitching score; pitchers above the team average give the team a bonus when they start, and pitchers below the team average give the team a penalty. Note that in the table above, one pitcher may have a higher overall score than another pitcher but a smaller Elo adjustment; this generally means that his team had a better rotation or that he started more games and his game scores contributed more to the team’s overall average.

These are the 2016 pitchers who give their team the biggest boost when they start:

Since starting pitcher bonuses from the two teams are additive, they cancel each other out when two top pitchers face each other and can be quite large when a strong pitcher faces a weak pitcher. The biggest mismatch of all time according to our pitcher scores was a 137-point Elo swing back in 1997, when Randy Johnson (+87) faced Ricky Bones (-50).

Our 2016 preseason team ratings are a blend of our 2015 end-of-season ratings (reverted to the mean by one-third) and four projection systems (PECOTA, ZiPS, Steamer and Davenport). Our preseason team pitcher scores use our 2015 end-of-season pitcher scores combined with projected starts from the same four projection systems.

We use Monte Carlo simulations to play out the season thousands of times to see how often each team makes the playoffs or wins the World Series. As with our other forecasts, we run simulations “hot,” meaning that a team’s rating changes within each simulation based on simulated results, including the bonus for playoff wins. For games where a starting pitcher is not yet known, we assume a pitcher of average strength will play.

Our Complete History Of MLB uses a slightly simplified Elo system that doesn’t take pitchers, travel or rest into account. Like the forecast, it will update after each game.

It’s early, but the Cubs are looking pretty good. We’re looking forward to the rest of the season and hope you’ll follow along with us.