Did The Packers Squander Aaron Rodgers?


The dismissal of Green Bay coach Mike McCarthy — who was let go after the Packers’ stunning home loss to the Arizona Cardinals on Sunday — wasn’t exactly a shock. Perennially tabbed as a Super Bowl contender out of the NFC, McCarthy’s team had gone just 11-16-1 over the past two seasons, including a disappointing 8-9-1 in games that featured future Hall of Fame quarterback Aaron Rodgers as Green Bay’s primary passer.59 It was time for a change along the sidelines that Vince Lombardi once roamed.

Things weren’t always so bleak on the frozen tundra. The McCarthy era had its high points, particularly early on — when he and Rodgers appeared to have Green Bay positioned on the cusp of a potential dynasty. But between postseason near-misses, roster changes, injuries and coaching miscues, McCarthy’s Packers never fulfilled that promise. Instead, it’s fair to wonder whether Green Bay squandered the prime of one of the most talented QBs in NFL history.

The Packers team that McCarthy inherited in 2006 from Mike Sherman60 was one in transition — and that meant navigating some heavy-duty Brett Favre melodrama in his first two seasons at Green Bay’s helm. However, McCarthy quickly found that he had an all-time great on his hands in Rodgers, who, when he took over the starting job at age 25, was just entering his best years as a passer. The McCarthy-Rodgers marriage sputtered to a 6-10 finish in its first season but yielded great results shortly thereafter: an 11-5 playoff campaign in Year 2, then a Super Bowl crown in Year 3 and a 15-1 regular season (with Rodgers winning MVP) in Year 4. The sky seemed to be the limit for McCarthy and his star QB.

Since the end of the 2011 regular season, however, the Packers have gone just 5-6 in the playoffs; by comparison, Tom Brady and the postseason Patriots are 13-5 over the same span. Green Bay’s record includes a crushing home defeat against the New York Giants two weeks after that 15-1 season ended and another loss in which they watched helplessly as ex-49er Colin Kaepernick destroyed their defense in 2012 — still one of the greatest individual QB games in playoff history. The Packers’ postseason circumstances have not always been ideal: For instance, that Giants game was actually the only time since 2011 that Green Bay lost in the playoffs while favored — meaning the rest of the losses were as underdogs. But at the same time, the Pack have also had clear chances to return to the Super Bowl, and they came up short in each of them.

All told, it remains mystifying that a quarterback of Rodgers’s stature hasn’t won more frequently. If we run a simple logit regression between a QB’s Yards Above Backup in a season and whether his team made the Super Bowl,61 we’d expect Rodgers to have made 1.86 Super Bowls in his career through 2017 — roughly twice as many as he’s actually been to. (Meanwhile, other contemporary QBs — such as Ben Roethlisberger, Eli Manning and even Brady — have gone to more than twice as many Super Bowls as we’d expect from their individual stats.)

Rodgers hasn’t won as much as he should have

Top 10 NFL starting quarterbacks by Yards Above Backup QB, 1990-2017, with their actual and expected Super Bowl appearances

Super Bowls Made
Quarterback Years Starting YARDS Above Backup Actual Expected Diff.
1 Peyton Manning 17 21,585 4 4.15 -0.15
2 Tom Brady 16 19,735 8 3.63 +4.37
3 Drew Brees 16 17,250 1 2.89 -1.89
4 Brett Favre 19 13,047 2 1.86 +0.14
5 Aaron Rodgers 10 10,988 1 1.86 -0.86
6 Ben Roethlisberger 14 10,945 3 1.35 +1.65
7 Philip Rivers 12 10,721 0 1.54 -1.54
8 Steve Young 8 10,022 1 1.65 -0.65
9 Matt Ryan 10 8,251 1 1.14 -0.14
10 Tony Romo 9 8,192 0 1.11 -1.11

1990 was the first season of the NFL’s current playoff format. Expected Super Bowls are based on a season-by-season logit regression between a QB’s Yards Above Backup and whether his team made the Super Bowl.

Source: Pro-Football-Reference.com

Over time, it became more and more difficult for the Packers to come within striking distance of the Super Bowl. In 2015, Rodgers slumped to career-worst numbers without top wideout Jordy Nelson, though the team as a whole was still good enough to get to the divisional playoffs before losing. In 2016, it was more of the same when Rodgers mused that Green Bay could still “run the table” — sparking an eight-game winning streak that saw the QB return to vintage form and left the Packers a win away from the Super Bowl.62 By then Rodgers was 34 years old, so a sense of urgency was setting in when 2017 came and went without a playoff berth — even though that could be written off as the byproduct of Rodgers missing nine starts.

The 2018 season was always going to be the real crossroads for McCarthy. With a healthy Rodgers leading the way, the Pack could always count on contending in the past, so this year’s expectations were no different. But Rodgers’s numbers have been merely good, not great. Brett Hundley isn’t around anymore to take any blame. And unlike in 2015, when Green Bay was talented enough to survive despite a downturn in its QB’s individual stats, there has been no answer from the team’s supporting cast this time around. It all came crashing down around McCarthy in the loss to Arizona as 13½-point favorites, Green Bay’s single most disappointing defeat since the merger according to Pro-Football-Reference’s point-spread data.

We can visualize the Packers’ decline over McCarthy’s final few years at the helm using FiveThirtyEight’s Elo ratings. Specifically, I’ve been tinkering with an experimental version of Elo that keeps a separate adjustment for the primary QB in each game, similar to how we treat starting pitchers in our MLB ratings.63 Using this, we can trace how a team’s performance rises and falls independent of its QB — which is useful in cases like 2017, when Rodgers was hurt and Hundley started nine games. (For instance, by season’s end, the Packers would have projected to be a 1529 Elo team with Rodgers starting — compared to a 1427 team with Hundley. And remember, 1500 is average.)

At the beginning of 2015, the Packers had an effective Elo of 1622, which included a 73-point boost from having Rodgers at QB and a 49-point boost from his teammates. By the end of the year, Green Bay’s effective Elo was still in the same neighborhood (1597), despite Rodgers’s adjustment actually dropping to negative 11, because the rest of the team carried a larger share of the weight (+108). Meanwhile, at the peak of the Packers’ run-the-table surge in 2016, the team’s 1657 effective Elo arose out of a 61-point boost from Rodgers and 97 additional points (relative to league average) from the rest of the team.

But fast-forward to now, and it’s clear how much the Packers have crumbled around Rodgers. His own adjustment is 16 points of Elo above an average QB, the lowest it’s been since Week 10 of the 2016 season. But he’s still expected to be above average; his supporting cast, by contrast, has fallen to a negative-67 score relative to the average team. That’s the worst they have been in Rodgers’s entire NFL career, and it isn’t especially close. Keeping QB play constant, the Packers’ Elo has dropped by a total of 139 points since the end of the 2016 season, which is essentially the difference in current Elo ratings of the 11-1 Los Angeles Rams and the 6-6 Carolina Panthers.

The reasons for the slide are varied, but many can be traced back to a series of poor drafts under former general manager Ted Thompson, who was replaced by current front-office chief Brian Gutekunst in January. As Sports Illustrated’s Kalyn Kahler pointed out last week, only three of Green Bay’s 17 draftees from 2014 and 2015 remain on the current roster. While no team can avoid dry spells in the NFL draft if given enough time, the Packers also — largely by design — did little in the way of enlisting outside help as a backup plan.64 Combine those infrastructural problems with criticisms of McCarthy’s offensive scheme (criticisms of a perceived lack of innovation that Rodgers apparently shared), plus legitimate complaints about Rodgers’s own decline in performance, and a season like this was bound to happen to Green Bay sooner or later.

Even so, it came contrary to preseason predictions. Going into the schedule, you might have penciled in this week’s matchup against the Atlanta Falcons as a marquee game with playoff implications. Instead, it will be the third-worst game of the week, according to our combination of matchup quality (i.e., the harmonic mean of the teams’ Elo ratings in each game) and game importance (how likely it is to swing every team’s odds of making the playoffs):65

The best matchups of Week 14

Week 14 games by the highest average Elo rating (using the harmonic mean) plus the total potential swing for all NFL teams’ playoff chances based on the result, according to FiveThirtyEight’s NFL predictions

Playoff % Playoff %
Team A Current Avg. Chg* Team B Current Avg. Chg* Total Change Game Quality
BAL 65.0% +/-15.1 KC 100.0% +/-0.0 31.8 1628
PHI 28.3 24.2 DAL 81.1 19.4 51.0 1578
MIN 59.7 19.9 SEA 87.7 11.8 41.4 1572
CHI 94.4 4.3 LAR 100.0 0.0 10.8 1615
IND 9.8 10.1 HOU 98.2 2.4 23.6 1515
MIA 6.6 7.4 NE 99.7 0.5 16.2 1537
WSH 26.4 11.7 NYG 0.1 0.1 24.9 1435
TB 1.7 2.0 NO 100.0 0.0 6.9 1570
TEN 18.9 10.6 JAX 0.1 0.1 21.9 1478
PIT 83.8 11.0 OAK 0.0 0.0 23.7 1453
CAR 17.8 9.9 CLE 0.3 0.4 22.0 1454
DEN 20.9 11.1 SF 0.0 0.0 24.7 1427
LAC 96.0 3.6 CIN 0.9 1.3 9.1 1504
GB 1.4 1.3 ATL 1.1 1.2 5.5 1469
DET 0.3 0.3 ARI 0.0 0.0 4.2 1412
BUF 0.0 0.0 NYJ 0.0 0.0 2.4 1377

Game quality is the harmonic mean of the Elo ratings for the two teams in a given matchup. Total Change adds up the potential swing in playoff odds for every team in the league (not just the two teams listed).

*Average change is weighted by the likelihood of a win or loss. (Ties are excluded.)

Source: ESPN.com

Although the Packers hadn’t replaced a coach at midseason since 1953, Sunday’s loss forced their hand. Now they’ll need to figure out who’s next, from a candidate list that includes big names among both pro coordinators (Josh McDaniels) and up-and-coming college coaches (Lincoln Riley). They’ll also need to hope Rodgers’s issues were more related to McCarthy’s offense and less to his getting older and less productive — basically, that the next Packer coach will be more Mike Shanahan to Rodgers’s John Elway than Jimmy Johnson to his Dan Marino. So while the Packers may not have much on the line over the rest of their games, this promises to be the most interesting offseason Green Bay has had since Favre was retiring and unretiring more than a decade ago.

FiveThirtyEight vs. the readers

Make sure to check out FiveThirtyEight’s Elo ratings using our NFL prediction interactive, which simulates the rest of the season 100,000 times and tracks how often each team should make the playoffs and win the Super Bowl. And did you know you can also pick against the Elo algorithm in our prediction game? Maybe you can also climb up our giant leaderboard (or, if you’re like me, fall down it with each passing week).

Here are the games in which Elo made its best — and worst — predictions against the reader picks last week:

Elo’s dumbest (and smartest) picks of Week 13

Average difference between points won by readers and by Elo in Week 13 matchups in FiveThirtyEight’s NFL prediction game

OUR PREDICTION (ELO) READERS’ PREDICTION
PICK WIN PROB. PICK WIN PROB. Result READERS’ NET PTS
CIN 52% DEN 59% DEN 24, CIN 10 +8.5
PIT 62 PIT 54 LAC 33, PIT 30 +6.7
LAR 68 LAR 79 LAR 30, DET 16 +4.1
ATL 53 ATL 50 BAL 26, ATL 16 +1.5
KC 83 KC 89 KC 40, OAK 33 +0.4
SEA 83 SEA 83 SEA 43, SF 16 -1.5
MIA 58 MIA 57 MIA 21, BUF 17 -2.3
NE 67 NE 65 NE 24, MIN 10 -3.8
PHI 69 PHI 66 PHI 28, WSH 13 -4.1
TEN 78 TEN 72 TEN 26, NYJ 22 -4.4
CHI 69 CHI 72 NYG 30, CHI 27 -6.1
HOU 77 HOU 69 HOU 29, CLE 13 -6.6
CAR 59 CAR 64 TB 24, CAR 17 -7.8
GB 73 GB 79 ARI 20, GB 17 -10.5
IND 51 IND 62 JAX 6, IND 0 -14.0
NO 64 NO 74 DAL 13, NO 10 -15.3

Home teams are in bold.

The scoring system is nonlinear, so readers’ average points don’t necessarily match the number of points that would be given to the average reader prediction.

After a series of narrow wins at midseason, the algorithm handed the readers their worst loss (-55.2 points on average) since Week 3. Some of the blame can go to the subject of this column — the Green Bay Packers, whose loss not only cost Mike McCarthy his job but also cost users 10.5 points on average. But readers were also burned by the Jaguars’ win over the Colts and the Cowboys’ upset victory over the Saints. Add it up, and Elo has beaten the average reader 12 times in 13 weeks this season.

But congrats to Mike Edelstein, who led all users in Week 13 with 137.0 points, and to one of my favorite leaderboard names, Greg Chili Van Hollebeke, who maintained his No. 1 ranking on the season with 1,002.1 points. Thanks to everyone who has been playing — and if you haven’t, be sure to get in on the action! You can make picks now and still try your luck against Elo, even if you haven’t played yet.

Check out our latest NFL predictions.