Skeptical Football: Manning Redux, Ancient History And An Award For Tony Romo


Something marvelous has happened to me. I was transported to the seventh heaven. There sat all the gods assembled. As a special dispensation, I was granted the favor of making a wish. “What do you want?” asked Mercury. … “Choose — but only one thing.” For a moment I was bewildered; then I addressed the gods, saying: “My esteemed contemporaries, I choose one thing — that I may always have the laughter on my side.” Not one of the gods said a word; instead, all of them began to laugh. From that I concluded that my wish was granted and decided that the gods knew how to express themselves with good taste, for it would indeed have been inappropriate to reply solemnly: It is granted to you.

— Soren Kierkegaard, Either/Or Part 1

There’s nothing more satisfying than to have the Hacker Gods1 laugh at you, and that’s pretty much what this past weekend of NFL action entailed. So let’s get right to it.

Twitter question of the week

Following Peyton Manning’s costly interception with 2:25 left, down 5 points and in Seattle Seahawks territory, I took the opportunity to tweet the “Comeback King” chart from last week’s Skeptical Football column:

I intended to gently remind people that Manning far outpaces the field in big comebacks, and that taking risks like the one that led to his interception is likely one of the main reasons why.

But then things got crazy. Following a Seattle field goal, Manning got the ball back with less than a minute left, led the Broncos on an 80-yard touchdown drive in 41 seconds, and then scored on a two-point conversion to send the game to overtime. Twitter exploded. High drama, tempers flared, things were said.

Even before the Seahawks took the first OT possession down the field for a touchdown, a number of people were questioning Manning’s comeback cred. The chart I tweeted showed that Manning has come back to win 10 of the 41 games in which his team has fallen behind by 15 points or more, which compares favorably to Tom Brady doing the same in five of 25 chances. Several people seemed underwhelmed by this difference, with many pushing back like so:

Some enterprising tweeters also pointed out that Andrew Luck already has three comeback wins in 13 opportunities, good for 23 percent.

Granted, Manning’s comeback rate is only a few percentage points higher than Brady’s or Luck’s. But that doesn’t make it any less “special.” With the league average at just 5.6 percent, having 10 comebacks in 41 attempts is way, way more ridiculous and impressive than having five in 25.

And those are very carefully calculated “way”s.

Microsoft Excel has a function2 called binom.dist() that can easily tell you the probability of something happening a certain number of times in a certain number of tries (an issue that, in my experience, comes up about every five minutes in life). It’s probably more useful than a sonic screwdriver.

In this case, to find out the odds against each quarterback getting the number of wins he did, assuming they were all exactly as good as the league average,3 we plug in the numbers like so:

=1/(1-BINOM.DIST([Comeback wins]-1,[Comeback opportunities],[League average comeback rate],TRUE))

That spits out odds that lead to this chart:

morris-feature-nfl-wk3-1

Yes, that’s a logarithmic scale. It needs to be because Manning’s results are that much better.4

Peyton Manning’s 10 comebacks in 41 attempts is over 150 times less likely than Tom Brady’s five comebacks in 25.

To put that in perspective: The odds against an average quarterback duplicating Brady’s feat are roughly the same as the odds of a .500 team winning its first six or seven games of the season.5 The odds against duplicating Manning’s feat are the equivalent of a .500 team starting the season 14-0.6

Chart of the week

The NFL is now down to just three undefeated teams: the Philadelphia Eagles, the Cincinnati Bengals and Patrick Peterson’s Arizona Cardinals.

Of these, the Bengals have been the most dominant, winning their three games by an average of nearly 16 points.

The Eagles have needed three improbable comebacks (and as my colleague Neil Paine pointed out after Week 2 — and is still true now — they’ve spent most of this season trailing). However, the Eagles were a 10-6 team last year, and teams that start hot are far more likely to be successful if they have a track record.

Since 1990 (when the league introduced a salary cap) there have been 72 teams that started 3-0 after winning eight or more games the year before, and 57 have made the playoffs (79 percent). There have been 24 teams that started 3-0 after winning seven or fewer games the year before, and only 12 of them made the playoffs (50 percent).

Here are all the teams that have started 3-0 and whether they did or didn’t make the playoffs, arranged by the number of games they won the year before:

morris-feature-nfl-wk3-4

Indeed, given that a team has started the season 3-0, knowing how many wins it had the season before is about twice as valuable as knowing what its margin of victory was in its first three games of this season (more on this later).

While these probably wouldn’t have been the three teams most observers would have picked to start the season 3-0, they’re not really shocking either: The Bengals were 11-5 last year, and both the Cardinals and the Eagles were 10-6. While starting 3-0 certainly isn’t a guarantee of anything, immediate history suggests all three teams should be fine.

Rookie QB watch

This was quite a week for rookie QBs! The top four quarterbacks in this year’s draft all saw action.

As a reminder, my most basic criteria for evaluating a rookie quarterback’s career prospects (as discussed here, here, and here) are:

  • Starting = Good
  • Touchdowns = Good
  • Yards = Good
  • Wins = Don’t care
  • Interceptions = Don’t care
  • Completion percentage = Don’t care (possibly even a negative indicator, all else being equal)

Our leaderboard for “best career prospects,” — which, yes, I just invented — is shaken up considerably. It had been basically just draft order until the start of the season, with Derek Carr on top since then, but now …

  1. Blake Bortles is on the board, and has re-assumed the No. 1 position. In a loss (which, according to my analysis, doesn’t matter) against Indianapolis, he had two touchdowns (good), 223 yards (good) and has been named the starter for next week (more starts = more good). Importantly, he’s starting early enough that any advantage Carr had in the rankings from his early starts should now be nil. The relationship between the number of rookie starts and career prospects isn’t very linear — the main thing that matters is that a QB starts at least four games; then it’s marginally better for him to start eight, etc.
  2. After limited action, Teddy Bridgewater is looking like he’ll start this week as well.
  3. Meanwhile, Derek Carr hasn’t really been lighting it up. Carr has only three TDs in three games, and is averaging under 200 yards per game. At this point, the main thing he has going for him is starting earlier than the others, but his stock is slowly dropping because he hasn’t been more productive.
  4. But it will take a lot of bad play for Carr to drop behind our favorite underweight QB Johnny Manziel, who is looking less and less likely to get much action as a starter this year. Manziel was in for a nifty-looking trick play, which was called back for a penalty, and was probably illegal anyway. According to my rigorous and proprietary analysis, acting ability is not a statistically significant predictor of a rookie QB’s future success.

In case you missed it

If you haven’t read it, you should really click through to my colleague Neil Paine’s article from earlier this week that revisits the Greatest Show on Turf. I particularly liked this line: “The Rams anticipated what statistical analysts would eventually come to learn about football: Teams run when they win; they don’t win when they run.”

That’s a causal chiasmus that holds true for so many things about football.

Experimental chart of the week

In Skeptical Football Week 1, we posted a chart showing the percentage of teams with a given record making the playoffs (since updated), and also noted that the odds were considerably different if a team had gone 12-4 or better the previous season. We’re still at a point in this season where the previous year’s results matter a good deal.

We can combine each team’s results from this point in the season with its results from the previous season in a regression to see which is more important: what a team has shown over three games this year, or what it showed over 16 games the year prior. Using raw winning percentages or average margin of victory, we can predict wins or margin of victory for the remainder of the current season — which metric we use doesn’t really matter. Here, for the hobbyists at home, are a couple of examples of how to do these calculations yourself:

  • To predict a team’s average margin of victory over its next 13 games, you can take 0.23 times its average margin of victory over the first three games, and then add 0.29 times its average MOV for the previous season.
  • If you don’t have margins of victory to work with, you can predict a team’s winning percentage for the rest of the season like so: Start with a base of 30 percent, then add 0.18 times the first three games’ winning percentage and 0.22 times the team’s winning percentage from the previous year.

For the whole set of teams since 1990, the first three games of the current season and the entirety of the previous season are roughly about equally predictive.

But if we break the sample down by record, we can see that a disproportionate amount of the predictive work is being done by the 3-0 teams. Here’s a comparison of the previous season’s margin of victory with the percentage of games won over the remaining 13 games, broken down by number of wins after three games:

morris-feature-nfl-wk3-3

Note that in the red plot there are fewer outliers and the slope of the fit is steeper. (If you look just at 3-0 teams, the previous season’s record is about twice as important as the margin of victory the team put up over the first three games.) Pedigree appears to be even better at separating the contenders from the pretenders than it is at predicting team performance in general.

Gunslinger of the week

Kudos to previous Gunslinger of the Week awardees Andrew Luck and Matt Ryan, who both took out their aggression on lesser opponents, going off against Jacksonville and Tampa Bay, respectively, for a combined 52 of 63 for 656 yards and four TDs, with no INTs. The same mindset that leads to a game-costing interception today may lead to game-breaking touchdowns tomorrow.

But unlike the previous weekend, last week’s gunslinging produced more immediate results. Six quarterbacks won despite throwing interceptions (up from just one the week before). There’s nothing more exciting to me than seeing a QB who is scraping to get back in a game throw an interception, and then come back to win anyway — particularly if it’s a back-breaking pick-6.7

Which is why, in a stunning upset, the Gunslinger of the Week award goes to … Tony Romo. I know, right? I demand a recount! But so it is. Throwing a pick-6 when down 14 and then managing to come back from 21 down to win anyway is just too much to ignore, despite Peyton Manning’s late-game theatrics against Seattle. Romo’s heroics deserve acknowledgement.

Despite being one of the gunslingers fans most love to hate, Romo is actually a decent close-game QB. He has won 44 percent of games decided by less than a touchdown — no Brady (64 percent) or Manning (59 percent) to be sure, but better than the likes of Donovan McNabb, Carson Palmer, Philip Rivers, Kurt Warner, Aaron Rodgers and Matthew Stafford. Along with Matt Ryan, he’s one of only two players since 1990 to win a game despite throwing five interceptions (in 2007 against Buffalo).

Perhaps most interestingly, Romo has much better relative results in games when he throws one interception or more (where he wins 53 percent of the time) than in games where he doesn’t (where he wins 66 percent of the time).

morris-feature-nfl-wk3-5

Among quarterbacks with at least 40 starts since 2001, that’s the fifth-highest winning percentage in games with an interception (behind Donovan McNabb and Ben Roethlisberger as well as Brady and Manning).

Most empirically significant game of Week 4

This is a no-brainer for me: It’s the Eagles vs. the 49ers, for at least three reasons:

  1. Colin Kaepernick is the most empirically interesting “running QB” to watch, since he doesn’t play for an amazing team like his counterpart up the coast.
  2. So far, Kaepernick and Alex Smith have both had their “career” years in the eight games they each played with Randy Moss. The more difficult matchups we see Kaepernick play, the better we understand his true skill, and by extension Moss’s, and by domino effect that of many others.
  3. Any time a team wins a lot of close or comeback games, it gets interesting. This year, the Eagles are ground zero for the question of how much skill there is to winning in the NFL, aside from just scoring and allowing points.

Also, in a roundabout way, every time I watch the 49ers I feel like I learn something about the Seahawks, and what they’re all about is pretty interesting right now.

Charts by Reuben Fischer-Baum.