And Now, The Roy Awards For The Best NHL Playoff Goaltending Performances


UPDATE (May 14, 7:28 a.m.)Game 7 between the Rangers and Capitals on Wednesday night featured more top-notch goaltending from Lundqvist (35 saves) and Holtby (37 saves). The Rangers won 2-1 — every game in the series was decided by one goal — and both goalies beat their combined save percentage for the series.

 

Who says low-scoring hockey games are boring?

The New York Rangers’ Henrik Lundqvist and the Washington Capitals’ Braden Holtby have put on a heart-stopping and spectacular goaltending duel in Round 2 of the Stanley Cup playoffs, which will conclude with Game 7 in New York on Wednesday night. So far, every game in the series has been decided by one goal, with Lundqvist and Holtby combining for a 1.80 goals against average (GAA) and a .943 save percentage.

Lundqvist and Holtby have been among the better playoff goalies in recent NHL history, and the Rangers-Caps series has been in the upper echelon of goaltending battles. But a few have been even better. In their honor, we’re going to be handing out some Roy Awards for the best postseason goaltending performances since 1988. (Why are they called Roy Awards? That will become clear in a moment.)

How to measure goaltending success is a subject of debate among hockey geeks. But here’s one approach, which is inspired by Baseball Prospectus’s Support Neutral Win-Loss (SNWL), a statistic designed to evaluate baseball pitchers. As SNWL seeks to evaluate pitchers while controlling for their run support, our goalie statistic will seek to give goaltenders credit for wins and losses without being biased toward those goalies who have better offenses scoring goals for them. It will also control for the number of shots the goaltenders faced and the quality of their opponents. Allowing three goals — as Lundqvist did Sunday — is not that impressive, but it looks a lot better when you consider he faced 45 shots against the Capitals, who have one of the NHL’s best offenses.

Here’s how it works. I downloaded data from Hockey-Reference.com on all NHL playoff games since 1988. (Hockey-Reference, as terrific as it is, doesn’t have detailed game-by-game data before then.) For each game, I compared each goalie’s actual GAA against a benchmark GAA that represents how you’d expect an average playoff goalie to perform under the same circumstances. The benchmark GAA is calculated7 based on the number of shots the goalie faced, his opponent’s goal-scoring and shooting percentage during the regular season, and whether he was playing at home or on the road. During Friday’s Game 5, for instance — with the Rangers playing at home and the Capitals generating relatively few shots — Lundqvist’s benchmark GAA was 2.17. But on Sunday, on the road and with the Caps taking 45 shots on goal, his benchmark GAA was 3.56.

The next step is to translate the benchmark GAA and the goalie’s actual GAA into win probabilities,8 assuming that the goalie had average offensive support.9 For Friday’s Game 5, for instance, Lundqvist’s benchmark 2.17 GAA translates into a 52 percent win probability. But Lundqvist’s actual performance, allowing just one goal, raised the Rangers’ win probability to 80 percent. So Lundqvist gets credit for +0.28 net wins, the difference between the two figures. (Actually, he gets credit for slightly more than that, since the game went to overtime.)10

First up, here are the Roys for goaltending in a single playoff series:

Best Performances

Screenshot 2015-05-13 18.27.09

GOALIE YEAR TEAM OPP. MP/60 NET CHANGE IN WIN % PER 60 MP NET WINS
Tim Thomas 2011 BOS VAN 7.0 +34.2% +2.4
Tuukka Rask 2013 BOS PIT 4.6 47.2 +2.2
Patrick Lalime 2002 OTT PHI 5.3 37.6 +2.0
Dominik Hasek 1994 BUF NJD 8.1 24.2 +2.0
Mike Richter 1997 NYR NJD 5.2 36.7 +1.9
John Vanbiesbrouck 1996 FLA PIT 7.0 26.9 +1.9
Ed Belfour 2004 TOR OTT 7.4 25.3 +1.9
Arturs Irbe 2002 CAR TOR 6.4 27.9 +1.8
Jean-Sebastien Giguere 2003 MDA DET 4.8 34.8 +1.7
Patrick Roy 1996 COL FLA 4.7 35.4 +1.7
Felix Potvin 1993 TOR STL 7.7 21.5 +1.7
Jean-Sebastien Giguere 2003 MDA MIN 4.5 37.2 +1.7
Curtis Joseph 2001 TOR OTT 4.2 38.5 +1.6
Patrick Roy 1993 MTL QUE 6.3 25.3 +1.6
Jaroslav Halak 2010 MTL WSH 5.7 27.6 +1.6

 Worst Performances

Screenshot 2015-05-13 18.27.17

GOALIE YEAR TEAM OPP. MP/60 NET CHANGE IN WIN % PER 60 MP NET WINS
Dan Cloutier 2003 VAN MIN 6.9 -31.3% -2.2
Corey Crawford 2014 CHI LAK 7.4 -27.8 -2.1
Trevor Kidd 1995 CGY SJS 7.2 -24.3 -1.8
Ron Hextall 1988 PHI WSH 6.3 -25.6 -1.6
Curtis Joseph 1999 TOR BUF 4.6 -33.2 -1.5

In the chart, MP/60 stands for minutes played divided by 60. Since a regulation NHL game is 60 minutes long, it essentially just means games played, although goalies will get extra credit for games that go to overtime.11 The next column shows the goalie’s net change in win probability per 60 minutes played. Multiplying this number by MP/60 produces net wins — how many wins a goalie added or subtracted from his team relative to an average playoff goalie. That’s what we use to hand out Roys.

So the Roy for best goaltending in a single playoff series goes to… Tim Thomas of the Boston Bruins, for his performance in the 2011 Stanley Cup Final against the Vancouver Canucks. The Canucks had been the NHL’s highest-scoring team in the regular season and launched more than 35 shots per game at Thomas. And yet he allowed only eight goals in the seven-game series, including a shutout in the final.

Thomas is followed by his fellow Bruin, Tuukka Rask, who allowed just two goals against Sidney Crosby and the Penguins in the 2013 Eastern Conference finals. He was even more effective than Thomas on a per-shot basis, with a .985 save percentage. Perhaps he was too good for his own good, in fact — the Bruins swept the series, so he played substantially fewer minutes than Thomas. In third place is Ottawa’s Patrick Lalime, who allowed two goals in five games against the Philadelphia Flyers in 2002.

The performance by Buffalo’s Dominik Hasek in the Sabres’ 1994 opening-round series against the New Jersey Devils ranks fourth, and Hasek also holds a couple of other distinctions. First, he wins the Roy for the best performance in an individual game, stopping all 70 New Jersey shots in a legendary four-overtime shutout in Game 6 of the series. And he and the Devils’ Martin Brodeur share the Roy for the best combined goaltending performance in a single series:
Screenshot 2015-05-13 18.27.27

COMBINED STATS
SEASON SERIES WINNER (MAIN GOALIE) SERIES LOSER (MAIN GOALIE) GAMES SAVE% GAA NET GT WINS
1 1994 Devils (Brodeur) Sabres (Hasek) 7 .943 1.61 +3.3
2 2007 Canucks (Luongo) Stars (Turco) 7 .951 1.36 +2.9
3 2011 Bruins (Thomas) Canucks (Luongo) 7 .936 2.16 +2.6
4 1997 Rangers (Richter) Devils (Brodeur) 5 .961 1.15 +2.6
5 1993 Maple Leafs (Potvin) Blues (Joseph) 7 .938 2.06 +2.6
6 2002 Senators (Lalime) Flyers (Cechmanek) 5 .961 1.05 +2.6
7 1994 Rangers (Richter) Devils (Brodeur) 7 .929 1.96 +2.6
8 1999 Maple Leafs (Joseph) Flyers (Vanbiesbrouck) 6 .946 1.46 +2.3
9 2002 Hurricanes (Irbe) Maple Leafs (Joseph) 6 .950 1.25 +2.3
10 2004 Maple Leafs (Belfour) Senators (Lalime) 7 .936 1.70 +2.3
SEASON HIGHER SEED (MAIN GOALIE) LOWER SEED (MAIN GOALIE) GAMES SAVE% GAA NET GT WINS
17 2015 Rangers (Lundqvist) Capitals (Holtby) 6+ .943 1.80 +1.8

Why does that Devils-Sabres series rank so highly? Hasek and Brodeur’s conventional statistics were great, but not obviously better than some other goaltending duels, like that between the Canucks’ Roberto Luongo and the Dallas Stars’ Marty Turco in 2007. One reason is because of that quadruple overtime game, which made the matchup the equivalent of an eight-game series. But another is because the series was played in 1994, when goal-scoring was about 20 percent higher than it is now. So it stands out more by comparison.

The current Rangers-Caps series ranks as the 17th-best goalie duel so far: Holtby has contributed 1.0 net wins and Lundqvist 0.8, for a combined 1.8. It could plausibly move into the top 10 if Game 7 is low-scoring.

We can also award a Roy for the best goaltending in a single playoff season. It goes to … Patrick Roy, who added 4.2 wins in the 1993 NHL playoffs. Roy’s performance ranks highly in part because it came against some high-flying offenses. His playoff opponents — the Nordiques, Sabres, Islanders and Kings — had each averaged about four goals per game during the regular season.

Best Performances

Screenshot 2015-05-13 18.27.36

GOALIE YEAR TEAM MP/60 NET CHANGE IN WIN % PER 60 MP NET WINS
Patrick Roy 1993 MTL 21.6 +19.6% +4.2
John Vanbiesbrouck 1996 FLA 22.2 18.3 +4.1
Jean-Sebastien Giguere 2003 MDA 23.5 15.8 +3.7
Tuukka Rask 2013 BOS 24.4 14.8 +3.6
Tim Thomas 2011 BOS 25.7 12.5 +3.2
Patrick Roy 2001 COL 24.2 13.0 +3.2
Kirk McLean 1994 VAN 25.7 11.8 +3.0
Patrick Roy 1989 MTL 20.1 14.7 +3.0
Jonathan Quick 2012 LAK 20.6 14.1 +2.9
Patrick Roy 1996 COL 24.2 11.6 +2.8
Martin Brodeur 1995 NJD 20.4 13.3 +2.7
Martin Brodeur 2003 NJD 24.8 10.7 +2.6
Martin Brodeur 1994 NJD 19.5 13.6 +2.6
Mike Vernon 1997 DET 20.5 12.8 +2.6
Dominik Hasek 1999 BUF 20.3 12.4 +2.5

Worst Performances

Screenshot 2015-05-13 18.27.42

GOALIE YEAR TEAM MP/60 NET CHANGE IN WIN % PER 60 MP NET WINS
Dan Cloutier 2003 VAN 13.9 -17.9% -2.5
Trevor Kidd 1995 CGY 7.2 -24.3 -1.8
Marc-Andre Fleury 2010 PIT 13.3 -12.3 -1.6
Ron Hextall 1988 PHI 6.3 -25.6 -1.6
Greg Millen 1988 STL 10.0 -15.8 -1.6

Most of the Roy winners in this category comport well with the conventional wisdom. Four of the top six goaltenders — Roy in 1993 and 2001, Thomas in 2011 and Jean-Sebastien Giguere in 2003 — also won the Conn Smythe Trophy for being the MVP of the NHL playoffs.

Finally, the Roy for the best lifetime playoff performance goes to … Patrick Roy.

Best Performances

Screenshot 2015-05-13 18.27.49

GOALIE MP/60 NET CHANGE IN WIN % PER 60 MP NET WINS
Patrick Roy 227.7 +6.6% +15.0
Ed Belfour 165.7 6.3 +10.4
Martin Brodeur 211.9 3.6 +7.7
Dominik Hasek 121.9 6.2 +7.6
John Vanbiesbrouck 47.5 11.3 +5.4
Henrik Lundqvist 105.8 4.4 +4.6
Tim Thomas 51.9 8.3 +4.3
Chris Osgood 127.5 3.3 +4.2
Braden Holtby 34.8 10.5 +3.7
Curtis Joseph 135.1 2.6 +3.5
Jonathan Quick 78.1 4.3 +3.3
Craig Anderson 26.8 12.3 +3.3
Jean-Sebastien Giguere 52.8 6.2 +3.3
Olaf Kolzig 46.6 6.9 +3.2
Tuukka Rask 50.8 5.9 +3.0

Worst Performances

Screenshot 2015-05-13 18.27.56

GOALIE MP/60 NET CHANGE IN WIN % PER 60 MP NET WINS
Kelly Hrudey 65.3 -6.8% -4.5
Dan Cloutier 22.7 -16.9 -3.8
Marc-Andre Fleury 98.8 -3.7 -3.7
Sean Burke 35.8 -9.1 -3.2
Antti Niemi 61.0 -4.5 -2.8

From 1988 onward, Roy was 15 wins better than an average playoff goaltender, easily outdistancing second-place Ed Belfour. And that under-rates Roy, since it doesn’t give him credit for 1986, when Roy, then 20 years old, had a 1.92 postseason GAA in leading the Canadiens to the Stanley Cup. Roy also does really well by conventional playoff statistics — he had 151 career playoff wins, easily the best all-time — but he earned them.

In other cases, however, the advanced stats provide some insight that isn’t as clear from traditional stats. While Brodeur had a considerably better career playoff GAA than Roy, for instance, he’s relatively far behind him in net wins, since the Devils’ neutral-zone trap prevented him from facing all that many shots and since he played in a low-scoring era.

Meanwhile, the Penguins’ Marc-Andre Fleury ranks as the third-worst playoff goaltender since 1988 despite a winning (53-44) career playoff record. That’s because it’s easy to win games when you have Crosby scoring goals for you. Our support-neutral stat detects that Fleury really hasn’t been much good in the playoffs.

Lundqvist, meanwhile, ranks as the sixth-best playoff goaltender since 1988, while Holtby ranks ninth — despite being in just his fifth NHL season. After Wednesday night, one of them will have the chance to add to his legend, while the other will have plenty of time to watch Patrick Roy clips on YouTube.