Using NHL Coaching Changes to Identify Historically Good and Bad Coaches

Iron Mike no like. - Photo by "Resolute", via Wikimedia Commons; altered by author

Photo by “Resolute”, via Wikimedia Commons; altered by author

Having now looked at the overall effect a coaching change might have on a team, and identified some outstanding examples where a coaching change had a drastic impact on a team, it’s now time to shift over to some juicier matters. For the most part, I don’t think one coaching change is necessarily sufficient to say a coach is good or bad; there is a possibility the previous coach was just that bad. But if the coach returns the same signal a couple of times or more, you are probably getting closer to a true reading on what they might bring to the table.

Across the 140 or so coaching changes these last 60 years where both coaches led the team 20+ games, there were 69 coaches who were a part of that change twice or more (which, to me, is quite a remarkable number). The full list, followed by an explanation of the measures:

Coach Yrs Avg 2pS σ Avg Off σ Avg Def σ
Schoenfeld, Jim 3 +6.5% 2.7 +3.4 1.5 -4.1 2.0
Molleken, Lorne 2 +5.4% 2.0 +2.7 1.9 -3.3 0.5
Boudreau, Bruce 3 +5.3% 1.9 +2.8 0.2 -3.3 2.5
Delvecchio, Alex 2 +5.2% 3.7 +2.7 1.4 -3.7 3.5
Ruel, Claude 2 +4.6% 4.6 +3.1 3.4 -2.9 2.8
Sutter, Darryl 3 +3.8% 3.0 +1.5 1.6 -2.6 2.6
Martin, Jacques 2 +3.7% 2.3 +1.7 2.4 -2.7 0.1
Patrick, Craig 4 +3.5% 1.9 +2.6 1.9 -1.8 0.6
Tortorella, John 2 +3.4% 1.2 +1.0 2.4 -3.3 1.1
Reay, Billy 2 +3.0% 1.2 +1.1 1.5 -2.7 0.1
Julien, Claude 2 +2.8% 3.8 +2.6 2.9 -0.4 1.2
Lapointe, Ron 2 +2.4% 4.5 +2.0 4.4 -0.8 0.7
Patrick, Muzz 2 +2.2% 2.5 +1.5 2.3 -1.3 0.5
Hartley, Bob 2 +2.2% 3.5 +0.8 1.6 -1.6 2.4
Boivin, Leo 2 +2.1% 2.2 +3.0 1.7 +0.6 0.8
Crozier, Joe 2 +2.1% 1.5 +1.1 3.2 -1.3 1.8
Arbour, Al 3 +2.0% 2.5 +1.0 1.7 -1.4 1.5
Neale, Harry 3 +1.8% 1.7 +1.0 1.1 -1.2 1.2
Quenneville, Joel 2 +1.5% 0.9 -0.2 2.2 -1.7 3.0
Sather, Glen 3 +1.4% 1.2 +1.9 2.0 +0.3 0.7
Hartsburg, Craig 2 +1.3% 3.6 +1.6 2.7 +0.3 1.2
Guidolin, Bep 2 +1.3% 2.8 +0.1 1.7 -1.6 2.2
Sullivan, Red 2 +1.2% 2.3 +1.3 1.6 -0.1 1.5
Gainey, Bob 2 +1.0% 1.6 +0.7 1.8 -0.5 0.1
Maurice, Paul 4 +0.9% 2.4 +0.7 2.6 -0.4 1.5
Boileau, Marc 2 +0.9% 9.7 +0.2 6.3 -0.5 5.9
Milbury, Mike 2 +0.9% 1.1 -1.5 0.8 -2.7 0.4
Quinn, Pat 3 +0.8% 2.3 +1.2 1.5 +0.2 1.5
Constantine, Kevin 3 +0.7% 3.0 -1.5 2.3 -2.5 1.3
MacLean, Doug 3 +0.7% 0.8 -0.9 1.9 -1.7 2.7
Schmidt, Milt 2 +0.6% 0.6 -0.6 0.6 -1.5 0.3
McVie, Tom 3 +0.5% 0.7 +0.0 0.9 -0.7 2.1
Sutherland, Bill 2 +0.5% 1.6 +0.7 0.1 +0.1 2.3
Murphy, Mike 2 +0.4% 2.8 -1.1 0.2 -1.7 3.4
Maloney, Phil 2 +0.4% 1.8 -0.2 0.8 -0.8 1.4
Burns, Charlie 2 +0.4% 0.6 +0.4 2.1 -0.1 1.7
Hitchcock, Ken 3 +0.2% 3.1 +0.8 2.8 +0.6 1.2
Murray, Andy 2 +0.1% 2.3 -0.5 0.1 -0.6 2.7
Muckler, John 3 +0.1% 4.7 +0.2 4.2 -0.3 1.7
Sutter, Duane 2 +0.1% 3.7 +0.5 0.2 +0.5 4.9
Schinkel, Ken 3 -0.2% 6.9 +0.7 4.7 +0.6 4.2
Plager, Barclay 3 -0.2% 3.2 -0.9 2.2 -0.8 1.9
Pleau, Larry 2 -0.2% 1.0 +0.7 0.6 +1.0 0.4
McCreary, Bill 3 -0.4% 1.8 +0.9 1.6 +1.5 1.5
McCammon, Bob 2 -0.4% 3.1 -1.2 2.1 -0.6 1.7
Murray, Bryan 2 -0.6% 1.3 +2.3 1.1 +2.9 2.7
Ramsay, Craig 2 -0.8% 1.3 -0.8 1.0 +0.1 2.2
Blair, Wren 2 -0.8% 0.1 -0.7 1.8 +0.4 2.1
Johnston, Marshall 3 -0.9% 4.2 -1.6 2.0 -0.8 3.8
Bowness, Rick 3 -1.0% 2.5 -0.1 2.3 +1.1 1.7
Francis, Emile 4 -1.0% 3.2 -1.5 1.5 -0.1 2.7
Perry, Don 2 -1.0% 0.3 -0.2 1.9 +1.1 1.5
Kitchen, Mike 2 -1.3% 0.6 -0.4 1.4 +1.1 2.1
Laviolette, Peter 3 -1.4% 2.6 -1.8 2.1 +0.0 1.4
Robinson, Larry 2 -1.5% 0.3 -0.4 0.5 +1.2 0.5
Bowman, Scotty 3 -1.7% 2.2 -1.0 1.4 +1.0 1.7
Noel, Claude 2 -1.8% 2.8 -0.7 4.1 +1.3 0.8
Neilson, Roger 4 -1.8% 1.9 -0.4 1.4 +1.8 2.8
Geoffrion, Bernie 3 -1.9% 1.6 -0.4 0.5 +1.9 1.7
Dudley, Rick 2 -2.0% 3.2 -2.6 3.1 -0.1 0.9
Pulford, Bob 3 -2.0% 3.8 -1.8 2.5 +0.5 2.9
Renney, Tom 2 -2.1% 3.0 -1.1 2.2 +1.4 1.5
Keenan, Mike 3 -2.5% 0.3 -0.3 2.1 +2.3 1.9
Imlach, Punch 2 -2.6% 0.6 -1.7 2.4 +1.3 1.9
Brooks, Herb 2 -2.8% 0.4 -0.9 1.9 +2.5 2.0
Murray, Terry 4 -3.0% 5.2 -1.7 1.5 +1.6 4.9
Barkley, Doug 2 -3.4% 6.3 -1.8 2.8 +2.5 5.1
Therrien, Michel 4 -4.6% 3.5 -4.2 1.9 +0.9 2.4
Hanlon, Glen 2 -5.5% 0.9 -2.9 0.4 +3.3 1.8

Some explanation: the values with the headings starting with “Avg” are the average change in 2pS% (an historical possession metric, explained here), in 2pSF/60 (designated “Off”; shots-for per 60, using the rates up through the 2nd period rather than full-time), and 2pSA/60 (designated “Def”; rest same as with SF only working with shots-against). The perspective is from that of the coach – so, if Tom Renney was replaced and shots-for went down, he would be seen as a positive influence on shots, and if Renney replaced someone and shots-for went down, he would be seen as a negative influence. The shorter explanation is that this is the presumable impact on those metrics these coaches would have if you put them behind the bench. I included the standard deviation for each average to inform whether the average involved wide or narrow disparity in the data used for the average.

Overall, if the standard deviation exceeds the average value, then there’s a greater likelihood the reading is a) a bit too noisy for conclusion, and b) suggesting a coach’s average could very well be a mirage.

Anything jump out at you? Well, to me, I feel we once again see an evaluative rule play out here: that there are a limited number of people who give you a clear signal, and the rest should receive the benefit of the doubt and be left to the inconsistent noise. That certainly writes off some pretty big names, though, doesn’t it? Scotty Bowman, Roger Neilson, Ken Hitchcock, Pat Quinn…there’s a number of coaches here you were sure would deliver, but really provided a mixed bag. Truth be told, I think Bowman gets kind of under-served here, as two of the changes involved his messy Buffalo tenure. When it was between he and Al Arbour with St. Louis in 1970-71, it was Bowman who oversaw a 0.7% uptick in possession.

On the negative end, there sure is no saving Glen Hanlon, who might have defended himself as the heir to the Jagr disaster in Washington, but had little excuse once Ovechkin, Semin, Mike Green, and Nicklas Backstrom were running on all cylinders. Therrien I’ve already covered, but how consistent is Mike Keenan? He helmed some fantastic Flyers teams in the 1980s, but by the 1990s the Iron Mike act was wearing thin on players and front offices alike. Punch Imlach is also an interesting one, an unassailable character in some arenas (including The Hall), his tally includes taking the reins in Toronto from a legend who is not in the Hall, Billy Reay, in 1958. Reay, you’ll notice, is much higher on the list above.

On the positive end, we have some clearer signals (keep in mind, per my first post on this topic, that the average expected 2pS% shift is +0.66%). Jim Schoenfeld is the undisputed star, an appropriate label for the man who once cut a vinyl record with his karaoke-quality vocals, as he made significant impacts in all his stops in Buffalo, New Jersey, and Washington (the latter mentioned in my previous post). Lorne Molleken is likely a surprise, but Bruce Boudreau definitely is not – nor is Darryl Sutter. Craig Patrick and John Tortorella are certainly the most intriguing…my guess is Torts benefits from two instances of mediocre previous coaching, but Patrick has given us four instances of positive replacement work, in 1980 and 1985 for the Rangers’ Fred Shero and Herb Brooks, then in 1989 and 1997 for the Pens’ Gene Ubriaco and Eddie Johnston. The latter two were at the same time Patrick was Pittsburgh’s GM. Nobody can take away Patrick’s Cup championships with the Pens, but he sure received (and, to some degree, earned) a heap of criticism as the wheels fell off the wagon in the early 2000s. These days, Patrick is haunting the hallways of the Buffalo Sabres organization as a Special Advisor while Schoenfeld is the Rangers’ Assistant GM, and Torts is probably a lumberjack with Dexter Morgan or something.

Bringing this little series to a close, I’m reminded of something Vic Ferrari mentioned in Elliotte Friedman’s great unveiling of Ferrari’s persona.* Vic noted that NHL coaches are “smart guys” who “have a hell of a grasp of who is bringing what to their team,” and I generally agree with that for the same reasons I agree with Tom Awad’s assertion that time on-ice can tell you a lot about who are the “good players.” I think this is generally true, and I very much believe that there are coaches out there that couldn’t care a lick for complicated metrics yet still have an eye for talent and what works. That being said, there are still boobs in the bunch, and it’s important to find ways to identify and avoid them; looking at coaching change history is one way you could accomplish that.

* I’m not lost on the irony that I mention Vic, who was originally inspired by Roger Neilson, in the same post that suggests Neilson didn’t necessarily have a positive impact on his teams.

Leave a comment