Who Dat Report 2010 Week 14

Play

Running time: approximately 52 minutes

__I’m thrilled to bring you this week’s Who Dat Report, which features interviews with 2 fantastic guests.

Aaron Schatz is the Editor-in-Chief of Football Outsiders, perhaps the premier NFL stats site on the web. In addition to their innovative statistics, they also feature some of the best play-by-play breakdowns around, complete with play diagrams, etc. It’s really great stuff. You can also follow Aaron on [Twitter][2] at @FO_ASchatz. While you’re visiting Football Outsiders’ website, you can sign up for their premium service, which includes their picks against the point spread (they’re 106-80-6 this year, which beats almost anyone who picks every game), if that’s your kind of thing. You should also buy their preseason almanac each year; it’s great.

Jeff Duncan (starting approximately 32 minutes into the show) writes about the Saints for the Times Picayune. His book is called Bags to Riches: How the New Orleans Saints and the people of their hometown rose from the depths together. You can order a signed copy of the book from Acadian House here, or you can save a few dollars (and support The Who Dat Report) by ordering an unsigned version from Amazon.com by clicking here. The book is a great Christmas present for the Saints fan in your life. You can also read Jeff’s great articles at Nola.com/Saints and follow him on Twitter via @jeffduncantp. It’s a great gameday Twitter feed.

Don’t forget, if you’d like to help support The Who Dat Report, please visit www.WhoDatReport.com/Support for a few different ways of helping out.

[2]: http://www.Twitter.com/FO_ASchatz

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

Don’t let the record fool you: This Saints team is not very good.

UPDATE: For a more reasoned argument, see this followup post.

By record, this is one of the handful of greatest Saints teams ever. After all, how many times have the Saints won 9 games in a total season, much less 9 games with 4 remaining. This has been a truly great year for the Saints.

However, the team simply isn’t very good right now. I’ve been saying so all season, and today’s game against the Bengals really drove my point home. Allow me to explain.

The Saints have played one of the easiest schedules in the NFL this year, and have not looked particularly good while doing so. They lost to the Max Hall-led Cardinals, nearly lost to the Pickles Clausen-led Panthers, the Alex Smith-led 49ers, and the Jon Kitna-led Cowboys. While the Saints did beat the Steelers and took the Falcons to the wire, most of their games have been close, regardless of the (lack of) quality of opponent. Good teams don’t play close games against inferior opponents. They just don’t.

So, my theory is that this team isn’t that good, but they’ve been able to load up on wins against teams that are even worse than they are. Kind of like if The University of Florida moved to division 1-AA. Sure, the Gators might not be that good, but give them crappy enough opponents and they can pile up a few victories.

Don’t believe me? There are a few different websites that measure schedule strength. Football Outsiders [rates the Saints’ past schedule ranked 31st in the league][2]. In other words, the Saints have played the second-easiest slate of opponents in the NFL this year, behind only Carolina (how bad must the Panthers be?). If the Saints were anything other than a mediocre team, they’d be blowing out many of their opponents. Instead, nearly every game has been a nail biter.

It’s possible that the closeness of the games has been because the Saints’ opponents are super excited to prove themselves against the defending champs. It’s also possible that the close games are a sign that the Saints know how to gut out a victory. However, I doubt it. Instead, I think that the closeness of games reflects a Saints team that isn’t very good this year.

However, that doesn’t mean all is lost. I said in the first episode of the Who Dat Report that I thought a playoff trip would be a successful season. Well, the Saints are almost definitely playoff-bound, so this has been a successful season. If they get the top wild card seed, then they’ll likely win their first playoff game against whichever team limps to the finish line in the NFC West. It’s just been frustrating, because the schedule was lined up for us to make a truly dominant march toward the playoffs, and it hasn’t happened.

Still, it’s been a great run in the Loomis/Payton/Brees era, and we should still have a few years of contention left. Let’s enjoy the fact that we’re writing negative columns about teams that are 9-3. We won’t have that luxury forever.

[2]: http://www.footballoutsiders.com/stats/teameff

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

How Good Are the Saints?

UPDATE: I’ve substantially changed this article since first publication. This is the better version. You can read the final version (slightly updated from this one) at Canal Street Chronicles.

Ranking NFL teams is folly. Since each team doesn’t play each other team, we have to use guesswork, assumptions, and a bit of voodoo to try to figure out who is better than whom. However, we’re headed toward the playoffs, and I thought it’d be worthwhile to try to figure out just how good the Saints are. My gut tells me they’re in the top handful of teams in the NFC, and somewhere in the second tier of teams in the NFL, but let’s see if we can move beyond gut feelings.

There are many ways to evaluate a team’s strength. One way is to look at their record, compare it to other teams records, and leave it at that. That’s the Bill Parcells “you are what your record says you are” approach.

Looking at records, the Saints are tied for 2nd in the NFC (with the Bears, behind the Falcons) and tied for 3rd in the NFL.

While the Parcells approach is satisfying (and ultimately correct in the sense that a 7-win team does have 7 wins), it’s not a particularly good way of comparing teams. After all, an 8-8 team with an easy schedule is not the same as an 8-8 team who has played the hardest schedule in the league. If we want to really compare teams, I think we need to move beyond record and consider the context in which that record was achieved.

The same goes for statistics. There are some great statistics that measure the quality of NFL teams. I’m partial to Yards Per Attempt (after I make my adjustments for sacks and interceptions), but there are plenty of others that are even better (though harder to calculate and understand). However statistics are of limited value if you don’t take context into account.

My contention, and the basis for this article, is that statistics, wins, losses, etc., in a vacuum are enlightening, but only tell part of the story. By looking at the conditions under which those statistics, wins, losses, etc., occurred, you can increase your predictive power.

In other words: wins, losses, and stats without context do a great job of describing how a team has done in the past. However, if you are trying to predict how a team will do in the future, or against other teams, then it helps to go beyond wins, losses, and basic statistics. You need to look at the context in which those wins, losses, and basic statistics occurred.

The problem is that it’s difficult to account for context. Fortunately, there are a few websites out there that do this for us. So, we can look to those websites, combine them with our own subjective judgment, and use that to get a sense of how good the Saints are. That’s what I plan to do here.

One other disclaimer: I’m aware that these statistical measures aren’t perfect. Statistical analysis in the NFL will never catch up to baseball: the game is too complex. However, I think that looking at these sorts of analyses gives you a much better idea of what’s going on than does looking at the various “power rankings” at sites like SI.com, ESPN.com, etc. If you disagree, that’s fine, you can let me know about it in the comment thread. However, you should also let me know where you rank the Saints among NFL teams (and especially NFC teams) and why. I’ll publish the best comments in this week’s 4th and Geaux.

Football Outsiders

The first site I look to when judging teams is Football Outsiders , which is one of the more popular “advanced statistics” sites in the NFL. While they aren’t perfect, they are about as good as it gets for NFL analysis.

FO’s primary way of measuring team quality is through their Defense-Adjusted Value Over Average (DVOA). Without getting too bogged down in the details, DVOA basically assigns a value to each play run and compares the success of that play to how the league has performed in similar situations. This value is then adjusted for the quality of defense faced.

While no statistic is perfect (that’s why they play the game, right?) DVOA is a pretty good stat in that it correlates well with winning. In fact, if you use DVOA to pick games against the spread (after making a slight adjustment for home field, weather, etc.), you’ve done quite well for yourself over the last several years. This year, the Football Outsiders premium picks are 106-80-6 vs. the spread. That would place the Football Outsiders premium picks in the top 17% of pickers in the famed Las Vegas Hilton Supercontest with one important difference: the DVOA picks are for each game, where the entrants in the Supercontest get to choose their favorite 5 picks each week.  (NOTE: You really shouldn’t bet on football, even with DVOA or other advanced metrics.). DVOA is also highly correlated with wins, much moreso than the adjusted Yards Per Attempt that I talk about in 4th & Geaux.

According to DVOA, the Saints are the 5th best team in the NFC and 9th in the NFL*. FO’s stats have the Saints offense ranked 7th in the NFL, defense ranked 11th, and special teams ranked 26th.

*Interesting note: if the Saints were in the AFC, they’d be ranked 5th in the AFC, as well.

That offensive rank struck me as a bit low, but then I remembered that it’s a season-long measure, and takes quality of opponent into account. While the Saints’ offense has been on a tear lately, they weren’t particularly good at the start of the season*. Their offense is improving: when I wrote the first draft of this article earlier this week, the Saints’ offense was ranked 14th in the league! Hopefully Reginald will round into form and the offense will continue to improve as the playoffs approach.

*That’s a critical point to remember when looking at some of these computer-generated rankings: they take the entire year into account, not just how a team is doing currently. The advantage of doing so is that the rankings are less likely to get screwed up by the week-to-week swings that happen in any NFL season. The disadvantage is that the rankings may be a bit late to pick up on trends. In other words: it’s good to ignore the week-to-week fluctuations, unless the week-to-week fluctuations are a sign of genuine improvement. The hard part is knowing which is which.

Ignoring the AFC (the comparisons become too hard), who does Football Outsiders have ranked higher than the Saints in the NFC? In order, it’s Philadelphia, Green Bay, NY Giants, and Atlanta. Football Outsiders has Philadelphia ranked as the best team of the NFC by a pretty good distance, Green Bay and the Giants almost identical, and Atlanta and New Orleans almost identical. The next teams in the NFC are way back in quality.

Now, whether or not you agree with these rankings, take a second to understand the logic behind them. The Falcons and Saints are ranked behind the other teams for two primary reason: quality of victory (in the case of the Falcons and Saints, who have had a lot of close victories…particularly the Falcons) and quality of schedule. According to FO, the Saints have had the second easiest schedule in the NFL, where as Philly’s schedule is ranked 19th, Green Bay’s 21st, New York’s 27th, and Atlanta’s 10th. The Saints’ opponents have been much easier than the other teams’, yet they still haven’t looked great against many of those opponents.

Subjectively, these rankings strike me as approximately right, although I don’t know what to make of the Giants. They don’t seem all that great to me, but I might be wrong.

Advanced NFL Stats

AdvancedNFLStats.com is an interesting site run by an interesting dude. It’s by far the most statistically complex of the NFL sites I’m aware of, in that it uses advanced, technical techniques (regression, simulation, tests of significance, etc.) to analyze the NFL. As someone who has taken way too many statistics in graduate school, Advanced NFL Stats gets my nerd parts tingling.

The basic stat that Advanced NFL Stats looks at is called Generic Win Probability (GWP), which is essentially the probability that an NFL team would beat an “average” NFL team on a neutral field. Brian Burke (former Navy pilot and Advanced NFL Stats Guy) calculates this based on a variety of efficiency stats, including offensive pass and run efficiency, defensive pass and run efficiency, interception rates, fumble rates, and penalty rates. He then makes opponent adjustments (the context that I’m looking for!) and derives GWP from a bunch of mathematical voodoo. Overall, Burke claims that his model correctly picks about 69-70% of games. Not bad: GWP does a better job of choosing (straight-up, not against the spread) winners than just picking the favorite does. It also does a better job than most people do in “pick em” pools.

Through week 13, Advanced NFL Stats has the Saints ranked 5th in the NFC and 15th in the NFL. That’s about what I expected in the NFC, but a bit lower than I’d expect in the NFL.

Let’s look at the NFC teams. GWP ranks Green Bay as the best team in the NFC by a pretty good margin, followed by the Giants, Philadelphia, Minnesota, and Chicago. The Saints are barely ahead of Dallas (which might explain why the Thanksgiving game was so close) and are significantly ahead of Atlanta and Tampa.

These rankings are slightly different from my subjective feelings. Subjectively, I think that we’re significantly better than Minnesota and pretty close to Atlanta. I have no idea about Chicago and the Giants (they both seem to be so hot and cold), and think we’re worse than Green Bay and Philadelphia.

The model used by Advanced NFL Stats indicates that the AFC is a LOT better than the NFC. I don’t know for sure, but my gut feeling is that the stats are right, based on the games I’ve seen by the top teams in each conference. However, you could convince me otherwise (reader HB-NOLA points out that the AFC/NFC matchups have been very even this year).

Cold Hard Football Facts

ColdHardFootballFacts.com is the most simplistic of the “advanced” NFL stat sites that I know of. It has a metric poop ton of stats, but few of them account for any sort of context. However, some of the stats are so fun that I think they’re worth looking at, anyway.

First are the “Quality Wins”. CHFF calls a quality win any win against a team that has currently has a winning record. For example, the Saints’ victory over Tampa Bay in week 6 counts as a Quality Win because Tampa has a winning record. However, if Tampa loses out and finishes 8-8 or 7-9, then that victory will no longer count as a Quality Win.

I mentioned above that I think a team’s record is a flawed way of viewing a team, but it’s still better than nothing. Quality wins is a limited measure of how good a team is*, but it’s a fun statistic that (unlike GWP, DVOA, etc.) is easy to understand and can be a pretty good measure of a team’s strength

*Some of the problems with Quality Wins: An 8-8 team and a 7-9 team might not be all that different, but one of them counts as a Quality Win and the other doesn’t. Additionally, teams might be significantly different early in the year than later (for example, due to injury), but Quality Wins doesn’t take that into account. Also, there’s some evidence that it’s more important how you play against bad teams than how you play against good teams

The Saints are 2-1 (67% winning percentage) against teams with winning records, which is second in the NFC, behind Atlanta (5-2, 71%), tied with Chicago and the Giants (2-1, 67%) and ahead of Philadelphia (3-2, 60%) and Green Bay (2-2, 50%). If you look at the AFC teams, the Saints would be in second place, behind the Patriots who are 3-1 against teams with winning records.

Two things are striking about that statistic: (1) the Saints have done better than I thought against teams with winning records, and (2) the Saints haven’t played anybody with winning records, but neither has any other NFC team!

Peeking back at the schedule, their victories are against the Steelers (which I think of as a very good team), and the Bucs (which I think of as a pretty average team), and their loss is against the Falcons (which I think of as a good, though overrated team). So, while I’d rather have a winning record against teams with winning records than not, all this stat really tells me is that we’ve beaten the Steelers. That’s good, but not particularly revealing.

So, I’m buoyed by the Quality Standings, but what they really tell me is that the NFC has a lot of fair-to-middling teams, or at least very few dominant teams.

Let’s look at some of the other CHFF stats. Now, these are stats you have to take with a grain or two of salt, because they don’t even pretend to take quality of opponent into account. However, they do teach us a bit about the Saints, so we’ll go through them in rapid-fire fashion to see if we can find a trend.

Bendability Index: The Bendability Index is simply Yards Allowed/Total Points. This statistic gives the number of yards per point allowed is attempt to measure how good teams are at preventing other teams from scoring. The higher the number, the harder it is for opponents to score on a team.

The Saints are ranked 9th in the NFL in “Bendability”, with an average of 17.13 yards per point allowed. That’s good for 4th in the NFC, behind Green Bay, Chicago, and Atlanta.

Scorability Index: The Scorability Index is similar to the Bendability Index, but it measures how efficiently a team scores points. To calculate, just divide Offensive Yards by Total Points. In other words, you’re measuring yards per point scored. The lower the number, the more efficiently a team scores points.

The Saints are ranked 23rd in “Scorability”, requiring an average of 15.99 yards per point scored. That’s 9th in the NFC.

Passer Rating Differential: [Passer rating differential][9] is simply the difference between a team’s offensive passer rating and defensive passer rating (that is, the passer rating that the defense allows).

The Saints offensive passer rating is 92.74 (9th in the NFL), their defensive passer rating is 79.26 (9th in the NFL), and their differential is +13.48, which is 8th in the NFL and 4th in the NFC.

Back to the original question: How good are the Saints?

Before this article, my gut feeling told me that the Saints were about the 10th-best team in the NFL, 4th or 5th in the NFC. Looking at the statistics, it looks like I was in the right neighborhood. Most of the advanced analyses that I’ve read point to the Saints being one of the best teams in the middle of the pack, league-wide and about the 4th or 5th best team in the NFC. That’s significantly worse than their record would indicate, but I don’t think record is a good predictor of future success compared to some of these other metrics.

For the fun of it, here’s a quick list of the power rankings from Football Outsiders, Advanced NFL Stats, and a few popular sports websites:

  • Football Outsiders: 5th in NFC, 9th in NFL
  • Advanced NFL Stats: 5th in NFC, 15th in NFL
  • Cold, Hard, Football Facts Quality Standings: 2nd in NFC, 3rd in NFL
  • ESPN.com: 2nd NFC, 5th NFL
  • SI.com (Don Banks): 2nd NFC, 5th NFL
  • National Football Post: 2nd NFC, 4th NFL
  • CBSSports.com: 4th NFC, 7th NFL
  • FoxSports.com: 2nd NFC, 3rd NFL

While there is a lot of variation the Saints NFL-wide rankings, the NFL-wide rankings aren’t that important. After all, the Saints play the Ravens in a couple of weeks, but won’t meet another AFC team until the Super Bowl, should we get there. Focusing on the more important NFC rankings, we can argue for hours over whether the Saints are the 2nd-best team, 4th-best team, or whatever, but it doesn’t really matter. The consensus seems to be that the Saints are in the top handful of NFC teams.

After reading the sites, the rankings, and the articles, and combining it with my subjective judgement based on watching the games, talking to people for my podcast, and writing my weekly columns, I think the Saints are probably 4th or 5th in the NFC. That would make them a decent-to-good team, but not a very-good-to-great team.

So, what does that mean? It means the Saints are definitely Super Bowl contenders, but will need to beat some teams that are probably better than they are in order to get to the championship. Given the way the Saints have played this year, I don’t have a lot of faith that they’ll do so. However, I’ve been wrong before (back in the early 1980s…long story), and I hope that I am again in this case. The Saints certainly have been playing better on offense over the last several weeks, but I’m concerned that the defense and special teams are hamstringing us.

That kick that Garret Hartley missed against Atlanta looms large over our season. It would be a lot easier to beat teams that are better than us if we played them at home, which we likely won’t have the luxury of doing.

If I had to turn this into a prediction so that you can ridicule me when it’s wrong, I’d say the Saints look like they’ll get to the second round of the playoffs (after all, their first opponent will probably be the NFC West champion) and struggle to move beyond there. If they continue to play like they’ve played so far, I don’t think they’ll make it to the NFC Championship game. If they get on a hot streak (or if Reginald and PT’s return make a big difference), though, the sky is the limit. This team definitely can repeat, but at this point, I don’t think that they will.

(You see, that way I can say I’m right now matter what happens. I’m not stupid!)

[9]: http://www.coldhardfootballfacts.com/Articles/2_2865_2009_Passer_Rating_Differential.html

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

Back in action, with a few changes

Hi there!

I’m producing this week’s show right now, so it should be up within the hour. We’ve got great shows lined up for the rest of the regular season, and we should get some good ones for the playoffs, too.

Part of the trouble I’ve had with the Who Dat Report is finding a way to fill 45-60 minutes each week, as my goal was to produce an hour-long show. Well, between this show, the NFC South Report, and my writing for [Canal Street Chronicles][2], that takes more time than I have.

So, going forward, I will let the length of the interviews determine the length of the shows. Some shows will be a half hour or so, others will be over an hour. I’ll occasionally still have things like 3 Facts and Trivia (after all, I did write theme songs for them!), but they’ll be a bit more rare.

Thanks for your patience. I’m trying to build a show for the long run, which means I need to constantly improve the process.

Go Saints!

You can help keep the Who Dat Report going by making a donation for equipment upgrades. Donate $10 or more and get producer credit for a month. Either way, thanks so much for reading and listening. <!– Begin PayPal Donations by http://johansteen.se/ –>

[2]: http://www.canalstreetchronicles.com

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

Who Dat Report 2010 Week 13

Play

Running time: 28 minutes

We’re back in action this week, interviewing Sports Illustrated Senior Writer Tim Layden about Drew Brees, the Sportsman of the Year, and more Saints excitement.

You can find Tim’s writing in Sports Illustrated and at SI.com. If you aren’t yet a subscriber to Sports Illustrated, you can help the Who Dat Report by [clicking this link and subscribing at Amazon.com][1]. Actually, clicking that link and buying anything at Amazon.com will help the show, so go nuts.

You can help keep the Who Dat Report going by making a donation for equipment upgrades. Donate $10 or more and get producer credit for a month. Either way, thanks so much for reading and listening. <!– Begin PayPal Donations by http://johansteen.se/ –>

[1]: http://amzn.to/dPiN50

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

Bye week: No show

Since there’s no game this week, I took the opportunity to launch the [NFC South Report][1] rather than record a Who Dat Report. Look for it to return next week, and, in the interim, let me know what you think of the new show!

[1]: http://www.nfcsouthreport.com

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

NFC South Report: A New NFC South Podcast

I’ve started a new podcast with a few of my internet friends. It’s called the NFC South Report (clever!) and it’s a review and analysis of the big stories in the NFC South each week. You can [listen to the first episode here][1] and listen live each Tuesday at 8:30 Central at http://www.NFCSouthReport.com/live.

[1]: http://www.nfcsouthreport.com/2010/11/10/nfc-south-report-episode-1/

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

Who Dat Report 2010 Week 9

Play

Running time: 84 minutes

In this week’s episode, Stuart previews the Saints-Panthers game with Saints fan/message board legend Joe Shorter and, finally, the lost interview with Eric Quakenbush of CatCrave.com, a great Panthers blog. We also play 3 Facts and bring back the Josh Levin Random Saints Memory.

Please take a minute to rate the Who Dat Report on iTunes and like us on our Facebook page, it’s the best way to help new people find the show. Producing this podcast takes hours a week, and I need to reach as many people as possible to justify the time.

Show Notes:

The Quackenbush interview was originally scheduled to run before the last Saints-Panthers game, but technical difficulties prevented me from running it. Thanks to Eric for his patience.

Though Joe couldn’t remember the specific game he was talking about in the Random Saints Memory, here’s a link to a box score [from a Saints-49ers game in 1989][3]. The Saints had a 17-3 lead in the 4th quarter, only to lose 24-20 thanks to a Joe Montana comeback. We used to lose to the 49ers a lot.

[3]: http://www.pro-football-reference.com/boxscores/198910080nor.htm

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

Today's episode is coming

But slightly delayed. I had a bit of real work to do, so I haven’t finished editing the show. Look for it later tonight or early tomorrow morning. Sorry for the inconvenience, and thanks so much for listening!

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.

Stuart partners with Canal Street Chronciles

Hi Folks,

Just wanted to let you know that I’ll be doing less writing on this blog, as I’ve been asked to do a weekly column for [Canal Street Chronicles][1], a nice Saints blog on the SB Nation network. Look for my weekly preview columns, called 4th and Geaux, over there each Friday.

I’ll still post episodes here, and periodic analysis, but most of my Saints-related writing will appear over there for now.

Thanks, and go Saints!

[1]: http://www.canalstreetchronicles.com/

---

Like what you see here? Please consider supporting me on Patreon. Your support helps keep me blogging plus, you know, kids are expensive.