Niners Nation: An SB Nation Community

Navigation: Jump to content areas:


Sports blogs for fans, by fans.
Around SBN: SB Nation NFL Power Rankings for Week 11

49ers-Cowboys Statistical Review: Red Means STOP!

Just to get this out of the way immediately, I obviously took a backwards K in my prediction of a so-so T.O. performance this week. Three things though. First, the stats couldn't account for T.O. having 2 catches for 120 yards and a touchdown on plays where he blatantly committed an offensive pass interference that was not called. Second, and perhaps I had an influence on this, 67% of those of us who voted on the preview poll thought that T.O. would have less than 100 receiving yards, and only 9% correctly predicted that he would have over 150. Finally, T.O. still has a negative DYAR (-7; ranked 65th) and a lopsided expected yards discrepancy (-133) even after the second best yardage game of his career. In fact, his expected yards discrepancy per game actually got worse, dropping from -8.6 to -12.1. So I guess what I'm saying here is, "Yeah. I was wrong, but I wasn't as wrong as you think." Sunday's performance by T.O. was totally unexpected based on the stats, and therein lies a major limitation of statistics: It is good at predicting "typical" performance, but not so good at predicting "atypical" performance.

Now, with that out of the way, I'd like to focus on what most 49er fans have been focusing on since Sunday, and I don't mean the choice between roasting and deep frying the Thanksgiving poultry. I'm talking about the atrocious performance of the 49er offense in the red zone against the Cowboys. Most of the blame over the past 3 days has been centered around Mike Martz's play-calling...you know...the pass-run-pass tendency that even I picked up on a couple of weeks ago. Well, there's a dirty little secret, borne out by the stats, that tells me that Martz may not be as much of an offensive genius as most NFL fans think he is.

IN THE RED (ZONE)

We all know the legend of Mike Martz. He turned a guy with "bag boy" and "Arena League player" on his resume into a Super-Bowl-winning, multiple-MVP quarterback. He was the ringmaster of "The Greatest Show on Turf." Hell, he even gilded Jon "The Interception Machine" Kitna's right arm. What's become obvious over the years, though, is that his offense is bred for easy situations. Versus a defensive genius (See Bill Belichick), or when the pressure is on (See Super Bowl XXXVI), however, his offense can be amazingly inefficient. It's great at racking up yardage, but it's not so great at succeeding in the situations that most impact the outcome of an NFL game. Nowhere is this more apparent than in the red zone.

Below is a chart showing the efficiency of Martz-led offenses both overall (black line) and in the red zone (red line):

08_wk_12_review_chart_1_medium 

*Martz only coached the Rams offense for 5 games during the 2005 season.

After the jump, I'll explain the chart, explain why talent hasn't been as important as you think, compare the red zone stats with other field zones, and see how the 49ers did in their SVW situations...


Star-divide

Martz has either been an offensive coordinator or a play-calling head coach for 10 seasons in the NFL. Of those 10 seasons, his offense has had a negative red zone DVOA in 7 of them (2002-2008). Furthermore, only once (2001) has his red zone offense performed better than his offense overall. In other words, only once has his offense been more situationally efficient inside the opponent's 20 yard line than it was across the other 80 yards of the field. Surprisingly, his red zone pass offenses have performed especially poorly. For the sake of readability, I didn't include these stats on the chart, but the only two seasons in which Martz's pass offense performed better than league-average in the red zone were 1999 and 2001, seasons in which that offense advanced to the Super Bowl. How's that for a connection between red zone performance and winning? Now, obviously, 10 is too small a sample of seasons to draw rock-solid conclusions, but trust me when I tell you that red zone efficiency is one of the most important stats in the NFL when it comes to winning and losing. Perhaps that's why Martz's offenses haven't won as much as you'd expect.

I'm expecting an argument from methodrampage at some point in the near future along the lines of, "Well, Martz had great talent from 1999-2001, and not-so-great talent after that. I mean, look at the garbage he has to work with this season!" Here's the problem though. Below is a list of the top QB, RB, and WR (yardage-wise) for each of his offenses over the past 10 seasons:

YEAR

QB

RB

WR

1999

Warner

Faulk

Bruce

2000

Warner

Faulk

Holt

2001

Warner

Faulk

Holt

2002

Bulger

Faulk

Holt

2003

Bulger

Faulk

Holt

2004

Bulger

Faulk

Holt

2005

Bulger

Jackson

Holt

2006

Kitna

Jones

Williams

2007

Kitna

Jones

McDonald

2008

O'Sullivan

Gore

Bruce

As you can see, the only thing you can say about differences in talent are that (a) he hasn't had Kurt Warner running his offense since 2001, (b) he didn't have a top-notch RB in 2006-2007, and (c) Isaac Bruce is the Methuselah of WRs. What you can't say is that Martz has had a bunch of Pop-Warner-caliber skill position players executing his offense. Even if we agree that Kitna-Jones-McDonald is light years away from Warner-Faulk-Bruce, what about the difference between Warner-Faulk-Holt and Bulger-Faulk-Holt, or how about Warner-Faulk-Holt vs. Bulger-Jackson-Holt? I'm sure when you were drafting your fantasy football teams from 2002-2005, you weren't saying, "Man, my team's going to suck if I end up with guys from the Rams offense." The point here is that, although there's been a dropoff in talent over the years, sometimes major (2006) and sometimes minor (2002), the dropoff doesn't do a very good job in explaining why Martz-led offenses have performed worse than the league average inside the red zone for 7 years running.

I'd like to mention one last thing about how Martz's offenses are yard-rich but efficiency-poor. Below is a table showing the "typical" performance of a Martz-led offense in the 5 field zones delineated by Football Outsiders. I'm using "typical" (aka median) efficiency rather than "average" (aka mean) efficiency because an average based on only 10 numbers tends to be skewed in one direction or the other due to sample size, especially when there are highly atypical values, as is the case here:

FIELD ZONE

Typical DVOA

Own 1-19

3.25%

Own 20-39

3.10%

Own 40-Opp 40

7.95%

Opp 39-21

-2.95%

Opp 20-1

0.50%

Notice: Outside the opponent's 40 yard line, Martz's offenses have performed above average, with a well-above-average performance between the 40s. In contrast, his offenses are, at best, average in the scoring zones.

THE DEVIL IS IN THE DETAILS

Just to refresh our memories, I identified the following strength vs. weakness (SVW) matchups for the 49ers in their game against the Cowboys:

Situation

SF Rank

DAL Rank

SF SPECIAL TEAMS VS. DAL SPECIAL TEAMS

1

30

SF DEFENSE VS. DAL OFFENSE ON 2ND AND LONG

8

29

SF DEFENSE VS. DAL OFFENSE ON 2ND AND SHORT

28

5

So how did they do? As you may recall, the bottom line of the 2nd-down SVWs was that the 49ers' defense needed to limit Cowboy yardage on 1st down, putting them into 2nd and long situations, rather than 2nd and short situations. That's how I'm going to score success/failure here. But first, the special teams.

Special Teams - Channeling Starkey here, "Wow. No Chance. No Chance." The Niners had a 13.1% advantage in this matchup, but performed 3.1% worse than the 30th-ranked Cowboy special teams. It kind of goes without saying that, when you have inferior talent on offense/defense, and when you're on the road, you MUST exploit this level of special teams advantage. Losing Rossum to injury didn't help, of course, but neither did special-teams-stud Michael Robinson channeling Kwame Harris on punt protection duties. Score: Double Bogey.

1st-Down Defense - The Cowboys had 26 total 1st-down plays on Sunday. Ignoring one victory-formation kneel down at the end of the game, the Niners' defense forced the Cowboys' offense into 2nd and long 14 times, allowed 2nd and short 4 times, allowed another first down once, and put the Cowboys into 2nd and mid 6 times. All told, that's a 14-5-6 performance, which is actually pretty good. This confirms my impression during the game that they were doing a good job of making the game easier for themselves on defense.  So what happened? Well, on those 4 2nd-and-short plays, the Niners' defense failed all 4 times, giving up a total of 16 yards and 4 first downs. On the 2nd-and-long plays, the Niners' defense was successful on 12 of 14, stuffing the Cowboys for no gain on 7 plays, allowing a total of 33 yards for the 14 plays, and recovering Romo's ill-advised lateral. That's pretty damn good defense if you ask me. Score: Birdie.

Using my golf scoring system, the Niners were 1-over in two holes. They can't shoot above par and expect to win many games on the road against superior teams.

So, taking the most relevant game stats into account, why did the 49ers lose to the Cowboys? Well, it sure wasn't because of their SVW situation on 1st/2nd down. Rather, it was a combination of (a) having a poor red zone offense coached by a poor- red-zone-offense-prone coordinator, (b) the failure to exploit a favorable special teams matchup, and (c) a combination of poor officiating and poor defending (more so the former) on the defensive back end.

Next up this Friday...a preview of the Bills game - gasp - east of the Mississippi River.

**DVOA statistics used to produce this article were obtained from Football Outsiders.

Poll
Which type of suckage was MOST to blame for the 49ers loss to the Cowboys?
Red zone suckage
46 votes
Special teams suckage
0 votes
Deep pass defense suckage
25 votes
Refereeing suckage
3 votes

74 votes | Poll has closed

0 recs  |  Comment 9 comments |

Story-email Email Printer Print

Comments

Display:

Brilliant

Great analysis.

At the end of the year I guess it’s goodbye to Martz.

by Bob On The Coast on Nov 26, 2008 1:18 PM PST reply actions   0 recs

thanks bob...

…and i agree with you about martz. he’s definitely gone after this season. pass-run-pass in the red zone is going to be his 49er legacy.

by Florida Danny on Nov 26, 2008 1:31 PM PST up reply actions   0 recs

I say none of the above...

I think the lack of capitalizing on the pass rush hurt us the most. The majority of the time we didn’t get in the back field and even when we did we couldn’t sack Romo. When Romo has the much time to throw the defense will start to break down. Also I think the game plan on T.O. was appalling. You should always have two guys on him and bump him off the line.

Next year will be our year! (copyright 2003*, been used each of last five years)

by StrictlyFootball on Nov 26, 2008 2:53 PM PST reply actions   0 recs

Then from now on we’ll definitely have to refer to it as the Pass Rush.

My Dave Righetti is better than your Dave Righetti.

by howtheyscored on Nov 26, 2008 3:25 PM PST up reply actions   0 recs

Martz is gone

It was the red zone failure that lost the game for us more than TO goin crazy not to take away from him cuz he was awsome. 3 trips that resulted in 3 field goals is what beat us really. The 9ers still had chances toward the end of the game so if they would’ve capitalized on those 3 redzone trips, it would’ve been a totally different game.

Fans stuck in the 80's are lame. Respect the past, live in the now.

by maveric_87 on Nov 26, 2008 5:59 PM PST reply actions   0 recs

agreed...

…17-0 is a far more daunting hill to climb than 6-0, especially for a psychologically deficient team like the Cowboys. if the 49ers are up 17-0 after the first quarter, i’m convinced that the Cowgirls would have laid down.

by Florida Danny on Nov 26, 2008 9:43 PM PST up reply actions   0 recs

Well

Let’s just say they didn’t. Let’s say it occured to them that they were the more talented team and then they played the game exactly like they did otherwise.

Final score: Dallas 35, Niners 33.

So I assign more blame to the defense.

GROUGTHINK ALERT

by groug on Nov 26, 2008 11:43 PM PST up reply actions   0 recs

First off FD, thanks for the maths as usual.
However, I have some problems with the red zone analysis. Don’t most teams get worse in the red zone? Or are you does FO have some “zone by zone” DVOAs calculated somewhere. To ask a direct question: is the -55.8% for the niners in the Red Zone relative to all offense or to red zone offense.

Second – other than 08 – there is really not much difference in this graph. 1 year above and 3 years below, but mostly it’s right along the line. You have no demonstrated that this difference is statistically significant, compared to other offenses.

Third even if the 2 objections above are dealt with this does NOT proove it’s the OCs fault! We know the end of the Cards game was bad – sure. But many of the Red Zone failures have been JTO and Hill throwing picks in the end zone… and somehow I put more on the player.

I think bigger than Martz, the Niners problem is that their QBs are not good, and this especially shows when the field is condensed. They don’t have a big ‘post lob’ leaper threat at Reciever. And finally – they are a terrible power running team, and have been throughout the Gore years (even when their overall rushing offense was good).

data:
2008 Niners rank 5th in adjusted Line yards, 32nd in power success
2007 7th Adjusted line yards, 24th power success
2006 7th Adjusted line yards, 28th power success
(in 2005 the line was overall horrible).

So despite being a good running team for 3 years, they cannot run in short yardage situations. And if I had some time I would try to correlate that to red zone efficiency, but I think it’s at least as likely a culprit as Martz (also the Picks are bad too).

Anyway it’s an interersting point. I think we should maybe send an email to FO and maybe they will run some numbers and make a column out of it.

FIRE BRIAN SABEAN... UNLESS HE KEEPS DRAFTING WELL. .. AND SIGNS UNDERRATED PLAYERS LIKE AFFELDT OR PHELPS. .. OR ALRIGHT WHO'S PLAYING WITH THE ALIEN MIND-SWITCHING RAY?

by zenbitz on Nov 27, 2008 9:01 AM PST reply actions   0 recs

good insight...

…i apologize in advance if i respond to this in a piecemeal fashion. there’s a lot to digest here, and i’m going to try to focus my digestion today on thanksgiving dinner. :-) a few quick hits though until i can respond more fully:

1) i think the purpose of my article wasn’t necessarily to say that martz’s offenses are worse in the red zone than those run by other OCs. it was to answer the question, “is martz’s reputation as an offensive genius warranted given his teams’ efficiency in the red zone?” the way i looked at it was…here you have a guy who has worked all these miracles with qb’s, coordinated some of the most prolific passing offenses in NFL history, and yet his offenses have consistently been below average in red zone efficiency.

2) i’m not positive, but i’m pretty sure that a team’s red zone performance is compared to league-wide red zone performance, not league-wide all-field-zone performance, for the purposes of DVOA. from what i gather, their calculations are based on within-situation deviations from the mean.

3) regarding statistical significance, keep in mind that, for the purposes of my articles on here, i try to take a look at the stats from a layman 49er fan’s point of view. i’m simply using my stats background as a lens to focus 49er fans’ attention on the most important things to watch in the upcoming game, and on what to take away from the previous game. the normal rules of evidence and procedure, at least those that would be required when submitting an analysis for publication, do not apply in these articles. i definitely take some “artistic license,” and tend to draw stronger conclusions than what would otherwise be warranted given the evidence…all in the name of stirring up conversation. this is certainly not to say that i’m BSing everyone on here. quite the contrary. what i am doing, though, is looking for obvious and easily articulable trends, rather than “statistically significant relationships.” of course, i’m fully eager and willing to look at these things with much more scientific rigor, but that’s outside the scope of my previews and reviews on the website.

that’s it for right now…i’ll be back…in the meantime, feel free to respond to what i’ve said so far.

by Florida Danny on Nov 27, 2008 11:31 AM PST reply actions   0 recs

Comments For This Post Are Closed


User Tools

"We'll see them again in the playoffs." -- Coach Mike Singletary after a gut-wrenching week 3 loss to the Vikings.
Start posting about the 49ers »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Dave_small
Week 11 Prediction Games
Howtheyscoredcat_small
Official Alex Smith [Over]Reaction Thread: Bears Edition
Small
Alex Smith vs Aaron Rodgers(updated)
Small
The Titans/Niners play-by-play
Dave_small
Week 10 Prediction Games

Recent FanPosts

Small
10 things the 49ers should not do
Italian_flag_small
Still think the Niners will reach the playoffs???
2305d0d49c908218_small
Packers fan with some questions
49ers_small
I have a feeling about this particular road game
Joe_and_bill_small
49ers QB - 2010
Small
Jimmy Raye - Ken Whisenhunt
Small
Niners Nation hits the big time
Shaun_hill_small
SINGLETARY WAS HIRED BECAUSE OF SHAUN HILL !!
Howtheyscoredcat_small
Week 10 Prediction Games: The Riveting Results

+ New FanPost All FanPosts >

Latest NFL Headlines from SB Nation

Mobile Live
Eagles shuffle linebackers again
Mobile Live
The VRR: Redskins (3-6) @ Cowboys (6-3)
Mobile Live
Antonio Pierce out indefinitely

SPONSORS


Head Ball Coach

Dave_small Fooch

Editors

Jerry_rice_small ProfessorBigelow

Assistant Coaches

Howtheyscoredcat_small howtheyscored

Pixies_logo_small Florida Danny

M_12a62905a0324d2da2f43ddaf62c630f_small Ninjames

Duct_tape_bandit_small Josh from Hollywood

Crab_tree_small briandean

Moderators

Jackalope_card_small wjackalope