2011 49ers Season: Statistical Anatomy of a Turnaround
AUTHOR'S NOTE: This post is a more-in-depth version of the infographic David posted earlier today. Several of the themes overlap, so consider what you read here a text-based supplement to the pretty picture created by Beyond the Box Score.
Each Thanksgiving, millions of people travel home to celebrate with their family. It's only fitting then that I cyber-travel from Football Outsiders back to my internet home, Niners Nation, to celebrate the 9-1 San Francisco 49ers with my extended football blogging family. No doubt, there's a lot to celebrate about this team, not the least of which is that, for the first time since the pre-NN days, they're actually a relevant NFL squad in late November.
The question I'm going to try to answer today -- with statistics, of course -- is, "How did they get here?" We know what's changed in terms of what we've seen with our eyes. For instance, this year's team plays much smarter than those of recent vintage: gone are the stupid false starts, delay of game penalties, and blown coverages that made us want to throw a brick through our televisions. Heck, in the space of one lockout-shortened offseason, the 49ers have seemingly gone from the second-dumbest team in the NFL -- the Raiders are always the dumbest, obviously -- to one of the smartest.
Although our eyes are a vital source of football perception, statistics can help to supplement what we see, and provide additional nuance about things to which we may not have paid much attention. In addition to watching (and charting) plenty of game film at Football Outsiders, we evaluate teams using a play-by-play efficiency measure called defense-adjusted value over average -- DVOA for short.
After the jump, an in-depth look at the statistical improvements that have fueled the 49ers turnaround in 2011...
Despite its complicated name, DVOA is a pretty simple statistic that does a very good job of explaining why teams win or lose (See here for a detailed explanation). Essentially, DVOA is just a team's play-by-play success rate, adjusted for opponent and game situation. For instance, the 49ers' current total DVOA of +23.3 percent means that, all else being equal (i.e., average opponents, average game situations), their plays have been 23.3 percent more successful than the average NFL team; good for fourth-best in the league. For your brain's sake, I'm going to focus on DVOA rankings because that's a language everyone can understand no matter his or her mathematical acumen.
So, without further delay, let's dive right into what Football Outsiders' statistics reveal as having fueled San Francisco's massive, warp-speed turnaround in 2011.
IMPROVEMENTS ON OFFENSE
Much has been made about the 49ers' improved running game this season, which I'll get to shortly, but the bigger change on offense has been in the passing game. Last season, with a revolving door of quarterbacks, San Francisco's pass offense finished 24th according to DVOA. This year, it's ranked seventh.
Getting into the weeds a little bit, that improvement has been driven by two things: (1) Alex Smith isn't throwing interceptions as frequently, and (2) the pass offense overall has been much better on third down. In 2010, Smith threw interceptions on 2.9 percent of his dropbacks (i.e., attempts plus sacks), but that's dropped all the way to 1.4 percent so far in 2011. In terms of third-down passing, the 49ers were a below-average team last season, ranking 23rd in DVOA for that situation. This season, they're an above-average unit that ranks 11th.
Turning to the run offense, their overall DVOA ranking is actually worse this season (22nd vs. 17th). However, they're doing three things much better in 2011 than they did in 2010, and those improvements are making them more pleasing to the eyes: (1) running outside better and more often, (2) running better in the open field, and (3) running better on first down.
For anyone who used to read my Niners Nation material back in the day, one of my pet peeves about San Francisco's offense the past several years was its soul-crushing predictability. One way in which this manifested itself was that everyone in the stadium knew that their runs were going up the middle. Indeed, last season, they ran in that direction about 63 percent of the time, and only ran outside the tackles about 15 percent of the time. So far in 2011, they've brought their up-the-middle rate more in line with the league average frequency (49 percent), and have nearly doubled their frequency of outside runs (27 percent).
In addition to running outside more, they've also become increased efficiency by leaps and bounds on such runs, especially those to the outside right. Specifically, after finishing 2010 ranked 27th in this run direction, they're currently the No. 1 unit in the league. It turns out, however, that, as I mentioned earlier, their runs in every other direction have either gotten less efficient or have remained just as efficient as last year. That's beside the point, though. In my mind, the biggest effect of this year's change in direction -- so to speak -- has been to force opposing run defenses to actually play run defense. In other words, the mere fact that they're less predictable this season has opened things up for the rest of the offense.
With respect to open-field running, the scuttlebutt last season -- even before he got injured -- was that Frank Gore had lost a step, with part of the evidence for this being his seeming inability to turn a 5-yard run into a 50-yard run. At Football Outsiders, we have two stats to measure this kind of thing. First, there's second-level yards per carry (2LYPC), which only considers rushing yards gained between 5 and 10 yards past the line of scrimmage. In other words, if Gore has consecutive 8-yard runs, then his 2LYPC is 3.0. Second, there's open-field yards per carry (OFYPC), which only considers rushing yards gained more than 10 yards beyond the line. So, if Gore has consecutive 40-yard runs, then his OFYPC is 30.0.
According to these two stats, intuition was probably right in 2010: The Niners run offense (i.e., Gore and his injury replacements) ranked 26th in 2LYPC and 20th in OFYPC. This year, however, these rankings have been turned on their heads, as essentially the same unit (plus Kendall Hunter) currently ranks 11th in 2LYPC and fifth in OFYPC.
Finally, the 49ers' run offense has become an elite unit on first down (fifth) after ranking near the bottom of the league last season (28th). As was the case with their improvement in outside running, the benefit of increased efficiency via first-down runs is more than just the yardage per se; it also has the happy byproduct of making the offense more flexible in its play-calling. On 2nd-and-long, defenses can anticipate pass with high confidence. On 2nd-and-short or 2nd-and-medium, it's much harder to predict what's coming.
IMPROVEMENTS ON DEFENSE
While many people, including some of my closest friends, were threatening to burn me at the stake for questioning the 49ers defense in recent years, I could never get past the fact that their pass defense got abused against teams that were good enough to exploit it, and that the defense overall seemed to fold just when the team needed them most (See last year's Falcons game). Well, getting much better in both of these areas has contributed greatly to San Francisco's six-win improvement through the first 10 games of 2011.
Last season, the 49ers' pass defense ranked 24th in the league according to DVOA. This season, it's seventh-best. Furthermore, this improvement has been evident on both first and second down, where they've gone from 25th to ninth and 19th to fifth, respectively.
Regarding the defense's overall ability to close out games, their statistical ranking last year in late-and-close game situations (i.e., second half of game with score gap less than 8 either way) conformed nicely with my subjective view: they ranked 21st. This season, they've finished like Singletary wanted them to, but was never able to get them to. Through 10 games, the Niners own the fifth-best defense in the NFL when the game is on the line.
IMPROVEMENTS ON SPECIAL TEAMS
As other pundits have cleverly pointed out, Jim Harbaugh has coached up the 49ers to play Singletary-style football better than Singletary himself ever did: Mistake-free, ball-control offense plus great defense plus great special teams equals wins. As is often the case, the least heralded of the three units so far this season has been the special teams. After finishing 2010 ranked 21st in special teams DVOA, they're currently ranked second, and were ranked first the entire season until Sunday's Keystone Kops routine on field goals.
In large part, the overall improvement in special teams has been due to winning the field-position battle on kickoffs, both in coverage and returns. Last season, their kickoff coverage unit was the third-worst in the NFL; this year it's the eighth-best. Similarly, the kick return unit ranked 22nd in 2010; it's currently fourth in 2011.
IMPROVEMENTS ON HIDDEN THINGS
I'll finish up with a few things that the 49ers have improved at, but have exerted more of a covert influence on the team's turnaround. They're statistics that are not unrelated to performance and wins so much as they're indirectly related.
The one hidden improvement that's probably done more for the psyche of Niners Nation than anything else is that San Francisco is a much (much!) more consistent team in 2011 than they have been in recent memory. In fact, even going back to the Mooch days, I can't remember the last time you knew exactly what you were going to get each week from this team.
At Football Outsiders, we have a statistic called "variance," that tells us how consistent a team's efficiency has been from game to game. Last season, San Francisco was the fourth-least consistent team in the NFL, which shouldn't surprise any of you. This season, however, they're the fifth-most consistent. A big reason for this increase in week-to-week consistency is that they're no longer a horrible road team. Namely, their road offense DVOA ranking has jumped 13 spots, and their road defense DVOA ranking has jumped 12 spots.
The final two hidden improvements have to do with the aspects of the game that have as much to do with luck as anything else, both of which concern the 49ers defense. First, that unit has been one of the healthiest in the league so far, with starters having missed a combined 5 games out of a possible 110: Dashon Goldson's missed two, Donte Whitner's missed one, and Ray McDonald's missed one.
Second, the defense has recovered fumbles at a rate that suggests the footballs are bouncing their way. Specifically, of the 15 times their opponents have fumbled, San Francisco has recovered 10. Fumble recoveries are random events, so the 49ers defense has essentially won a coin flip 17 percent more often than they should have. Obviously the footballs their playing with are not akin to loaded dice, but the fair dice coming up craps a few more times this season might have left them with a worse record. A concrete example of this is Goldson's sideline-defying fumble recovery that sealed the Niners' win over the Eagles. One could reasonably argue that that win -- ultimately the result of a fortuitous bounce -- signaled their arrival to playoff contention, cemented the players' faith in Harbaugh, and propelled them to six more wins in a row (so far).
BOTTOM LINE
It doesn't take statistics to realize that the 49ers are a much better team this year than last. However, statistics can help to shed light on some of the specific manifestations and mechanisms behind their improvement. To wit, the main stat-based differences between 2010 and 2011 are as follows:
- The pass offense is more efficient overall, mostly because Smith is throwing fewer interceptions and that they're much better on third down.
- The run offense has gotten better at utilizing carries to the outside, gaining extra yards downfield, and efficiency on first down. Each of these has helped make the offense less predictable overall, which has had residual effects on the passing game.
- The pass defense is much more efficient.
- The defense as a whole doesn't fold anymore when the game is on the line.
- The special teams has contributed more towards winning the all-important field position battle, especially on kickoffs.
- The team's week-to-week performance is more consistent, largely because they actually show up to road games now.
- They've been very lucky on defense in terms of health and fumble recoveries.
40 comments
|
3 recs |
Do you like this story?
Comments
Very interesting, I love this stuff, but you forgot the most important statistic.
The Singletary to Harbaugh ratio.
2010: 1 / 0
2011: 0 / 1
That is an elevety trillion percent increase. (Roughly, I obviously rounded)
Joe, Jerry, Steve, and....Who is next?
by 16to80fan on Nov 23, 2011 4:51 PM PST reply actions 8 recs
I like your math
Straightforward, but accurate.
Rec’d!
"Football combines the two worst things about America: It is violence punctuated by committee meetings" -George Will
by lottwasgangsta on Nov 23, 2011 7:50 PM PST up reply actions
believe me...
it took all of my intestinal fortitude not to reduce this post down to “Harbaugh >>>>>>>>>>> Singletary.” instead, alluded to it indirectly.
by (Florida) Danny Tuccitto on Nov 23, 2011 11:32 PM PST up reply actions
I don't have NFL Network...
Any suggestions on how I can watch the game tomorrow?
Matt Cain, Tim Lincecum, and Madison Bumgarner,
L2WIN.
FFFFFFFfff...
it should be on local television
assuming you are local…
by Sigelvictory on Nov 23, 2011 5:36 PM PST up reply actions
How did you find that out?
I’m in SJ CA and I have FOX and CBS but no NFL Network. Don’t get my hopes up here :P
Affectionately,
Kareem Abdul-Jabbar,
NBA’s All-Time Leading Scorer
by afrikabamboodle on Nov 23, 2011 7:56 PM PST up reply actions
Google TV Listings in your area.
Easy day.
~In Heaven all the interesting people are missing~
by ~Yellow Fever~ on Nov 23, 2011 8:35 PM PST up reply actions
My head hurts...
How much film do you guys breakdown? Very impressive and interesting stats, thanks!!!
by Frisco_Kid on Nov 23, 2011 5:15 PM PST via mobile reply actions
Couple Things
Ideas on the injury front: Not completely due to luck in my opinion. Little things like Harbaugh making his quarterbacks wear knee braces. If the head coach is focused on incorporating injury prevention into the game plan, then it might also fit into the scheme a little bit. Staying home in your assignments means players are not out of position as muc,h means players aren’t having to try and take heroic actions just to make a stop or get a first down. The biggest injuries this year( josh morgan, braylon edwards, frank gore) came when a player was making an extra effort to try and gain yards or make a first down. Playing within the scheme of an offense, hitting with leverage on offense rather than with slipperiness, and taking proper angles to the football all lead to a slightly better chance of NOT getting hurt. Also, in general, the 49ers are a fairly young football team, and younger players recover from minor injuries more quickly.
As for fumbles, might a fumble recovery rate improve for a defense if they are consistently playing all the way through a snap, and collapsing on a football. Teams that are considered “well coached” and “disciplined” would seem to in general recover more fumbles due to their swarming for a tackle, maintaining gap integrity(thus ensuring players are in the likely lanes for a ball to travel, even when fumbled, as a ball will generally fumble forward in the direction the ballcarrier was moving, and as such, into the path of an oncoming player) and also in general hustle and awareness of the football. Good coaches coach being aware of the football, no matter if you are a D-lineman or a CB.
Just my two cents. Any ideas negating any of these thoughts would be greatly appreciated. Great article though, love love love football when it is covered in this great of depth.
by repytpeels on Nov 23, 2011 5:20 PM PST reply actions 1 recs
The ball bounces funny
FO have looked at fumble recovery rates over many seasons and they are random. I needed to be convinced too, intuitively I came up with the same arguments that you have in your second paragraph but the evidence is just overwhelming. Forcing fumbles is a repeatable skill, recovering them is random. Have a look on the football outsiders website, there’s probably an article covering it in their archives.
by Karl Cuba on Nov 24, 2011 4:45 AM PST up reply actions 2 recs
Like Karl Cuba said...
…everything reptypeels says makes intuitive sense. But if statistical analysis has taught me anything, it’s that we often can’t trust our intuitions!
Nicely done, Danny. Really interesting.
one minor corr: i think you mean: dropbacks = attempts plus sacks plus “scrambles”)
if the quarterback scrambles for positive
yardage it becomes a run and is counted accordingly… sacks go against pass yardage so “scrambles” are exempted from dropbacks… that is my understanding anyway.
by Sigelvictory on Nov 23, 2011 5:41 PM PST up reply actions
I see what you mean.
That makes sense, but I think it is misleading. (Since a pass play was called and executed.) I get it now though. It just goes in the run stats, like a called run play.
yeah...
…scrambles are part of dropbacks, but i was using “dropbacks” as shorthand more than trying to be technically correct. as a writer, have to consider the audience, you know.
by (Florida) Danny Tuccitto on Nov 23, 2011 11:30 PM PST up reply actions
I have a few questions.
They have to do with DVOA of the 49ers nickel vs base D.
What is the DVOA of base and nickel, respectively:
1) against the pass?
2) against the run?
Is this something you guys can separate out and analyze?
Does this question seem clear? I can clarify.
questions clear...
…we just won’t be able to compile that info until after the season. if you remind david or i this offseason, i’d be happy to provide it on here.
one thing i can say is that, from what i’ve seen on film, SF basically plays base 3-4 on first and second down, and then switches to nickel on 3rd. they play nickel on early downs only very rarely. therefore, i’d suspect that, given how much better their DVOA is right now on first and second down, their base D is probably way better.
by (Florida) Danny Tuccitto on Nov 23, 2011 11:43 PM PST up reply actions
i'll add...
…that the reason they play base 3-4 so much is because they get tremendous pressure from rushing only 4 (DL + one OLB). they’re not like PIT, GB, and DAL, which are teams that need disguised blitzes to generate pressure in 3-4 from anyone besides james harrison, clay matthews, and demarcus ware. i’d say that, right now, SF gets the best non-exotic pressure from base 3-4, and STL gets the best non-exotic pressure from base 4-3.
by (Florida) Danny Tuccitto on Nov 23, 2011 11:49 PM PST up reply actions
Hate to quibble but...
I disagree with your take on how the 49ers move between 3-4 base and nickel. I’m pretty sure they respond to the offense. Look at the snap counts for the Detroit game. The Lions run very little 21 personnel and use mostly 3 receiver sets (especially during the period when Scheffler was injured which stopped them using their 12 package) and in that game Parys Haralson barely played. However against teams like the Bengals, who use a lot of I-formation Aldon Smith only saw about 20 snaps.
oh yeah...
they do play much more nickel against team’s like DET. they just haven’t played many teams like DET, except for…DET. he was asking about what their stats are so far, so i was just pointing out that — without being able to say for sure what the exact stats are — they’ve played a lot more 3-4 than nickel. far more non-DET-type teams in that play sample.
by (Florida) Danny Tuccitto on Nov 24, 2011 11:18 AM PST up reply actions
Ball security
except for Crabtree a couple times (carrying a ball carelessly) I get the impression the niners are really aware of ball security much more than in the recent past. This includes DBs after interceptions. Presumably that shows up in our giveway/ takeaway differential.
Counter plays
I’ve noticed really effective counter plays so far this season. Do you guys track this at all? Seems the fear of a straight up kick your teeth in run has opened up quite a lot of counter room.
I’ve always enjoyed your stat filled articles. Gives some excellent context to go along with what we see and just think we’re seeing.
well...
we don’t track counters vs. dives (and so on), but, from what i’ve seen, it seems like the OL is a lot better this year at getting to the second-level (and beyond), and harbaugh/roman does a much better job than raye at outnumbering the opposing D at the point of attack. they use a ton of 3 TE sets, often on the same side of the field. when they also include a FB in the 3TE formation (which is most of the time), it ends up being a simple case of having more of your’un than they have of their’un.
by (Florida) Danny Tuccitto on Nov 23, 2011 11:53 PM PST up reply actions
Sopoaga
He also missed 1 game to injury. So a possible 6 out of 110. Simply an awesome stat really. Looking at the rest of the league, its astounding to see how many guys have missed games. I’m guessing the short offseason of training camps has alot to do with it. Hopefully we can keep it up(knocks on wood).
Still a pleasure, as always, to hear from good ol' Florida Danny.
Hope FO is treating you well.
"It came down like a punt, Coach!"
- Josh Morgan, in reference to a Shaun Hill "deep" ball.
by shlecko on Nov 23, 2011 6:58 PM PST reply actions 1 recs
thanks...
…and it is. wish i had more time to contribute to NN, but such is life.
by (Florida) Danny Tuccitto on Nov 23, 2011 11:31 PM PST up reply actions
Florida Danny, you are very clever
And I have no doubt that your statistical indexes provide a more accurate picture of what really happened…
But I just can’t shake the feeling that Patrick eff’n Willis decided that he had HAD IT!!! WITH THESE MOTHERF&*&(%( LOSSES ON THIS MOTHERF)$)%U^ PLANE!…
Correspondingly, the other Niners decided that winning damn near every game was wiser than risking his wrath….It’s what I’d do, in their situation.
"Football combines the two worst things about America: It is violence punctuated by committee meetings" -George Will
Great work dude, was hoping to read more FO stats about the Niners. One interesting stat relating to offensive consistency, the Niners rank #1 in least amount of INT per drive (0.34). Behind the Niners are the Packers (0.49). The Chargers were the worse with .159 INT per drive.
thanks man...
…appreciate it.
one thing i’ll add to your INT stat is that, per our adjusted INT rate stat that was feature in our book this year, smith’s INT rate last year was one of the best in the league when you account for tipped balls, WR drops, etc. he wasn’t getting lucky last year, and he’s not getting lucky this year. he just has an INT rate that’s sooooo low that it’s almost unsustainable over the long haul, kind of like what happened to brady and vick last season.
by (Florida) Danny Tuccitto on Nov 23, 2011 11:38 PM PST up reply actions
Reading this thread got me thinking about our D statistically. We've all heard, over and over,
parts of this, but here it all is, all in one place at one time:
~fewest points allowed per game: NFL rank: 1st
~fewest rush yards allowed per game: NFL rank: 1st
~number of passes defensed: NFL rank: 1st
-—————————————————————————————————————-
all of the following are interrelated:
~turnover differential: NFL rank: 1st
~most takeaways: NFL rank: 1st
~most opponents fumbles recovered: NFL rank: 1st
~most opponents passes intercepted: NFL rank: 2nd (tie)
~fewest giveaways: NFL rank: 1st
~fewest interceptions thrown: NFL rank: 1st
~fewest fumbles lost: NFL rank: 5th (tie)
-—————————————————————————————————————
~fewest total yards allowed per game: NFL rank: 8th
~most sacks made: NFL rank: 13th (tie)
~fewest passing yards allowed per game: NFL rank: 23rd
Most of these are purely defensive statistics, though a few offensive stats are provided to allow a few stats that are a blend of O & D. DOES THIS DEFINE “ELITE”, OR WHAT????
After all was said and done, a lot more got said than done.
Genuflection
Nice work Danny, I’m happy for you that you’ve found a home at FO but I do miss your niner focused work over here.
Great stuff, Danny!
We were discussing recently why the pass DVOA was so much higher than run DVOA. Some suggested it reflected a flaw with the statistic in the sense it punishes players like Gore who bear a disproportionate burden of the offensive load.
I suppose there’s some truth to that in the sense the passing offense would probably decline in efficiency with greater use. But I wonder to what degree it’s also because the few times Alex has been called upon in high-leverage “clutch” situations, he’s responded.
I know with EPA and WPA we can look at the difference and determine “clutch.” Can we do the same with DVOA by, like, comparing it to DYAR or something. Anyway, just thinking out loud. Great stuff, as always!
Mucho gracias Danny -
little tired of brothership.
Have a bro fighting cancer who’s without a computer & he thrives on printouts that go beyond the People’s Mag type of sports fare.
When I was in grad school in early 60’s tried to get a partner interested in a contingent statistics sports service. Instead of saying, “I could have been a contender,” I can now say, “I could have been Florida Danny!”

by 












































