Niners Nation: An SB Nation Community

Navigation: Jump to content areas:


Sports blogs for fans, by fans.
New Blog: Sounder At Heart for Seattle Sounders Fans!

49ers-Jets Statistical Review: Raining on the Parade

The Niners have won two games in a row. Awesome! We have cause for celebration, right? Well, perusing some of Ninjames's Golden Nuggets this week, I've gotten the feeling that I'm the Grand Marshall of a parade, and it's starting to drizzle. The analysis has gone something like this: "Singletary's 49ers have won a couple of meaningless late season games, but Nolan's squad did that too." In making this assertion, proponents cite wins against the Rams and Texans in 2005, the Seahawks and Broncos in 2006, and the Bengals and Bucs in 2007. Now, we all know that the 2005 and 2007 wins come with a bit of a caveat  in that the 49ers' opponents were either crappy (i.e., the Texans and Bengals) or were resting their starters (i.e., the Bucs). So which side is right? Are the Niners' back-to-back wins against the Bills and Jets a sign of change or are they more of the same? In this week's statistical review, I'm going to answer that question using a bit of PG-rated hardcore stat analysis.

BLAME IT ON THE RAIN

The question at hand is, "Do the Nolan era 49ers perform better during the second half of the season than the first?" Since Mike Nolan took over to start the 2005 season, the 49ers have played 32 games (9-23 record) in the first halves of their seasons and 29 games (12-17) in the second halves of their seasons. If you look only at the records, that's a 4.5-game difference, or a little over 1 game better in the second half per season. However, as we all know by now, 4 season-halves per group is a pretty small sample size, so this 1-game difference basically tells us nothing. In order to come to a meaningful conclusion, we have to somehow increase our sample size. The easiest way to do that is to look at each game rather than each season-half. Doing so gives us group sizes of 32 and 29. To make the conclusion even more valid, we also need to account for the 3-game difference in number of games per group. Because that difference is entirely due to the fact that the second half of the Niners' 2008 season is incomplete, we can equalize the group sizes by cutting back the first half of this season to 5 games. But which 5 first-half games should we choose? Well, the best way to do that is to choose them randomly, so that's what I did.

So we have our sample: 29 games played in each half of the season. Now we need to figure out how to measure "49ers performance." Well, you know what I'm going to use for that: the tried-and-true DVOA statistic. For each game the Niners have played since 2005, I obtained their total, offense, defense, and special teams DVOAs from Football Outsiders. Below is a table showing the averages for each half of the season and the differences between them:

Nolan Era

TOT DVOA

OFF DVOA

DEF DVOA

ST DVOA

First Half

-46.94%

-32.93%

16.86%

2.84%

Second Half

-24.81%

-21.10%

5.71%

2.02%

Difference

22.13%

11.83%

-11.14%

-0.82%

After the jump, I'll go hardcore on these stats, and review the 49ers' performance in their 5 SVW situations against the Jets...

Star-divide

OK...So there seems to be quite a difference in the 49ers' performance between the two halves. The only performance consistency they show from one half of the season to the other is on special teams (Remember: Negative values for defensive DVOA mean better defense). Now, that's all well and good, but we need to go one hardcore step further with this analysis: Are these differences - gasp - statistically significant?

To determine statistical significance in this situation, we have to do what's called an Analysis of Variance (ANOVA), which basically tells you whether the average difference between two groups is greater than what would be expected by chance (aka dumb luck). Because we're not trying to cure cancer here, I'm going to use a rather liberal statistical significance level of .10, which means we can be 90% confident that an average difference is, in fact, a meaningful one.

It turns out that the overall and defensive DVOA differences are statistically significant, while the offensive and special teams DVOA differences are not. Specifically, we can be 93.1% confident that the Nolan Era 49ers perform better overall during the second half of the season, and 93.0% confident that they perform better on defense during the second half of the season. In contrast, we can't be sufficiently confident that the offense and special teams perform any better or worse during the second half of the seasons as compared to the first.

So what is there to say about the Niners' second-half performance this season? Is this year change or more of the same? Below is a table showing the averages and differences for this season:

2008

TOT DVOA

OFF DVOA

DEF DVOA

ST DVOA

First Half

-28.46%

-27.62%

6.68%

5.80%

Second Half

-7.94%

-17.40%

-5.10%

4.34%

Difference

20.52%

10.22%

-11.78%

-1.46%

If you ask me, that right there is pretty (site decorum) consistent. Comparing this table with the previous one, the overall and defensive DVOA differences are nearly identical. So what does this all mean?

Bottom line: Hope you had an umbrella, because I just rained on your parade.

THE DEVIL IS IN THE DETAILS

Just to refresh our memories, I identified the following strength vs. weakness (SVW) matchups for the 49ers in their game against the Jets:

Situation

SF Rank

NYJ Rank

SF RED ZONE OFFENSE VS. NYJ RED ZONE DEFENSE

31

5

SF RUSH OFFENSE VS. NYJ RUSH DEFENSE

26

7

SF RUSH OFFENSE VS. NYJ RUSH DEFENSE ON 1ST DOWN

28

6

SF PASS OFFENSE VS. NYJ PASS DEFENSE ON 3RD DOWN

30

8

SF DEFENSE VS. NYJ OFFENSE ON 2ND AND SHORT

27

6

So, aside from the redundant 1st-down rushing SVW, how did they do? See below.

Red Zone Offense - In one word, splendidly. The Niners were successful on 6 of their 13 plays in the red zone, with 1 first down, 1 field goal, and 3 touchdowns. This is even more impressive given that the Jets were the 5th-ranked red zone defense going into the game. Score: Eagle.

Rushing Offense - In one word, shabbily. Of their 33 running plays, the Niners were successful on 13 (5.3 ypc), of which 6 produced first downs and 1 produced a lost fumble. In their 20 unsuccessful plays, they averaged a piddling 1.6 yards per carry. I'll give them a pass though due to the caliber of their opposition. Score: Par.

3rd-Down Passing Offense - In one word, stupendously. The Niners were 7 of 13, with a touchdown. Score: Eagle.

2nd-and-Short Defense - In one word, eh-ly. I wasn't even going to evaluate this one seeing as how the 49ers only had 4 of these situations during the Jets' meager 20:11 of offense, but one of the Jet touchdowns came on 2nd and short. Just had to bring it up. Score: Par.

Using my golf scoring system, the Niners were 4 under par over 4 holes. Like last week, the 49ers' SVW performance reinforced what we already kind of knew about their overall game performance. I like this week's "they played better than the other team" version though.

Next up on Friday...a preview of the once-in-a-blue moon home game for me: 49ers vs. Dolphins in Miami. Frank Gore's not the only one that might to be out of commission this week.

 

**For any statisticians out there who feel that ANOVA is not the correct analysis here because of non-independent groups, I found the same conclusions via a paired samples t-test with 29 randomly assigned game-pairs. I chose to report the ANOVA results instead because they were easier to articulate and present to a non-statistician audience given the same conclusions. The only noticeable difference between the two sets of results was that offensive DVOA change was closer to statistical significance using the paired samples t-test.

**DVOA statistics used to produce this article were obtained from Football Outsiders.

Poll
What is your opinion on the legitimacy of the last two wins?
Legit. They're not the same as Nolan's meaningless late-season wins.
81 votes
Not legit. They're the same as Nolan's meaningless late-season wins.
12 votes

93 votes | Poll has closed

0 recs  |  Comment 16 comments |

Story-email Email Printer Print

Comments

Display:

I think I blacked out from all those numbers and tests!!!

That’s certainly an interesting breakdown of first half vs. second half Nolan teams compared to now and it makes sense looking at things on the surface. Just based on that people would be getting their hopes up for improvement next year, but hopefully this is one cycle that can finally be broken.

Niners Nation - The premier 49ers blog on the Internet!

by Fooch on Dec 11, 2008 9:17 AM PST reply actions   0 recs

Does it really matter?

As a fan are you really evaluating wins based on performance or outcome? Personally, as a fan, I’m more outcome based, a win is a win just the same as a loss is a loss.

by methodrampage on Dec 11, 2008 9:19 AM PST reply actions   0 recs

*edit

“on performance over outcome”

by methodrampage on Dec 11, 2008 9:20 AM PST up reply actions   0 recs

the point here is how we interpret the outcome...

…of course we like to see wins…but do the wins mean that the team is getting better or do the wins mean it’s just more of the same “niners crushing our hopes next season” things.

p.s. i’m starting to get the feeling that you’re just trying to be a contrarian in re my posts.

by Florida Danny on Dec 11, 2008 9:35 AM PST up reply actions   0 recs

Well you did do a great job with your TO projection

I’m just curious what everybody else’s opinion is. Does a fan enjoy a loss where the preformed exceptionally well more than a win where the team played like crap? I watch football because it keeps me entertained and maybe I’m a simpleton that enjoys a win more than any kind of loss but I was just wondering what other people thought. I’m not evaluating the 49ers for their rights to keep my fandom (I’m probably more of an NFL fan than a 49ers fan anyways). I’m just as happy with a sloppy win as I am a clean win.

by methodrampage on Dec 11, 2008 2:12 PM PST up reply actions   0 recs

Um...

I enjoyed the loss to Arizona recently more than the win over Buffalo. That Buffalo game had me squirming.

Better performance makes for a more interesting and entertaining game for me. Why would I want to watch a bunch of guys bumble around the field until somebody eventually comes out on top? I can go watch High School football if that’s what I’m after.

When I see a team execute properly, march down the field, and get outplayed by the opposing D, I am far more entertain than I would be if we made some really sloppy plays against a poor D and just happened to score.

by Cruithear on Dec 11, 2008 2:17 PM PST up reply actions   0 recs

Edit: entertained*

by Cruithear on Dec 11, 2008 2:17 PM PST up reply actions   0 recs

Yes

Now that we are mathematically eliminated from the playoffs, wins don’t matter (except for giving us a lower draft pick). Performance this season also doesn’t matter, except that it is (in my opinion) a better indication of outcome next season. Thus, I am evaluating each game based on performance and not outcome (usually if performance is high, then the outcome is a win).

If this were in the beginning of the season, or if the 49ers were realistically in the playoff hunt, then I would agree that I would be more outcome based. But right now, my goal is future success, and since current performance is a better indicator of future success than current outcome, I would rather see a better current performance.

by rdub49erfn on Dec 11, 2008 10:33 AM PST up reply actions   0 recs

Third Option Please

I’m not sure if the wins are legit or not yet… The win against buffalo didn’t seem as legit as the win against the jets…. However, I think that if Frank Gore plays, the game against Miami will answer the question.

by rdub49erfn on Dec 11, 2008 10:35 AM PST reply actions   0 recs

Even if Gore plays...

… it’s been said that it’s an sprain to the inside of the ankle, which supposedly takes longer to heal, so it’d be hard to gauge performance.

by sfgfan on Dec 11, 2008 10:39 AM PST up reply actions   0 recs

so

what you’re saying is basically that the niners playing better in the second half this year, could just be the same thing we’ve seen the last few years, where we for some reason play better in the 2nd half? But WHY do we play better in the 2nd half?

Still defending Rich Aurilia, and the Niners' classic unis

by wjackalope on Dec 11, 2008 12:04 PM PST reply actions   0 recs

I think...

… a big reason for it is the offense. Based on the numbers above, the offense has always improved in the second half of the season. As a result, the defense is on the field less, helping reduce the amount of stress/fatigue the defense has to endure during the course of a game.

Why does the offense improve? It probably has something (or everything) to do with the fact that EVERY year the 49ers are implementing a new offense. It takes time for a system to start getting into gear, and maybe the second half is that “time” for the 49ers?

by sfgfan on Dec 11, 2008 1:30 PM PST up reply actions   0 recs

That makes a great deal of sense. Earlier in the season, I made reference to the idea that the offense (specifically JTO, though that bit did change) would improve over the course of the year as the chemistry between the quarterbacks and the receivers improved. That could well be what we are seeing now.

If we can maintain a similar offensive scheme next year, we might not see the first-semester slump that we have seen in recent years.

by Cruithear on Dec 11, 2008 2:13 PM PST up reply actions   0 recs

Game control

The statistics are great and I love reading them. Thanks Danny. And thanks Fooch for a great job here.

I have a feeling that these last few games would have had a much worse statistical outcome if Nolan was still the coach. As opposed to the last few years under Nolan, these games all have playoff caliber implications and Sing is getting the W’s.

While the stats are great and don’t prove the case of Singletary making a drastic mathematical improvement, I’m still marching in the rain to Sing and his band. There’s such an emotional and ‘feel-good’ culture shift that is translated from Singletary to the players that you can’t measure with numbers. These last few wins were more than numbers. These guys are playing at a higher level now, and hopefully next year they get the chance under Singletary. He brought FOOTBALL back to this team.

"We'd like to think that tickets will be hard to come by." Bill Walsh

by TripTheNinja on Dec 11, 2008 8:49 PM PST reply actions   0 recs

Comments For This Post Are Closed


User Tools

"We'll see them again in the playoffs." -- Coach Mike Singletary after a gut-wrenching week 3 loss to the Vikings.
Start posting about the 49ers »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Gary05-6_small21_small
Niners Forgotten Man Deserves Pro Bowl Recognition
Montana_action_150-188_1__small
Top NCAA/NFL Prospects
Dave_small
Week 9 Prediction Games
Mc_small
Ask Music City Miracles
Small
The Jimmy Raye play-by-play. Does he really suck?

Recent FanPosts

Small
time to get rid of another coach
Small
What to do about the 49ers Ownership? Ship them OUT!!!!
P1jackson_small
Alex Smith Sucks.
Small
WHY DID WE LET KORY SHEETS GO
Images_small
Titans vs. 49ers: The World According to Madden
Small
summary of NFL Experts picking 49ers to win or lose this season
Small
Playoffs: Details on the 2 horse race...
Montana_action_150-188_1__small
Weapons & Matchups (49ers vs. Titans)
Small
Remaining Strength of Schedule

+ New FanPost All FanPosts >

Latest NFL Headlines from SB Nation

SPONSORS


Head Ball Coach

Dave_small Fooch

Editors

Jerry_rice_small ProfessorBigelow

Assistant Coaches

Howtheyscoredcat_small howtheyscored

Pixies_logo_small Florida Danny

M_12a62905a0324d2da2f43ddaf62c630f_small Ninjames

Duct_tape_bandit_small Josh from Hollywood

Crab_tree_small briandean

Moderators

Jackalope_card_small wjackalope