Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
Around SBN: NFL Players Ready To Welcome Gay Teammate

2011 NFL Draft Results: Projecting QB Colin Kaepernick’s Performance

A week ago, I unveiled a statistical model that best predicts the career performance of QBs selected during the first 4 rounds of the NFL draft. As expected, the 49ers used one of their top picks to draft a QB. Therefore, it seems like a good idea to see what the model has to say about Colin Kaepernick; and the rest of the highly drafted QBs for that matter.

To refresh your memory, here was the equation for the 4-round QB prediction model:

FFPts/G = 7.10 - 0.05*Pick + 0.08*GS

As you can see, the model relies on the pick at which the QB was taken (Pick) and the number of games he started in college (GS). This simple model explained the past performance of QBs reasonably well (R-squared = .359), and accurately predicted future QB performance within about 3 fantasy points per game (FFPts/G).

This past week/weekend, 6 QBs were taken in the first 4 rounds of the draft: Cam Newton, Jake Locker, Blaine Gabbert, Christian Ponder, Andy Dalton, Colin Kaepernick, and Ryan Mallett. If we plug these QBs' pick and GS stats into the above equation, we get the following career FFPts/G projections (ranked from highest to lowest):

Rk

QB

Pick

GS

Projection

1

Jake Locker

8

40

9.81

2

Christian Ponder

12

34

9.13

3

Andy Dalton

35

49

9.10

4

Colin Kaepernick

36

48

8.97

5

Blaine Gabbert

10

26

8.61

6

Cam Newton

1

14

8.14

7

Ryan Mallett

74

29

5.48

After the jump, I'll discuss these projections, relay some thoughts about their potential accuracy, and offer an alternative set of projections based on one of the other models I tested last week...

Star-divide

First things first. Despite being the 6th QB selected, the Niners' newest QBOTF projects to have the 4th-best career performance according to the model. This, of course, is because of the insane number of games he started during his college career, which dwarfs those of the 2 QBs who, despite being drafted higher, are projected to have worse careers.

To put the above numbers into perspective, Locker projects to have a fantasy career something like that of Byron Leftwich (9.66 FFPts/G) or David Gerrard's (10.33), Cam Newton's fantasy career might look something like Quincy Carter's (8.09), and Kaepernick's projects to be somewhere around Rex Grossman's (8.86) or Matt Schaub (9.20).

Now, obviously, these are underwhelming comparisons. That's because of the error inherent in the model's prediction. We can see this if we look at the 84 QBs I used to create the model, and graph their model-based predictions vs. their actual careers (click to enlarge):

Qb_residuals_medium

For the purposes of this discussion, I've highlighted several QBs whose predicted careers were considerably different from their actual careers; basically the ones that are farthest away from the trend line. What you'll notice is that, aside from Aaron Rodgers and Drew Brees, who are both off the charts in terms of their actual careers, the fates of the other poorly predicted QBs were basically determined by what kind of opportunity they had to start. Aaron Brooks and Kyle Orton were both 4th-round picks who were handed a starting job, which is something highly uncharacteristic of 4th-round picks. Jim Druckenmiller was a 1st-round pick who never got that opportunity, which is also highly uncharacteristic given where he was picked. So, the point here is that the model is pretty accurate to the extent that it accurately gauges opportunity. When it gauges the opportunity part inaccurately, it's probably going to get the prediction part very wrong.

As this regards Kaepernick, it would be highly unusual for him to not get the opportunity to start for the 49ers. This is because, as I commented in Fooch's draft-grade post yesterday, QBs taken in the first 2 rounds become the full-time starter by Week 1 of their 2nd season 75% of the time, and only 5% never get a starting opportunity. Furthermore, almost every time, the only reason a highly drafted QB waits any longer than 16 games to become the starter is because there's a productive and/or winning QB keeping them from ascending to the starting lineup (e.g., Rodgers sitting behind Brett Favre). Kaepernick isn't in competition with such a QB on the 49ers, so I think that, insofar as we can accurately gauge his opportunity to start, the model's prediction should be pretty accurate.

Nevertheless, if you're still unsatisfied, here's an alternative prediction based on the 2-round modified version of the Lewin Career Forecast, which I labeled as "LCF3Rev." This model was much better at explaining the past performance of QBs taken in the first 2 rounds from 1993-2006 (R-squared = .431), but was pretty bad at predicting future performance for similar QBs drafted after 2006 (Mean Absolute Error = 3.81). Nevertheless, it's Kaepernick-friendly, and this is supposed to be an uber-optimistic time on Niners Nation. So, here are the 2-round-only projections based on pick number, GS, and college completion percentage (Comp%):

Rk

QB

Pick

GS

Comp%

Predicted FFPts/G

1

Andy Dalton

35

49

0.617

11.68

2

Colin Kaepernick

36

48

0.582

10.62

3

Christian Ponder

12

34

0.618

9.95

4

Jake Locker

8

40

0.540

9.47

5

Blaine Gabbert

10

26

0.609

8.30

6

Cam Newton

1

14

0.654

7.50

Sweeeeeeeeeeeet! Now we're talking about a McNair-esque career. I'll take that.

Comment 69 comments  |  0 recs  | 

Do you like this story?

Comments

Display:

thanks danny, nice work

2011 season can't come quick enough..

by AzNiner on May 2, 2011 10:25 AM PDT via mobile reply actions  

Any thoughts on LCF 2.0 over on Football Outsiders?

They have Kaepernick third behind Dalton and Stanzi (LCF 2.0 predicts for all rounds, not the just the first two).

by Bigmouth on May 2, 2011 10:26 AM PDT reply actions  

hmmm...

i guess it’s nice to see that i have kaepernick 2nd behind dalton in my modified LCF. guess we’re relying on very similar models. haven’t seen LCF 2.0 yet, but i’ll take a look.

by (Florida) Danny Tuccitto on May 2, 2011 10:38 AM PDT up reply actions  

correction...

LCF 2.0 predicts only for the first 3 rounds.

by (Florida) Danny Tuccitto on May 2, 2011 12:28 PM PDT up reply actions  

D'oh!

I misread the Stanzi footnote. Sorry for the misinfo!

by Bigmouth on May 2, 2011 3:37 PM PDT up reply actions  

btw...

i noticed alex smith is now the lowest-projected qb in the LCF sample. good thing niners took him #1 overall. haha.

by (Florida) Danny Tuccitto on May 2, 2011 1:05 PM PDT up reply actions  

Didnt Bill Walsh use something similar

with number of college games started and accuracy%?

by uspsuperman on May 2, 2011 10:31 AM PDT reply actions  

Probably not. Montana’s completion percentage at Notre Dame was under 54%.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:18 AM PDT up reply actions  

In fact, Montana’s overall numbers at Notre Dame were kind of stinky.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:23 AM PDT up reply actions  

but!

he did have come from behind wins on the regular

New Blog Post about Violent Video Games, Music, & Movies & why they should not be censored or banned @
Julio's Realm
Also, follow me on my
Twitter Account

by imjuliooo89 on May 2, 2011 12:26 PM PDT up reply actions  

Couldn’t have.

And I think focusing on the ZOMG FANTASY part of this taking too much credit away from what Danny’s trying to do.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:22 AM PDT up reply actions  

I think Danny can give you a more complete answer than I can, and I don’t want to much it, so I’ll defer to him for this one.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:29 AM PDT up reply actions  

“much it” was supposed to be “muck it up.” Guess I had to muck SOMETHING up after all.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:30 AM PDT up reply actions  

Have another drink

by mcwagner on May 2, 2011 12:11 PM PDT via mobile up reply actions  

Done and Doner.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 12:12 PM PDT up reply actions  

Mistake

You forgot the Harbaugh Armor +2 overall to the projection making him a legend. Homerism doesn’t lie. Nice try Danny.
Seriously, thanks good projection. I would love to have a McNair 2

by mcwagner on May 2, 2011 10:54 AM PDT via mobile reply actions  

Great info!

All these posts keep making be feel better and better about Kaepernick.

by Chefantone on May 2, 2011 11:08 AM PDT reply actions  

I wonder if the Bengels ran similar stats

or if they chose Dalton because his hair matches their jerseys

by reedkrase on May 2, 2011 11:11 AM PDT reply actions  

hair > stats

All the pro scouts know this.

We don't need 8 in the box. We have 52 in the box.

by these3words on May 2, 2011 1:46 PM PDT up reply actions  

The correlation between hair color and team pick is 1. Garcia – 9ers, Palmer, Dalton – Bengals. I’ve done a robust study on it.

go rowand

by lincypoo i wuv u on May 2, 2011 1:58 PM PDT up reply actions  

you're excused...

i don’t mind your skepticism because this system doesn’t use fantasy football points to predict anything.

by (Florida) Danny Tuccitto on May 2, 2011 11:20 AM PDT up reply actions  

Just trying to understand what I'm reading

What I see is projected fantasy numbers being used to predict what type of career Kaepernick might have..did I totally mis-read that?

by ManBearPig21 on May 2, 2011 11:27 AM PDT up reply actions  

Without stepping on Danny’s toes too much…

It’s not using Fantasy Points to project a career. It’s projecting a career and translating that projection to Fantasy Points. It maybe doesn’t seem like much of a distinction unless you really parse it out, but there it is.

Also, while I understand the gut check it takes for a stats minded person to take Fantasy Points seriously, it seems to be as much of a mistake to assume no correlation between high performance and high fantasy numbers (Tom Brady does average more Points per Week than Garrard, and he always will) as it is not to assume that Danny hasn’t normalized the Points system he uses to account for the kinds of totally stupid things that people incorporate into the scoring of their random Fantasy leagues.

Having said this after I said I was going to leave it up to Danny… I hope I got that right, I hope it makes sense, I hope it’s mildly satisfying, and I hope no toes were stepped on in the process.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:39 AM PDT up reply actions  

Wow, ugly double negative in there. I’m not doing well today. My Communication Points per Week average just went down.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:41 AM PDT up reply actions  

Or wait…

/rechecks double negative… carries the two…

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:42 AM PDT up reply actions  

Oh screw it.

Based on Danny’s comment below, I guess I’m making it more complicated than it needs to be anyway.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 11:42 AM PDT up reply actions  

It’s really quite simple once you get the secret decoder ring

by Andrew9erfan on May 2, 2011 1:43 PM PDT up reply actions  

Does it have one of those

whistles on the side? If so then I gotta get me one of those!

by ChesapeakeBay9er on May 2, 2011 4:24 PM PDT up reply actions  

yeah...

basically that’s right. the differences between predicting FFPts/G and predicting some advanced passing stat is negligible; which is just to affirm your “brady scores more and wins more too” comment. for NN’s purposes, given the lack of meaningful impact on the results, i’d just rather use something that people are going to understand and be able to apply, for example, in their keeper league drafts.

by (Florida) Danny Tuccitto on May 2, 2011 11:44 AM PDT up reply actions  

subject/verb agreement fail
the differences difference between predicting FFPts/G and predicting some advanced passing stat is negligible

by (Florida) Danny Tuccitto on May 2, 2011 11:46 AM PDT up reply actions  

the predictions are...

fantasy points per game. it’s not making any statemements about “what kind of career” qbs are going to have in any other way. i’m not predicting how many super bowls kaepernick is going to win, or how many years he’s going to play, or anything. it’s just for the purposes of predicting fantasy points. to the extent that fantasy points is a very easily understandable concept to the vast majority of our readers, that’s my measure of choice.

by (Florida) Danny Tuccitto on May 2, 2011 11:41 AM PDT up reply actions  

Concept being?

That in general (though not 100%) the better performing QB will have more fantasy points. And since many of the people are much more familiar with the meaning of those than other measures it gives them a more understandable “yardstick” to help them judge the final meaning of the indicators? RIght?

by ChesapeakeBay9er on May 2, 2011 4:27 PM PDT up reply actions  

thanks

Honestly, I wasn’t trying to shoot any of this down, I was just seeking clarification, because I wasn’t sure.

Fantasy points come directly from real stats, so I’m not saying its irrelevant..I was just thrown by the headline & the language of “predicts the career performance” before realizing that was the tool you were using.

If your QB is putting up good fantasy numbers he’s likely performing well, that said I’ll take the 15th ranked fantasy guy if he’s going to win 3 superbowls.

Kudos for putting this together, and thanks for clarifying.

by ManBearPig21 on May 2, 2011 11:45 AM PDT reply actions  

too hard to determine

too many determinants to forecast a superbowl. The quarterback does not win superbowls. Teams with a good quarterback wins superbowls. Marino on the 80’s 49er teams may have won two superbowls. I don’t think we can measure guts, clutch, and luck.

by mcwagner on May 2, 2011 12:08 PM PDT via mobile up reply actions  

oh yeah I agree, just sayin.

Some things can’t be measured, obviously, and fantasy points are pretty universal, so as far as projection tools go its a good idea.

Again thanks to everyone who clarified

by ManBearPig21 on May 2, 2011 12:19 PM PDT up reply actions  

Kaepernick's accuracy dramatically improved over his last 16 or so games

So, I think he’s a little short-changed in all of the QB formulas, but I’m extremely psyched to have him aboard.

by whistlingmountain on May 2, 2011 12:01 PM PDT reply actions  

apparently...

football outsider’s updated lewin forecast system incorporates “qb rating improvement from junior to senior year” into the model, which is something akin to what you’re talking about. that system projects kaepernick as 2nd behind only andy dalton, just like the 2nd set of projections i listed in the post.

by (Florida) Danny Tuccitto on May 2, 2011 12:05 PM PDT up reply actions  

Kind of like incorporating a trend model

by mcwagner on May 2, 2011 12:10 PM PDT via mobile up reply actions  

Ahh good point

Our QB is trending up :-) Gotta love trending up. Unless you’re shorting that is LOL

by ChesapeakeBay9er on May 2, 2011 4:29 PM PDT up reply actions  

QB rating? As in college QB rating?

Because for all the trouble I give the NFL QB rating system, it at least offers a very, very rough estimate of relative performance. Whereas the college QB rating system is the kind of joke that jokes tell each other.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 12:12 PM PDT up reply actions  

seems like...

aaron @ FO was equally skeptical, but the fact that junior-to-senior improvement was a significant predictor couldn’t be ignored. in their model, this is more of a measure of “ability to improve as a passer” than of how good the qb is as a passer in an absolute sense.

by (Florida) Danny Tuccitto on May 2, 2011 12:20 PM PDT up reply actions  

that's why...

christian ponder is lower in their projection than in the 2nd set in this post. his QB rating nosedived in his senior year.

by (Florida) Danny Tuccitto on May 2, 2011 12:21 PM PDT up reply actions  

and why...

kaepernick is as high as he is. his qb rating went up 11 points from his junior to senior year.

by (Florida) Danny Tuccitto on May 2, 2011 12:24 PM PDT up reply actions  

Well, at least they’re skeptical. And yeah, I guess you can’t ignore what the model shows.

Still, I wonder if it wouldn’t be even better to apply a less twisted QB rating system to the college numbers and check the model against that.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 12:24 PM PDT up reply actions  

if...

there was one, then i’m sure they would. i mean, it’s no secret that the qb rating sucks as a predictor of anything.

by (Florida) Danny Tuccitto on May 2, 2011 12:25 PM PDT up reply actions  

i was thinking..

your games started variable kinda accounts for that (in that you’d hope # games started is postively correlated with increased accuracy, qb improvement, etc..)

by sleepyotter on May 2, 2011 12:12 PM PDT up reply actions  

apparently...

football outsider’s updated lewin forecast system incorporates “qb rating improvement from junior to senior year” into the model, which is something akin to what you’re talking about. that system projects kaepernick as 2nd behind only andy dalton, just like the 2nd set of projections i listed in the post.

by (Florida) Danny Tuccitto on May 2, 2011 12:05 PM PDT up reply actions  

I’d like to see these same projections from previous drafts and see how the projections turned out.

I’ve always maintained that football is a sport that’s much harder to statistically evaluate than any other one. Doesn’t mean you can’t, but it’s hard, when taking into account different players are in different environments in relation to schemes, play calling, talent at the skill position, o-line, etc….

I do know that Ricky Stanzi was the safest statistical QB in this draft class and my favorite on tape. Hopefully Colin proves me wrong!

Harbaugh can turn any QB into a great one. He's a QB guru, even if he's only been a head coach at the college ranks.

by BustaTheRippa on May 2, 2011 12:43 PM PDT reply actions  

i did that already...

see the last part 5 of my posts 2 weeks ago. predictions are off by aboutt an average of 3 points per game.

by (Florida) Danny Tuccitto on May 2, 2011 12:51 PM PDT up reply actions  

for qbs drafted...

in the first 4 rds from 2007-2009. those were outside the sample i used to create the model (1993-2006).

by (Florida) Danny Tuccitto on May 2, 2011 1:00 PM PDT up reply actions  

thanks, just read your part 5. Good stuff.

Harbaugh can turn any QB into a great one. He's a QB guru, even if he's only been a head coach at the college ranks.

by BustaTheRippa on May 2, 2011 1:05 PM PDT up reply actions  

Thanks Florida Danny...another great post

I always enjoy your posts. I’m a statistician, though not in your league as I normally have to read some parts of your articles two or three times to grasp what’s being said!

Anyway, I was wondering if you have done (or could do) a post that looks at the likelihood of success in the NFL for a college senior, junior or in the case of Aldon Smith, sophomore.

Obviously there has been a lot of talk about this being a “developmental” draft and I read Coach Harbaugh’s comments that all drafted players are to an extent, developmental. But I guess my concern with Aldon Smith is that he only has 2 years of college football behind him. Similarly , Anthony Davis was a junior coming out of college. Is there any evidence that a senior is more likely to be successful earlier in his career or that he will have a more successful career than a junior? Is it dependent on position?

by Glasgow_49er on May 2, 2011 2:49 PM PDT reply actions  

I’m kinda stunned that Locker was rated so highly in the first one, considering one of the things you’ve always talked about with respect to predicting QB success was a 60% completion percentage, which Locker never achieved in his four years of starting.

GROUGTHINK ALERT
This baseball thing is pretty cool

by groug on May 2, 2011 3:53 PM PDT reply actions  

i mentioned...

in part 5 of the series last week that, when you extend the system from 2 rounds to 4 rounds, completion percentage is no longer predictive. locker’s worse in the 2nd set of numbers i listed above because that one does incorporate completion percentage.

by (Florida) Danny Tuccitto on May 2, 2011 5:43 PM PDT up reply actions  

What I find interesting in all of this is how much experience seems to count.

Sheer experience.

Simply playing more college games.

Simply getting starts in the NFL. In a way, the Druckenmiller “wait for him to develop” strategy is only hurting your prospect. In a way, Aaron Rodgers completely bucked the odds after taking so many bench days for so many years. In a way, Kyle Orton really demonstrates the winning model, starting for three full years in college, and then getting the lion’s share of starts with the Bears during his first handful of years in the NFL. Just that sheer experience paints such a broad picture of the success he’s enjoying today, a fourth round pick, a who came with no expectations.

So, hell. Who needs Alex Smith again (though an argument can be made that, with his NFL experience, he’s on the David Garrard/Kyle Orton/ track)? If he’s any good at all, get CK in there from day one. Just give him the starts now. Do it now and reap the rewards in 2013.

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 4:14 PM PDT reply actions  

(Orton, also, demonstrating that JR —> SR improvement in college)

Currently stifling the bacon, the world.

by howtheyscored on May 2, 2011 4:15 PM PDT up reply actions  

i agree...

wholeheartedly. just to extend the thought though, what makes accurately projecting low QB draft picks like brady, cassel, etc. is that the only thing that seems to separate these guys from the 100s of similar picks who did nothing is just that they happened to be next up on the depth chart, and either the team was forced to start him or the coach decided to give him a shot. aaron brooks is another perfect example. he was a 4th-rounder, which means it was highly unlikely he’d ever get his shot, especially given the fact that he was drafted by GB, who had favre and hasselbeck ahead of him on the depth chart. realizing he was never going to see any snaps, GB decided to trade him to NO, where they had crap for QBs. lo and behold, he ends up becoming the starter after a sea of guys higher on the depth chart blew their chances. he then craps out a 12 FFPts/G career, which is a full 10 FFPts/G better than what the 4-round stat-based model predicted; and it was all because of a fortunate chain of events that there’s no way anyone could have predicted.

by (Florida) Danny Tuccitto on May 2, 2011 5:49 PM PDT up reply actions  

correction:
what makes accurately projecting low QB draft picks like brady, cassel, etc. so difficult is…

by (Florida) Danny Tuccitto on May 2, 2011 5:50 PM PDT up reply actions  

Question

Is the weight given to where they were picked because of their probability to start or are we assuming they are better talent this the earlier they are drafted? I’m guessing probability of starting chances? My question is what if teams overvalued a player, or does it take into account the fact that they went early to a terrible team vs being picked in 20s to a more established team with more talent?

So is Alex Smith graded higher as a #1 pick and is his surrounding cast taken into account over Rodgers for instance being picked later thus to a better team by NFL design? That would be an interesting analysis.

by hudd07 on May 2, 2011 10:55 PM PDT via mobile reply actions  

I will add

I wonder if there is any correlation with being picked towards beginning of a round vs end of a round. Dalton beginning of Round 2. Mallett towards end of 3. Who has better career even though different rounds based on team quality. Kind of a nature vs nurture argument I guess.

by hudd07 on May 2, 2011 10:58 PM PDT via mobile up reply actions  

correlation

is actually backwards….the worse the team was the prior year, the better the QB ends up being. of course, this is just a byproduct of 2 things. first, worse team = higher pick = higher chance of picking more-talented QB. second, and this is just my theory, the QBs drafted to crappy teams get a lot of practice throwing the ball early in their careers because their teams are behind so often. if the guy’s worth the high pick, all that in-game throwing practice makes him that much better (think peyton manning drafted to 3-13 colts, sam bradford drafted to 1-15 rams, etc.).

by (Florida) Danny Tuccitto on May 3, 2011 10:16 AM PDT up reply actions  

Dalton

Dalton was not on the 49er radar. Coach H said in his press conference that they called Colin on Friday morning and told him they would try to select him that day. IF I am not mistaken, he also said something about trading up in the 1st rd didn’t work out and neither did the 33 pick trade. He also said ’It was always Colin" I think Coach H saw all the things he wanted in his qb and that was all it took.

by KaepernickFanForLife on May 3, 2011 3:32 AM PDT reply actions  

Comments For This Post Are Closed


User Tools

Media Requests please email ninersnation@gmail.com

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Small
Site Decorum: Remember, We Are ALL 49er Fans

Recent FanPosts

Small
Concussions...
Small
Is Harbaugh lying or does he mean what he says?
872_small
Where have you seen 49er players?
Download2_small
Can the 49'ers Maintain their Turnover Differential in 2012?
Sfak_small
Why are you a 49er fan?
6a00e5500c77218833011168f234b4970c_small
FOX: "How To Save The Sport"
Small
Old Spice Patrick Willis Football ProCamp
Dave_small
Call For Moderators
Steve_young_small
Game Day Food

+ New FanPost All FanPosts >


Head Ball Coach

Dave_small David Fucillo

Howtheyscoredcat_small howtheyscored

313483_2054510893373_1562580382_31984672_1965025_n_small James Brady

Coordinator

Pirates_small smileyman

Bowman_avi_sm_small Tre9er

Assistant Coach

Pixies_logo_small (Florida) Danny Tuccitto

Memento-lies_small urnext

Me_on_beach_small WesHanson

Dylan_cannes_small Dylan DeSimone

Officiating Crew

Jackalope_card_small wjackalope

These3words_small these3words

Joe_and_bill_small twolfe2

428030_10150598134996875_112852666874_9167376_1157036734_n_small mikeinsp