The NFL Draft: Is it High Stakes Poker or Roulette?
Over in the draft and FA threads we've had an interesting discussion about the rate of busts in the first round and in particular in the top 10. I thought that was a good question and decided to do some research on it. I wanted to look at the position, the year drafted, the pick and the team to come up with any idea of the success vs failure rates.
The first thing I had to do was come up with some sort of reasonable definition of bust. For me a first round pick should come in and be an almost immediate starter for you. They should also be a long term starter for you--if you have a guy that only plays for one or two seasons for you that's a waste of a pick. I also think that a first round pick should be better than most of the rest of the league. Here's how I decided to grade the players.
Criteria #1--Are they a starter by their 3rd season?
Criteria #2--If they were a starter during their 3rd season are they still a starter during the last year of their original contract? (Generally the 4th or 5th season)
Criteria #3--If they met criteria from #1 and #2 were they in the top 30% at their position?
With the top 30% rule I tried to be as generous as possible. For players with stats (basically everybody but offensive lineman), I used their best year and their best statistical category. For offensive linemen I had to dig a little deeper. Profootballfocus has rankings from 2007 through 2009 so I used those to help determine a player's ranking. For players not in that database I hasd to do some searching to see how they were viewed during their playing days.
One final note--if players left their original team and then turned it on with a new team I still counted them as busts, since they were not successful with the team that drafted them.
I didn't want to overwhelm myself with doing too much research, so I limited myself to players drafted from 2002 through 2009. The reason I did this was because that was the expansion year of the Houston Texans and I wanted to make sure that each team had the same number of years to choose from. That still gives us 256 players to choose from and 8 drafts so I think it's a large enough sample to give us a pretty good idea of where things stand.
I created a spreadsheet to help me sort the data--for those interested you can download it and play around with it or add to it if you would like to.
Join me after the jump as I tell you who the best and worst drafting teams in the NFL are (and they're probably not who you think they are).
First let's look at which teams are the best and worst at drafting in the first round. Here are the worst five teams at drafting.
| Team | Bust? | Non-Bust |
| Bills | 7 | 0 |
| Cardinals | 5 | 2 |
| Jaguars | 5 | 1 |
| Lions | 5 | 1 |
| Texans | 5 | 2 |
Surprisingly enough it's not the Lions who hold the number one spot. It's the Bills. Now the Lions aren't very good either, striking out on 5 out of their 6 first round picks, but the Bills haven't had a single success in the first round.
The results from the best teams are surprising as well.
| Team | Bust | Non-Bust |
| Steelers | 0 | 6 |
| Colts | 1 | 5 |
| Jets | 1 | 5 |
| Eagles | 2 | 4 |
| Cowboys | 2 | 4 |
As bad as the Lions were drafting the Steelers were that good. Drafting badly won't make you a perennial loser (Cardinals made the Superbowl and the playoffs despite not drafting well), but drafting excellently will certainly improve your chances of being a playoff team.
Now let's look at the positions in the draft and see which ones are safe bets and which ones aren't. The highest bust rate will surprise you, and the safest selection will also surprise you.
| Position | Bust | Non-Bust | Percentage |
| WR | 17 | 4 | 81 |
| DE | 16 | 12 | 67 |
| RB | 10 | 5 | 67 |
| QB | 10 | 6 | 63 |
| DT | 12 | 8 | 47 |
| OT | 7 | 8 | 43 |
| DB | 17 | 20 | 46 |
| C | 1 | 2 | 33 |
| LB | 4 | 12 | 25 |
| TE | 2 | 6 | 25 |
| G | 0 | 4 | 0 |
Some very interesting stuff there. Wide Receiver is the most overdrafted system--it looks like a WR's success in college might be solely based on the type of system being run not on the skill set of the receiver. QB is not the biggest bust, only landing 4th on the list. I had no idea that DE would be such a tough spot to draft for either.
On the other hand if you want a successful draft pick, you'd better go get yourself a guard. Not a single one of the guards drafted since 2002 has busted out. TE and LB are pretty safe bets too, coming in at 25% each. Offensive Tackle is just under 50%--it's basically a coin flip as to whether or not a tackle will succeed in the NFL.
Now let's look at it by position to see if being drafted top 10 or bottom 10 makes you more or less likely to be a bust.
| Draft selection | Bust | Non-Bust |
| Pick 1-10 | 28 | 32 |
| Pick 11-20 | 33 | 27 |
| Pick 20-32 | 41 | 31 |
Contrary to perceived wisdom you're more likely to suceed in the NFL if you're drafted top 10. You're more likely to be a bust if you're drafted in the bottom 3rd, though not by much (55% failure rate in the middle of the 1st, 57% in the bottom). Overall it looks like more busts than successes come out of the first round (102 busts to 90 successes).
Last I wanted to take a look at the year and see if that has anything to do with success rate.
| Year | Bust | Non-Bust |
| 2007 | 16 | 16 |
| 2006 | 11 | 21 |
| 2005 | 21 | 11 |
| 2004 | 17 | 15 |
| 2003 | 17 | 15 |
| 2002 | 19 | 13 |
Looks like 2006 was a pretty good year for drafting, while 2005 was pretty bad and the rest have been about 50/50.
So what does this mean for the 49ers? We have the luxury of two draft picks. Knowing what we know about the history of the draft what should we do? History says that if we draft Iupati at the guard spot we're going to be pretty safe. If we draft Spiller we have a 50/50 shot that he'll be a bust. If we go OT and OG the tackle has a 50/50 shot at being a bust as well. We could go safety/DB with the other pick since that also has a pretty high success rate.
51 comments
|
1 recs |
Do you like this story?
Comments
Awesome job
I definitely appreciate the amount of research that went into this.
May I suggest one thing? How about color coding the spreadsheet for easier once over senses of trends at draft position for each draft?
Thanks again!
I'd also be interested to see the percentages by school and converence
if you find yourself with more time on your hands than I do right now…
I know a lot’s been made of McC loving SEC players and it would be interesting to see which conference tends to produce the best pros…
by foosball4949 on Feb 24, 2010 11:18 AM PST up reply actions
Yeah I'll get to that eventually
Getting the data into the spreadsheet is fairly easy—it’s just a matter of copying and pasting from drafthistory.com.
It’s the organizing and sorting that takes time. I’ll see if I can have school and conference done by next week.
Yes Drew K, Tim Tebow will probably get picked in the first round.
Not sure what you mean here
Care to give an example?
Yes Drew K, Tim Tebow will probably get picked in the first round.
by color coding?
maybe having red for busts, green for players that went through, or even add another color or two to separate busts who are out of the league versus ones who just don’t play to potential and good draft picks versus great ones…
by foosball4949 on Feb 25, 2010 7:43 AM PST up reply actions
if we take
sergio kindle we wont have to worry about that, because with that strength and speed there is no such thing as a bust ;). haha im kidding but he is a beast and should be considered. we could use him at outside linebacker with manny lawson and haralson, or we could line him up on the opposite side of justin smith…imagine that, another fast, strong player on our defense
It's just a plant, it grows in the earth, and if you happen to set it on fire there are some effects...
FINALLY!!!
Somebody who’s speaking the truth if we would of got brian orakpo we wouldn’t be needing a DE or OLB we could of got coffee in the 4rd or got another running back hell where talking about getting another RB/ST .
We didn't have a 4th round pick to get Coffee and that is why we reached for him.
Orakpo is a DE not a 3-4 OLB, if the skins change to the 3-4 we’ll see how good he really is.
Tribute to #42 Ronnie Lott
Orakpo has played as a OLB on some downs. He plays both DE and OLB.
"Alex Smith doesn't inspire the Offensive Line to play well." - Random Troll on Post-Game Thread
by Hoopers Judge on Feb 24, 2010 5:45 PM PST up reply actions
Ask any Redskins fan.
They’ll say he’s horrible when playing LB.
He takes bad angles to the ball, misses tackles and has difficulty covering opponents.
He’s at his best when rushing the passer with his hand down.
What we've got here is a failure to communicate.
by SportsChicken on Feb 24, 2010 7:28 PM PST up reply actions
Really nice work, that was a good read. It’s incredible how much bad luck we got with that 2005 draft, we had the first pick in what was definitely the worst draft of the last 8 years.
Also known to haunt as theghostoftravisdenker and theaccidentalghostofsergioromo.
by theghostofjasonellison on Feb 24, 2010 11:59 AM PST reply actions
True...
but we could have drafted a player that would’ve made an impact immediately, even if we reached for someone. Drafting a spread QB with no weapons and no known offensive continuity was the worst move this franchise ever made. Could’ve had Demarcus Ware that year. Our pass rush would be incredible and it would’ve saved us from making some other (arguably) wasted picks (Lawson).
by 9thevolution on Feb 24, 2010 12:12 PM PST up reply actions
Lawson's ACL injury in his 2nd year is what brought him down.. but he led the 49ers in Sacks this year
Ware would have been a nice pick… instead of Lawson..
Smith didn’t have a chance in 2005 and I don’t think Rodgers would have done any better starting for us.
"Whether you think you can, or you think you can't, either way, YOU'RE RIGHT !"
I didn't count Lawson as a bust
he was a starter his third and 5th seasons and this year he was in the top 30% of all LB in sacks.
Yes Drew K, Tim Tebow will probably get picked in the first round.
I wouldn't say bust...
but I’d certainly consider Ware a better player, or at least a better pass rusher. I still believe Manny will be quality with a rotation like we have now, and he’s a good all around OLB.
by 9thevolution on Feb 24, 2010 1:09 PM PST up reply actions
But
The 49ers never had a chance to draft Ware.
They certainly weren’t going to draft him in 2005.
So how can you compare the two?
Ware was also the 11th pick in 2005, Lawson was 22nd.
No one expected Lawson to become the next Ware.
What we've got here is a failure to communicate.
by SportsChicken on Feb 24, 2010 3:12 PM PST up reply actions
You're right....
With the talent deficiency we had, Rodgers would have been beaten up too. I just think it was an even bigger mistake to trade Rattay after four weeks and insert Smith. He was clearly not ready and got beaten on too early.
by 9thevolution on Feb 24, 2010 1:07 PM PST up reply actions
I agree, Kill Rattay not Smith in his first year ;-)
"Whether you think you can, or you think you can't, either way, YOU'RE RIGHT !"
wow 4 reeeeeelll??
For all the smackthat you here TV sportscasters say about a safe bet getting running backs you’re gragh shows that its not as easy as they make it seems damm the bills so was clements taken in the first round .And for all the shots that the raiders take on tv and the radio i was surprised not 2 see them up there front and center don’t get me wrong i know they have’nt been that good on the winning side either, what i8 don’t understand is how in the world does jack del rio still have a coaching job or is it the gm anyway i hope that article have some of yall stop screaming 4 spiller spiiiiiller yea whatever OL and safety that’s what we need 2 draft and then snatch up the MACman mcluster in the sevcond round after that we can go any route we want 2
????
Can someone tell me where is WR rashon woods at ???
he changed his name
to Michael Crabtree and now wears number 15
It's just a plant, it grows in the earth, and if you happen to set it on fire there are some effects...
by iStoner on Feb 24, 2010 1:50 PM PST up reply actions 1 recs
????
Does anbody know whoes going 2 the combine 4 the niners is singletery going ?
All the 49ers scouts, coaches and GM are going.
Paraag is going too.
What we've got here is a failure to communicate.
by SportsChicken on Feb 24, 2010 3:12 PM PST up reply actions
Interesting
So we were doomed in 2005 really no matter who we picked. That is a sad thing to look back on. I agree that OL is our biggest need and it looks like a safer bet than some. Really appreciate the work that went into this chart. I am not as down on picking CJ Spiller as some are. A 50/50 shot at a difference maker isn’t as bad as taking a long shot at a QB. Well, actually according to the chart, it’s about the same risk. But is just SEEMS like a bigger bust when it is a QB. I don’t know if there is any way you could factor in the impact to the team by position by bust. I’d be willing to bet that busts on QB’s in the first round are the most negative impact on a franchise. Looks like you can almost bet a WR in the first round is gonna be a bust. What does that say about Crabtree? Yikes! Lets hope the odds are in our favor on that one.
So if we go Offensive Lineman and Running back, we have a decent chance of hitting on both. I think the draft is an educated crap shoot, because the players are human and the human element always seems to screw up empirical data. If we could just take the human element out of the equation, we would have a much better chance of not drafting busts…
This also explains Kentwan Balmer….kind of…
Another year, another chance to hope for the team !!
Part of the impact on the QB bust
is the amount of salary they command.
I might add to this as I go along and figure out salary and guaranteed money because that can definitely impact the team more.
Yes Drew K, Tim Tebow will probably get picked in the first round.
by smileyman on Feb 24, 2010 2:08 PM PST up reply actions 1 recs
This is awesome
Does this mean that the teams with a history of good drafts can evaluate players well or does it mean that they just develop their talent well?
Another thing to think about: while the top 10 are slightly less likely to be busts, they proportionally are guaranteed much more money. So it still might be better to have mid-to-late first round picks than to have early first round picks in the long run.
Very good question
I suspect it’s a combination of both. I also have to wonder if it’s a philsophy of BPA or need that busts out more. More research is needed I’m afraid.
Yes Drew K, Tim Tebow will probably get picked in the first round.
yeah...either way great job taking the time to put this together!
really impressed with these offseason posts
I suspect the former
Looking at some of the positions with a low bust rate (C, TE), those are positions that are rarely chosen in the first round unless you need somebody at that position. I don’t think they’re taken often as BPA.
Or do they use different criteria
Maybe they rank hard working and coach-ability higher, thus giving them a greater chance of having the pick work out?
I remember the Balmer pick was listed as high upside with him being a hard worker that’s coachable, but he was starting out needing a LOT of work.
So yeah I hold out hope that in this his 3rd year Balmer will be productive. If he stays healthy this year then it’s his make or break year for me with him.
BUT, BUT
C.J. Spiller is too awesome to bust.
He’s unique!
What we've got here is a failure to communicate.
BUT BUT
chikmagnet is too awesome to make a rational statement.
He’s unique!!
The Tim Tebow Story "A Bust In The Making" ...Part 2 Coming After The Draft...Stay Tuned.
Nice for you to mention the rational statement thing
Others on here (and all over the internet) have said the same thing I said above (without sarcasm).
C.J. Spiller is like some god that has no flaws to some people.
What we've got here is a failure to communicate.
by SportsChicken on Feb 24, 2010 7:30 PM PST up reply actions
great post
The only problem is rush linebackers, a highly bust prone position by general opinion, are thrown in with coverage linebackers, a position thought to be among the safest to draft. I wonder what happens if you take the rush linebackers out.
In respect to gaurds I don’t think there is anything about the gaurd position that makes it easier to scout, its just usually drafted lower. for a gaurd to make it into the first round they have to be basically flawless, while players with glaring flaws are sometimes drafted in the first round because their position is so much more valuable.
About the guard spot
I suspect you’re right. If you’re good enough to go in the first round you’re about as good as it gets at that spot.
By rushing LBs I’m assuming you’re talking about 3-4 OLB who converted from college DEs?
If so I’ll have to check and see how many of the DE actually were drafted to play LB because that can really adjust the numbers some. Might bring the LB numbers down and the DE numbers up.
Yes Drew K, Tim Tebow will probably get picked in the first round.
Interesting breakdown...
only there are so many more factors involved in how a player finds success or fails in the NFL. Sure there are numbers and percentages by position or whatever, but it’s pretty much roulette no matter who you are picking and what you are picking because of the outlying factors involved. Ever scenario is going to be different because of the outlying factors.
For instance, if Okung is selected by Washington, and Washington’s Oline coach happens to be pretty awful, his chances of busting increase based on that factor. There are other factors that could come in to play on top of that, but it’s just one example how you have to base each individual case seperately. Youo can’t group everything together like that to get an accurate gauging. Years, Picks, Position, have less to do with the success rate than as to who, where, and what an individual player has in front of them.
The Tim Tebow Story "A Bust In The Making" ...Part 2 Coming After The Draft...Stay Tuned.
was their a jab at our old o-line coach hidden in there?
by hellaninersfan on Feb 24, 2010 6:50 PM PST up reply actions
Well that's why I tried to be as generous as possible
It’s also why used the 3rd season as a criteria and not the 1st or 2nd.
I did go through and look at individual players to decide it on a case by case basis. The point still stands though. If you’re drafted in the 1st round you should be able to start on your team by your 3rd season and you should be better than most people at your position.
Your talent alone should put you there.
Yes Drew K, Tim Tebow will probably get picked in the first round.
Awesome Post!
Although a lot of work that I am not expecting anyone to do, It would be interesting to see how this applies to all players drafted over the time period. It could show us what the actual value of draft picks are.
I was "Deific16"
The cake is a lie.
by Sultan of Seitan on Feb 25, 2010 2:54 AM PST reply actions
Uncertainty?
Interesting numbers, but isn’t there a relatively high uncertainty for each bust prediction because of the small numbers involved?
For example, considering your largest sample (draft picks 20-32) size of 72, I would approximately calculate the confidence level of your prediction to be 1/(square root of 72), i.e, about 12%. So the chances that a draft pick in positions 20-32 is a bust is 43%+-12%.
It gets worse for smaller samples, e,g., the chances of a first round WR being a bust is 81%+-22%. So the best we can say is that the chances of a first round WR bust is greater 60%.
With more number crunching, we’d get more accurate estimates, but thanks a lot for this analysis.
Yeah it's still in the rough stages
I plan on adding to it and updating it, probably back to 1980. That should give us a plenty big enough sample to work from.
Yes Drew K, Tim Tebow will probably get picked in the first round.
I don’t know if going back that far will be useful. The data set you used is small but appropriate. Even going back to the 90’s there were teams willing to trade their entire draft class for 1 player. The perceived value and resources poured into the draft are so much different than what occurred just a decade ago.
Can only go back to 1990 anyway
Before that the NFL doesn’t have tackles, ints, etc available
Yes Drew K, Tim Tebow will probably get picked in the first round.

by 



























