Re: Draft projection models
Posted: Sun Jun 09, 2013 8:43 pm
Thanks for the new link. Looks like your article generated lots of comments there.
Analysis of basketball through objective evidence
http://apbr.org/metrics/
Here's essentially what I meant:VJL wrote:That could potentially be a cool addition. I'm not sure what the best way to operationalize "environmental goodness" is. Team record in previous year? It would be especially difficult, because I wager most of the "environmental" importance is idiosyncratic. What is a great situation for one guy may be a terrible one for another depending on how skills mesh with needs.How a player translates his college play to the NBA is controlled by his environment. Have you considered adding a measure for player development? For example, getting drafted to the Spurs probably helps you reach your potential better than, say, the Bobcats. If there's one team who could lead to their own variable, it's the Spurs.
Any of those options would rapidly approach over-fitting; in fact, I think that if you did out-of-sample validation, you would almost certainly regress "team effects" all the way to zero.AcrossTheCourt wrote:Here's essentially what I meant:VJL wrote:That could potentially be a cool addition. I'm not sure what the best way to operationalize "environmental goodness" is. Team record in previous year? It would be especially difficult, because I wager most of the "environmental" importance is idiosyncratic. What is a great situation for one guy may be a terrible one for another depending on how skills mesh with needs.How a player translates his college play to the NBA is controlled by his environment. Have you considered adding a measure for player development? For example, getting drafted to the Spurs probably helps you reach your potential better than, say, the Bobcats. If there's one team who could lead to their own variable, it's the Spurs.
1) The Spurs are really good at finding draft steals, so maybe it's beyond that and they know how to develop players. Thus, add a simple variable for landing on the Spurs to boost your draft rating by "X" amount. I'm not saying it's perfect, but it would be interesting to look into that.
2) I suppose you could go on a complicated route and try for weird fit adjustments like having quality players at the same position in the rotation. Or something else.
It would be pretty easy to see whether players going to particular teams tend to overperform and would be a fun thing to do when I get some free time. That said, I doubt the Spurs would stand out if I ran the numbers. For all the talk about "developing" it looks to me more like they are really good at identifying underrated talent. My models really like some of their "surprise" players. Leonard is pegged as the 3rd best in his class, Green as the 9th in his, Hill was the 12th in his... even more interesting to me is that some of their less successful attempts to find a gem agree with my model so they may actually be using a similar approach. Blair was viewed as a potential stud by any purely stats approach I have seen. James Anderson was rated 14th by my model and I have seen him higher using other similar stats models. The same can be said for Denmon (though for some reason he isn't in my dataset). Gary Neal is really the only recent Spurs contributor who wasn't a great value pick out of college by the numbers, but I wouldn't be surprised if his Euro numbers tell a different story.One of the common headlines about the Spurs and the draft is that they don't just find good players late in the round; they develop them better than anyone else. This thought is thrown around a lot in NBA articles ever since the Spurs blew through Memphis. So it would be useful to say, "Hey, we have all this data and couldn't find that effect at all, so it's probably not true."
The Spurs obviously take into account college production more/better than almost any other teams - so their ability to "develop" players isn't surprising to me. They often simply draft better "developed" players from the get go. Blair in the 2nd round is an obvious example.VJL wrote:
It would be pretty easy to see whether players going to particular teams tend to overperform and would be a fun thing to do when I get some free time. That said, I doubt the Spurs would stand out if I ran the numbers. For all the talk about "developing" it looks to me more like they are really good at identifying underrated talent. My models really like some of their "surprise" players. Leonard is pegged as the 3rd best in his class, Green as the 9th in his, Hill was the 12th in his... even more interesting to me is that some of their less successful attempts to find a gem agree with my model so they may actually be using a similar approach. Blair was viewed as a potential stud by any purely stats approach I have seen. James Anderson was rated 14th by my model and I have seen him higher using other similar stats models. The same can be said for Denmon (though for some reason he isn't in my dataset). Gary Neal is really the only recent Spurs contributor who wasn't a great value pick out of college by the numbers, but I wouldn't be surprised if his Euro numbers tell a different story.
Kudos on using standing reach. I just learned that Kevin Pelton didn't even use height (huh?) in his draft ratings.VJL wrote:When I was including them alongside the boxscore statistics, no step vertical and standing reach were the only predictors worth including.What combine stats did you find have a positive correlation to success?
Now that I tried applying combine stats post-hoc for the newer data (including it in a regression along with the predictions posted in the parent post such that -- [Observed Wins ~ Predicted Wins + No step vert + Standing reach] I found some interesting things:
1) Standing reach is now a negative. What that tells me is that while standing reach is obviously important to playing basketball, if you can't use it to record rebounds/blocks/points... in college, you won't figure out how to use it in the pros and some of the stats you got just by being bigger than anyone else will be tougher to come by.
2) No step vert is still informative, but the effect was really weak until I included an interaction term between predicted wins and no step vert. Basically, if you don't look like a good prospect based on the box score stats it doesn't matter how high you can jump. However, as your expected production increases, being able to jump out the building becomes an increasingly important predictor of your ceiling.