in-the-game.org

European Basketball Analysis

Players | Teams | Game List in the Stats Database

Measuring defense

with 13 comments

You’ve got to show me some stuff, and I’ll know it when I see it.

Steve Jobs, yelling at a copywriter about an iPad commercial.

By now, we all agree that numbers don’t tell us enough about how basketball players defend. Keeping track of blocked shots, steals and defensive rebounds provides us with only a fraction of the information we need in order to evaluate a player’s defensive performance. How many fouls does a player commit going for these blocks? How many lay ups does he give up going for a steal? And how many of those rebounds come at the expense of proper defensive rotations? The same is true for team defense. Different strategies and game plans are not taken into account by ‘mainstream’ or even ‘advanced’ statistical categories. And of course, statistical information about that gray area between defense and offense is sketchy at best. For example, points off turnovers would be a more useful tool if we knew more about what exactly led to each turnover.

You might say that the answers to these questions are simple if one who actually watches any given game. That’s partly true. After all, keeping track of advanced defensive stats requires video analysis. But I don’t see any contradiction between video and statistical breakdown. Numbers provide added incentive to watch the game closely and learn more about it every time. Isn’t that what makes basketball great?  However, if we want to learn more, he have to know what we are looking for. Each statistical category must incorporate a wide range of plays with certain common features, without being so abstract that it fails to exhibit meaningful individual and team tendencies. This is not as simple as it sounds. Luke Winn and Rob Mahoney initiated this debate with a detailed case study and a proposal for ‘new’ statistical categories respectively. Here’s my idea of how defense should be measured, based on their work, my defensive chart of the Olympiakos – Bilbao game and a rant from the coach of the team I support.

What’s not included

Winn’s article put a lot of emphasis on turnover percentage, i.e. the percentage of a player’s defensive possessions which lead to turnovers, and free throw rate, meaning the free throw – to – field goal attempts ratio allowed by a defender. I find both of them to be somewhat impractical. It is not always possible to define a turnover forced by individual effort, as opposed to poor decision making by the ball handler, or effective team defense. Let’s watch some tape:

Both of these turnovers partly result from defensive effort. Kalin Lucas keeps up with Janis Blums off the screen. Aaron Jackson does a great job pressuring the ball. But can the impact of this effort be measured and translated into a forced turnover? How about the help defense of Lazos Papadopoulos or the anticipation of D’Or Fischer? I don’t think there is a definite answer, which is why I prefer a combination of traditional and advanced numbers in order to capture a defender’s contribution in forced turnovers: charges taken (already available via play by play at euroleague.net) and steals on the ball, as proposed by Mahoney – how many steals a defender records against a player handling the ball. These two categories tell us enough about individual ability on the defensive end, without crediting team work and strategy (cutting off passing lanes, being in position to provide help) to a specific player.

Free throw rate, on the other hand, does not take into account most of the fouls committed by a player before his team is in the penalty (i.e. not in the act of shooting) and reveals very little about the player responsible for each pair of free throws: if Milos Teodosic loses his man, Krstitc rotates over to help and Khryapa fouls the opposing center in order to prevent a dunk off the assist, what does free throw rate tell us about this play? Fouls per possesion (Or at least per minute) are a much more useful indicator. Sometimes, the more advanced statistical category is not necessarily the most accurate one.

Hedge rate vs ppp and fpp on switches

After a game against PAOK last December, Olympiakos head coach Dusan Ivkovic publicly blasted his players in what is now considered a classic press conference. Duda provided a lot of memorable quotes that evening: he talked about developing Victor Khryapa and Sergey Monya at CSKA Moscow, alleged that some of his players think about the NBA too much and warned that ‘the moment of truth is approaching’. It was great drama, but something else he said was even more interesting. Ivkovic revealed that his assistants keep track of points conceded in mismatches created by switching on screens – a great example of advanced stats meeting game strategy. Mahoney proposes hedge rate, even though he admits that,

Assessing pick-and-roll defense in statistical form is difficult because of systemic considerations, but quantifying how often — or how far — a player hedges to counter a screen would provide an added level of defensive specificity.

Well, it would certainly help coaches make more sound decisions, but it is doubtful that it would make the game more accessible to fans. First of all, hedge rate indicates not only individual ability, but also a team’s defensive strategy. Kyle Hines showed his prowess as a hedge defender at Bamberg last season, but Ivkovic’s philosophy has kept him in the paint during his first games with Olympiakos. Also, using numbers to decide whether hedging out works or not is impossible without a clear definition of success. Hedge is only a small part of defensive strategy, as it sets off a series of rotations. If the defender manages to stop the ball handler coming off the screen but his teammates give up an open three on the weak side, does hedge rate provide us with meaningful information?

I am not saying that Mahoney, or Winn for that matter, are wrong; without their brilliant work you wouldn’t be reading this article (now you know who to blame). It is just that certain statistical information may be very useful to a coaching staff but complicate matters for fans – and not just casual ones. In other words, we have to agree that we know exactly what we see. This is why I find points and fouls per possession on switches (or mismatches) to be a more universal category.

The formula is simple: points allowed and fouls committed by a defender on every possession where he switches to a player that he has not been assigned to. Keeping track of fouls provides extra information about the efficiency of each defender in mismatches; keeping track of assists allowed in these plays raises once again the less – than – obvious distinction between individual tendencies and team defense. Advanced player stats on offense turn into team numbers without much trouble. This is not the case with defense. Perhaps there is a need for team-only categories: assists or offensive rebounds allowed on switches, ppp on hedge outs, ppp when going into a zone etc. The more detailed the chart of defensive performance, the more stats keep popping up.

Defining steals and deflections

Nonetheless, when certain numbers of each defender are added up, they tell us a lot – only about team tendencies, but the pace of the game as well. Take steals-plus and blocks-plus, meaning steals and blocks which lead to transition points. In the first half of the game I charted, Olympiakos had two steals to Bilbao’s three. However, those three steals by the visitors led to six points and an extra possession, after Lazos committed a flagrant foul. Olympiakos, on the other hand, managed just two points on their steals. In the second half, Bilbao recorded six steals, which produced only four points, the same as the hosts on four pick ups. This is a great way to assess the impact of defense on the other end of the floor and determine which team dictated the pace of the game.

Speaking of steals, Mahoney also proposes keeping track of gambling ratio – how many times a players gives up defensive position for each steal he makes. This is a very interesting concept, but is there a concrete definition of a gamble? Sometimes, there is a very fine line between, say, gambling and going over a screen as part of the game plan. Deflections, on the other hand, is a category we can all agree on – except for Euroleague.net, apparently. Each player should be credited with a deflection every time he tips the ball loose and his team secures possession, either via an opponent throwing it out of bounds or because a teammate got his hands on it. Here’s an example:

Euroleague credited Mavroeidis with the steal, but I think it would be more accurate to give him a deflection and Vasileiadis a steal-plus. Mavroeidis did not secure possession and while Vasileiadis did not have a lot of work to do on this play, the addition of another category in traditional Euroleague boxscores would allow a much better understanding of a player’s defensive performance.

You may disagree with some of my suggestions. You may think that hedge rate is more useful than ppp on switches or that Mavroeidis actually stole the ball. And you could be right. The point of this post is not to convince you about what we should measure. It’s all about starting the conversation. Fans can learn a lot more about basketball by simply looking more closely. If you think that you are up for it, contact us and you could be charting the defense of your favourite Euroleague team. Trust me, there is a lot to be discovered.

Rod Higgins is also writing on Swooshnation in English and Thrylos-Fans.net as well as Redhoops in Greek.

Written by Rod Higgins

December 1st, 2011 at 1:55 pm

  • http://twitter.com/robscott33 Rob Scott

    It’s interesting that you bring up Ivkovic’s reference to internal video scouting work. Obviously coaches have watched film on their own players and upcoming opponents since forever, and have used it to offer corrections and improvements to their own player’s game both on offense and defense. 

    So, I can see the usefulness of a coaching staff watching every play and providing breakdowns of how their players perform in a given situation – be it hedging on the PNR, making effective rotations, whatever. But (and finally we get to my question) to what extent do they need to know this as a precise *number* (ie. when Hines hedges the opposition scores .45PPP etc) if, as you say, there are so many other variables in play? Would it be enough for the assistant to tell Ivkovic that they played team X four weeks ago and Hines hedged too much and they killed us? So then Ivkovic tells Hines to go under those screens. In fact, I can’t believe there ISN’T a top team that doesn’t already do this.

    That qualitative scouting report isn’t particularly useful to the general journalist/blogger/fan who might want to know ‘who is the best screen hedger in the Euroleague?’ but how much usefulness (given all the caveats explained in the post) does that have anyway?  I’m not saying it shouldn’t be done, but the man-hours needed to generate the data in a quantitative form are so siginficant, is the output worth the effort? So Player A has a PPP allowed of x when he hedges, but Player B’s is 0.001 higher than x… as the post points out, these numbers need so much clarification, do they mean anything in player evaluation? Does Ivkovic need his assistant to tell him it in such precise quantiative detail, or does he just need the basic principle to use as a coaching instruction?

    This isn’t an anti-stats rant (at least I hope it doesn’t come across like one!) advanced stats can be absolutely fascinating and tell us things that the naked eye wouldn’t pick up (or helpfully confirm what the ‘eye test’ suspects, is actually true). I just think they defensive numbers are a little too abstract to be worthwhile. I hope the defensive charting project proves me wrong!

  • http://www.in-the-game.org sJacas

    Tend to agree with that. Things get complicated whenever a defensive rotation starts. Therefor, imo, it makes sense to look at what causes defensive rotation. That can be a blow-by in one on one, or other situations. In general I am primarily interested in the very action that breaks the defense.

    In pick and roll defense though, defensive rotation, even if only for a couple of seconds, happens in any case except for 1) when a clean switch occurs (although you might call that a rotation, too) or 2) when the defender goes under the screen, so that is partly a matter of strategy and hardly something we can put into meaningful individual numbers.

    Ps: I find the qualitative scouting report very useful. And I am sure that Ivkovic knows exactly about Hines’ tendencies and efficiency, but how much opponent information can he gather in pre-game preparation?

  • http://twitter.com/robscott33 Rob Scott

    Good points – to clarify, I find the qualitative scouting reports fascinating (ie what Sebastian Pruiti, Kostas Psimoulis, Rod Higgins, etc do) thats the point though, those are detailed video breakdowns and not just a table with numbers after player names. 

    I think that’s also a good point in scouting the opposition, the numbers could be a very useful shortcut (especially the offensive numbers, but as you say, they are far less problematic).

    One of my favourite ‘advanced’ stats isn’t really that ‘advanced’ at all, the 5-man lineup plus/minus. When it gets to a decent enough sample size those numbers are incredibly revealing, I think (which is why I can’t wait for them on here. patience, I know!)

    I think the last paragraph in Rod’s post is the most important – what the adv stats ‘revolution’ has definitely done is make people look at the game in more detail and the conversations it has started are hugely relevant just by virtue of taking place. So Iong may they continue.

  • http://www.in-the-game.org sJacas

    Ideally, a qualitative scouting report is backed by numbers (=longterm observation) though. For example I find extremely relevant what percentage a player makes when pulling up in PnR. But not everyone has access to situational stats.

    As for the usual advanced stats, I trust individual offensive and defensive rebound percentages more than my eyes, and in general the minute- and usage adjustment is relevant, definitely. I think when watching games we tend to overrate the players who play a lot and have the ball in their hands a lot, automatically assuming they’re better than the rest.

    Also, everyone who watches basketball has a peek at the boxscore after the game and is heavily influenced by that in his judgement, even if he won’t admit it. The boxscore is rudimentary. Advanced stats are painting a better picture of performance.

  • http://twitter.com/rodhig7 rodhig

    @ Rob

    First of all thanks for your feedback and for bringing up so many great points.

    My argument is this: if each advanced statistical category is clearly defined and contains a specific number of variables, then the game becomes more accessible for fans and coaches alike.

    I think we can agree that steals plus/blocks plus is a quick and efficient way of understanding the impact that the defensive effort of each player has on his team’s offense. Instinctively, we know that every steal has a different ‘meaning’. This stat let us know what this meaning is.

    Ppp and fpp on switches is a very useful tool, because of the comparisons it allows. Let me give you an example. As I tweeted yesterday, Olympiakos allowed 1.44 ppp after switching against Fenerbahce (1.32 ppp if you don’t take into account assists allowed in these situations). Overall, FBU scored 1.1 points on each possession of this game. This is a huge difference. It tells us that Olympiakos were a poor defensive team throughout this game and an awful one when they were switching. It also raises very interesting questions for even casual fans. For instance, why Ivkovic went with this strategy in more than a third of FBU’s possesions?

    Would we be aware of this issue (which has a lot to with both individual ability and team strategy) without these numbers? Well, we would have to watch really closely. And we certainly wouldn’t be in position to say with certainty that this type of defense failed spectacularly – we would in much broader terms – ‘lack of effort’, ‘not aggressive enough’, ‘too slow’ etc.

    However, I see your point. In order to get meaningful information we must be precise. This is why I hesitate to measure hedge rate, free throw rate or forced turnovers. Each of these categories contains so many variables that I find it almost impossible to come up with a concrete definition and it will probably end up confusing fans (and some coaches, to be honest). In other words, numbers are too abstract only if you don’t know what you are looking for. Or if you think that they can answer all the questions.

  • http://twitter.com/robscott33 Rob Scott

    @twitter-261625877:disqus Thanks for your reply, I had meant to reply to this days ago! I think actually understand the rationale a lot better now, that’s a fantastic explanation. This reply won’t be very long because I don’t have any counterpoints! I look forward to seeing the progress of the defensive charting project – the fog has been parted from in front of my eyes!

    @inthegamebasket:disqus 

    Totally. As I said, its actually a little baffling why some ‘advanced stats’ are termed as such – what is more simple than something like possessions per game, or defensive rebound rate? They’re not more advanced, necessarily, than trad boxscore stats, just better and more informative. 

  • CT

    Although I like every little bit of new information as it provides a new paradigm, this is a point where stats come up short. Basically I agree with most of the content by Rob, so please don’t misunderstand me as well. There are too many variables and to measure which one effects, you need to look at the right ones. That stat Ivkovic’s keeping is basically something they want to measure. These kind of very specific stats are vey common at NBA and US hoops, as you know very well and they emanate from a specific theory, idea, thought, etc.

    For example, Turkey NT had a specific study on some certain stats to succeed in Eurobasket 2001 while starting the training camps. One of them was the assist number, targeted. But, they had a different way of calculating it; basically leads to a higher number of assists than standard box scores. The meaning, there was to help players understand sharing the ball and arriving at the destination point by the system they are trying to implement. If they are winning an important game by Kutluay’s great performances and not reaching the targeted stats, it wasn’t OK actually. This plan helped step by step at the 2 year preparation plan. Turkey NT, with so many egos to be handled did a good job at the subject. At the last friendly against Israel before tournament starts, players were extra selfless and wasting fully free opportunities, bench had to warm the players to act a little more like Liadellis. That was a team with no less potential than Spain about a decade but destroyed itslef with on and off the court ego problems. After all, what I am saying is if there is a purpose, they might be very helpful to understand but at a bigger picture it might be misleading. If coach orders some players to go into the passing lanes as a part of the defensive strategy. A detailed stats here could be very helpful but if taking the right position against offence is more preferred option, there should be something looking at this side of the game. And overall defensive or offensive stats look like a very large subject and could come up short and misleading in some way.

    PS: Rod, do you have a link for that press conference? It should be as good as Zeljko’s:)

  • http://www.in-the-game.org sJacas

    Exactly. Measuring in per possessions for offensive/defensive efficiency and looking at the percentage of available rebounds grabbed for rebound percentage is the most basic, most logical thing.

  • http://www.in-the-game.org sJacas

    Many good points.

    But let’s not mystify stats here. Every single observation a conventional scout makes during a workout/game can be first defined to standardise it, and then be charted, be it by simply counting the actions, or in a qualitative way (example: rating scale). The thing is, if you want to chart the quality of a hedge out on a scale of 1 to 10 for every play where a hedge occured, you need someone who is qualified enough to do it. And even if you find 12 of those guys, you still need them to evaluate the action through absolutely identical criteria.

    I guess what I want to say is this:

  • CT

    The problem here is that it is very difficult to standardize. Pts off turnovers, fast break points after missed long distance shots, ratio of offences of which rhytm interrupted by deflections, steal attempt, etc. we could definitely find somethings but hedging or swtiching, help defense, etc. this type of preferrences are really hard to analyze. Measuring is one hard thing but, making an assessment out of it prabably not easier as well. But sure, we can come up with some ideas. Good discussion, unfortunately just could have read the piece.

  • http://www.in-the-game.org sJacas

    Definitely. And you will have a large number of categories quickly.

    It’s definitely a difficult topic, but maybe the discussion leads to better results than we expect.

    Rod charted deflections, steals+, blocks+, points after switches, etc. for recent Olympiakos games, that data combined with the boxscore already gave me a lot of information without even watching the game. I think simply charting pick and roll

    offensive (location of the screen, who is running it and how often, roll or pop of the screener?, spacing parameters for the 3 off ball players – all 3 outside or 2 outside plus 1 inside? – , plus the results in every category)

    and defensive (PnR def team strategy parameters)

    actions would give me a great idea of what is happening in the most important area of today’s game, without even tackling the idea to measure pick and roll play on an individual basis.

  • http://twitter.com/rodhig7 rodhig

    CT touches on a very important issue: which categories really matter and why. The answer in my opinion is quite simple: we are looking for info that are not part of a conventional boxscore, but can be applied in any basketball game.

    Yes, ppp on switches was inspired by Ivkovic’s priorities on D. But the key is ppp, not the switch. This is why I am trying to incorporate more defensive strategies vs pick and rolls, namely hedge out and ‘down’ (where the big man guarding the screener stays on the paint, risking a mid-range shot by the ball handler):
     
    http://www.redhoops.gr/?p=1455

    I think we can agree that each category is broad enough to be applied in any game, but not too abstract or partial to the tendencies of a specific team. Of course there are other issues. The most significant is distinguishing between individual ability and team strategy. On the link above you can see that Papadopoulos comes across as a poor pnr defender. What I see every week (not to mention +/- on this game) confirms what these numbers tell us, but he is not solely responsible for all these points. What about the defender guarding the ball handler, or the precision of Oly’s defensive rotations?

    In other words, I agree that it is difficult to standardize. But this is more a question of individual vs team advanced defensive stats. Otherwise, we know what a switch or a hedge is when we see it. It’s all about measuring them properly. Anyway, this whole debate is very interesting, hopefully I will make the most of your great feedback in a post once the regular season is over and I have charted five games overall.

  • Pingback: Fenerbahçe’s rebounding struggles: an analysis at BLOG.IN THE GAME