Research article - (2006)05, 509 - 516 |
A Probability Based Approach for the Allocation of Player Draft Selections in Australian Rules Football |
Bedford Anthony, Adrian J. Schembri |
Key words: AFL, probability, draft, importance |
Key Points |
|
|
|
Our system is based on Carl Morris’ famous work on the most important points in tennis (Morris, |
Criteria |
In devising the system of selection for the AFL national draft, we designed our model based on the following: Teams with a reduced probability of making the finals are rewarded incrementally higher for winning matches of high Unimportance Teams that have qualified for the finals are ineligible for any reward. DPR is restricted to a 16-week period commencing from the end of Round 6. DPR is higher for teams unlikely to win, and is further enhanced by the Unimportance of a match in terms of making the finals. No DPR is given in defeat, so teams must win to obtain a reward. A priority system is in place to protect teams that have continuous runs of losses, but it is not implemented at the expense of rewarding victory. The way in which the number of matches ‘needed to win’ is calculated is based upon the minimum number of wins needed by a team in the remainder of the season based solely upon making the final 8 (F8). Obviously this is not precisely known until the end of the season; however a reasonable estimation can be made. |
Probabilistic model |
The heart of our model is based upon reworking Morris’ equation to suit our purpose of determining how Unimportant a match is to a team’s finals aspirations. There are a number of things that we need to evaluate first, such as what measures are required in our assessment of what makes a match Important, and, in turn, Unimportant. A regular AFL season constitutes 22 matches and we need to consider the probability of a team making the finals based upon the number of matches won at round r. There are a number of features in our probabilistic model that were used to determine how much a team was rewarded for winning a match. The process is as follows: Determine the minimum number of wins ( Check if team i at round r has already made the final 8 or cannot make the final 8. If neither of these events are true, we determine the probability of team i making the finals at the completion of round r. Calculate the Unimportance of match r +1 for team i using the above results. Allocate the |
Determination of projected wins to make the final8 |
There are two possible approaches to determining the number of wins required to make the final 8 at round r for team i. We could either use the final season’s required wins and impose that retrospectively on the completed season, or use a projected requirement during the season and keep this result even at the end of the season. For example, in season 2004, the eighth placed team won 12 of 22 matches to make the finals. Ultimately, differing results make it difficult to predict this result during the season. However, the attraction of our model is that teams must know the rewards of winning their next match prior to the game as an incentive to win. They should also be confident this reward does not change post game. So we used a projected final 8 wins, or This does, on occasion, return a result that is not possible. For example, a team with 4 wins at the completion of round 7, and sitting in 8th place, yields a |
Determination of the probability of making the final 8 |
At the heart of the second stage of the process is the binomial distribution. A number of other methods were considered, such as simulating the remainder of the season using success probabilities for each team using p = 0.5, or varying p; also averaging the number of wins of all teams and forward multiplying to determine the number of wins needed to make the final 8. Ultimately, it was both simplicity and a reduction of variability that settled our choice. We define the probability of team i at the completion of round r making the final 8 as Pri (F8/r). Using B (x, n, p) (the cumulative binomial distribution function with x = number of successes, n = number of trials and p = probability of success), we have Notably, one must consider the value of Pi. We have chosen to look at two methods, the first, and predominant choice in our results, is the classic coin toss model pi =0.05. The second method uses the winning ratio (pi = TWi/r). One could be tempted to use successful prediction probabilities such as those determined by Stefani and Clarke, |
The unimportance of a match |
We define the Importance for team i at the end of round r, or Ii(r), as Now we unpack the two components of Importance (see Appendix Eq 4 and 5). By using the binomial cumulative density function to model the probability of making the finals based on winning or losing the next match, we can, in turn, calculate the Unimportance of a match. Through some neat cancellation of terms we obtained a simple result for the Unimportance (see Appendix Eq 6). |
Allocation of Draft Point Reward (DPR) |
The allocation of DPR is simply the Unimportance probability multiplied by the probability of not making the final 8 at round r. In this way, the Unimportance is tempered by the likelihood of making the final 8. Teams that cannot make the final 8 receive the highest weight possible (1), that is, the full Unimportance probability, as long as they win the match. The allocation of DPR for team i at round r is given by the following |
Using the DScore for the national pre-season draft |
The use of the DScore towards draft selections encompasses some parts of the AFL’s latest policy on priority picks. For our DScore system, the teams are ranked 1 through 16, with the highest DScore attracting pick 1, and the lowest pick 16. This ordering remains for the subsequent iterations of the draft with one exception. Current AFL policy dictates that a team that wins less than or equal to 4 matches in a season receives a priority pick in the second round of the draft. As a method of protecting teams that may never win another match after round 6, we employ a similar priority pick system, whereby a team that wins less than or equal to 5 matches in a season receives a priority pick at the start of the second round of the draft. This is a little more generous than the AFL system, however the bottom side will not necessarily end up with the first draft pick under the DScore model. |
|
|
We begin by examining how the system operated for 2005 in finer detail. We then cover some interesting scenarios, and investigate the implications of the model. |
The 2005 season |
For season 2005, a number of teams remained in contention for the final 8 right through to the last round. The final round saw five teams competing for three finals places. One win separated 6th through 10th at seasons end. Notably, half a win separated last (16th) from 14th and all three bottom sides received a reward from the AFL for winning less than or equal to 5 matches. Variation of the DScore throughout the season is evident; with the number 1 pick changing teams 11 times during the season - twice in the last three rounds. Also, picks 3 to 7 provided extremely close results in the final round, given that if Collingwood had won its last match against the Western Bulldogs they could have secured pick 3 (instead of 7) and cost the Western Bulldogs first pick. So a win to Collingwood under the DScore model would see a rise to pick 3, however a win under the AFL model would have seen a drop to pick 5. |
An evaluation of the incentive of the DScore model |
Ideally the DScore model should evidence high DPR continuously for low placed teams, given they win. |
Importance |
Of interest to us was when the maximum value of importance occurs for each team. We then sorted the teams by final ladder position (FLP) and calculated the mean and standard deviation of the round, as given in As shown in |
|
|
It is somewhat difficult to measure the effect of our model on past results as we are implementing our method retrospectively. As a consequence, where players would end up under our model would be different to reality and therefore team success may change. Even so, the findings are still an eye-opener, and indeed motivate poorer teams toward success. As was shown in the results section, for the final round of 1998, the 1st and 2nd draft pick had been decided. However, 11 teams could still be playing in expectation of a change in their draft pick with a victory. The ‘ideal’ advocate of our system was the final round of 2003. Geelong played St Kilda, and it could be argued they were playing for ‘nothing’, sitting 10th and 13th on the ladder - no finals place or priority pick at stake. Under our |
Alternatives |
A criticism that may be leveled at the DScore system is that teams which continually lose are never rewarded. A possible way of assisting teams that consistently lose may be to reward a ‘gallant’ defeat. Calculating an expected and actual margin, then smoothing the difference, is an approach used in other areas of sport analysis, such as tennis as in Bedford and Clarke, A point of interest raised in the methods section was the possible inclusion of a team’s relative skill into the system, either using probabilities such as those pioneered by Stefani and Clarke, |
Conclusions |
In this paper, we have developed a unique system for player allocation in the AFL draft using probabilistic principles designed to encourage success. Whilst the AFL system was not designed to encourage teams to lose, it does reward teams that only win a small amount of games. Our model, known as the |
AUTHOR BIOGRAPHY |
|
REFERENCES |
|