Table 1. Characteristics of the included studies.
Study Sport Sample
(n)
Referee
type
Expertise Sex Age Measurement
Level Experience
Ahmed et al. (2017) Futsal 18 R Experts > 5y Male 34.1±3.2y

- R recorded in nine competitive matches

- R decisions assessed by three futsal experts

Catteeuw et al. (2010) Soccer 10
38
AR
AR
Experts FIFA: 2.6 ± 3.3y
EPL: 4.8 ± 5.1y
6.6 ± 5.7y
NR NR

- Video assessment of offside situations with ProZone®

Elsworthy et al. (2014) Australian football 29 Umpire Experts NR NR 32.4±6.1y

- Movement demands measured with GPS

- Decisions assessed by AFL coaching staff (n = 3)

- Video analysis by the authors

Emmonds et al. (2015) Rugby 8 R Experts 7.3 ± 4.3y NR 35.3±7.1y

- Movement demands measured with GPS

- Video-assessment of penalty accuracy in 10-minutes periods

Gomez-Carmona and Pino Ortega (2016) Soccer 5
1
AR
R
Advanced
Advanced
NR NR 21.2±0.98y

- Recorded/ monitored in four games

- R decisions assessed by five experts

Larkin et al.
(2014)
Australian football 15 Umpire Experts 235.2 ± 151.3 matches NR 36±13.5y

- Blood lactate and video test after each quarter

- GPS monitoring for movement demands

Mallo et al.
(2012)
Soccer 10
20
R
AR
Experts FIFA license:
9.2 ± 4.1y
5.8 ± 3.8y
NR 39.4±2.4y
37.3±4.0y

- Matches recorded during FIFA confederations Cup 2009 in South Africa

- Decisions assessed by top-class referees (n = 3; experience: 9.7 ± 1.5y)

Mascarenhas et al. (2009) Soccer 5 R Experts > 4y Male 38.2±5.89y

- Recorded/ monitored in seven games

- Assessment by an authors

Oudejans et al. (2005) Soccer 4 AR Experts > 5y Male 42.2y

- Four matches recorded

- Video analysis of offside situations

Paradis et al. (2015) Australian football 10
8
Umpire
Umpire
Sub-elite
Junior
8.86 ± 2.04y
NR
NR 2.86±3.39y
22.38±10.5y

- Physical exercise (10x300m runs) with a video test each round

Samuel et al. (2019) Soccer 22 R Experts 5-23y Male 27.14±6.4

- Video-based decision test on a treadmill with variable speed

R = referee, AR = assistant referee, EPL: English Premier League, y = years, m = matches, NR = not reported, ± = standard deviation