Table 3.
Overall test agreement (as a combination of each test’s criteria) and overall scenario agreement (as a combination of all tests).
Test
Test agreement (%)
Inter-rater
Intra-rater (1)
Intra-rater (2)
Real-time / video
1
85.0
99.5
93.0
76.9
2
83.5
99.5
90.5
77.5
3
87.2
95.0
100.0
67.9
4
95.0
97.1
93.6
74.6
5
81.9
96.7
94.1
67.8
7
91.7
98.3
90.0
82.2
8
95.0
94.3
96.4
87.1
9
77.5
97.5
95.5
77.3
10
87.0
97.0
96.0
58.3
Overall
86.5
97.5
93.9
74.5