Table 8.
Real-time versus video agreement: Cohen’s Kappa with 95% confidence intervals and criteria percentage agreement; (n = 20, except * n = 19, ** n = 18).
Test
Criteria
Left-hand side
Kappa (95% CI)
Right-hand side
Kappa (95% CI)
Criteria agreement (%)
1
A
.55
(.19-.90)
.43
(.01-.85)
77.5
B
.67
(.34-1.00)
.69
(.38-1.00)
85.0
C
.69
(.29-1.00)
.69
(.29-1.00)
90.0
D
.46
(-.14-1.00)
.34
(.04-.64)
77.5
E
.13
(-.16-.46)
.23 *
(-.11-.57)
53.8
2
A
.00
N/A
N/A
N/A
92.5
B
.38
(-.12-.87)
.318
(-.27-.90)
82.5
C
.00
N/A
.000
N/A
92.5
D
.14
(-.16-.43)
.259
(-.08-.60)
55.0
E
.00
(-.40-.40)
.529
(.14-.92)
65.0
3
A
.31 (-.14-.75)
75.0
B
.10 (-.28-.48)
55.0
C
-.08
(-.24-.08)
-.08
(-.24-.08)
-.08
4
A
1.00 (1.00-1.00)
100.0
B
N/A
N/A
N/A
N/A
N/A
C
.26
(-.12-.63)
.26
(-.12-.63)
.26
D
.24 *
(-.02-.50)
.24 *
(-.02-.50)
.24 *
5
A
N/A*
N/A
N/A
N/A
100.0
B
.18 *
(-.16-.53)
.11 **
(-.33-.55)
59.5
C
-.02 *
(-.46-.42)
.03 *
(-.43-.48)
60.5
D
-.09 *
(-.25-.08)
.22 *
(-.15-.58)
76.3
7
A
.00
N/A
.000
N/A
85.0
B
-.11
(-.29-.06)
-.14
(-.33-.06)
77.5
C
.64
(.01-1.00)
.27
(-.17-.71)
87.5
D
.38 (.08-.67)
65.0
E
.78
(.50-1.00)
.69
(.38-1.00)
87.5
8
A
0.00 N/A
95.0
B
.58
(.22-.95)
.58
(.22-.95)
.58
C
N/A
N/A
N/A
N/A
N/A
D
.83
(.50-1.00)
.83
(.50-1.00)
.83
9
A
.73
(.39-1.00)
.66
(.31-1.00)
87.5
B
.58
(.22-.95)
.70
(.38-1.00)
82.5
C
.49
(.11-.88)
.07
(-.28-.43)
62.5
D
.35
(-.17-.86)
.46 *
(-.14-1.00)
87.2
E
.42
(.06-.78)
.38 *
(.01-.76)
69.2
10
A
.50
(.05-.95)
.00
N/A
72.5
B
-.07
(-.48-.35)
.21
(-.24-.67)
65.0
C
.03
(-.37-.43)
.20
(-.22-.62)
55.0
D
.03
(-.04-.11)
.04 *
(-.04-.12)
30.8
E
.38
(-.02-.78)
.38
(-.02-.78)
70.0