Research article - (2011)10, 184 - 192 |
Effectiveness of Multimedia-Supported Education in Practical Sports Courses |
Roland Leser, Arnold Baca, Johannes Uhlig |
Key words: Multimedia, soccer, e-learning |
Key Points |
|
|
|
Design and procedure |
The study compared two different teaching methods in a soccer practical sports course at the Centre for Sport Science, University of Vienna (CSU) during the 2009 summer term. Due to the high number of participants who registered for the course, the class was split into two groups. The students were allocated to one of the two groups by the CSU teaching institution’s registration system and were, therefore, more or less chosen at random (If the number of student registrations for a CSU course is higher than 30, the course is split into several subgroups/sections. The allocation to the parallel sections is done automatically.). Throughout the semester both groups attended the course 90 minutes per week. The same teacher instructed both groups, and the aims and content of the courses were the same. The content relevant to the study was concentrated within a block of six consecutive units during the first third of the semester. In one case, traditional instruction was provided (Group A), characterised by the fact that at the beginning of the units, short theory blocks (i.e., soccer technique, tactics etc.) were given, before the subsequent practical forms of exercise and teaching. In the other case, the students attended the practical units already armed with theoretical preparation (Group B). The test subjects went to a computer-equipped lecture hall twice a week, where they received brief instructions on the operation of an information platform (as described later) and they worked through the information via independent study. Each unit was designed to take between 15 and 25 minutes. There was always an investigator on site to deal with any questions that arose during the learning process and the frequency and duration of the participants’ self studies were noted. The multimedia-teaching units were taught before and at the beginning of the teaching activities. Due to organisational constraints it was not possible to carry out the multimedia units at fixed intervals before the corresponding practical education. Nevertheless, much importance was attached to the factor that the time between learning and practising was adequate and an information transfer was possible. This second teaching method corresponded with the blended learning approach, being used at CSU with the platform “Sport multimedial” (Baca et al., The study followed a classic pre-test/post-test design. The instructional content of technical and tactical aspects of soccer performance was examined by means of two tests: one test before the six-week instruction block, and one after the six-week instruction block. In addition, subjective assessments of the instruction and of the participants’ own performance were gathered from the test subjects by means of a questionnaire. The following working hypotheses were formulated: |
Participants |
In total, 35 students (7 women and 28 men) from the Sport Science undergraduate course of CSU took part in the study. All the test subjects were active in sports: six were active soccer players for amateur clubs, another six came from other sports game disciplines and the rest were involved in other types of activities ( |
Multimedia-lectures |
The multimedia-teaching units were based on the soccer module of “Sport multimedial”, an online platform used to convey theoretical and practical aspects of sports to students (Baca, To demonstrate one concrete example of the e-learning course, the content and elements used to convey defensive tactics are detailed below. The self-study course was structured sequentially. It began with written cues containing the most important rules for the defensive behaviour in one- versus-one situations: These basic tactical rules were then illustrated by static graphics ( In addition to the static illustrations, animations were provided which focused on the crucial factor of “timing” (e.g., appropriate moment of attack). These animations were not only restricted to isolated one-versus-one situations but also showed adequate individual behaviour in the defence in more complex situations. Six multimedia units were prepared: three on the subject of soccer technique and three on soccer tactics. The units built on each other within the technical and tactical content. |
Instruments |
For the purposes of the study, three analysis instruments were used: a performance diagnosis test to check soccer technique (LSPTm), an expert rating to classify soccer tactics and the use of a questionnaire to assess the subjective impressions of the test subjects. |
LSPTm |
There are numerous testing procedures within the area of soccer technique. However, only a few of these meet scientific quality criteria. The Loughborough Soccer Passing Test (LSPT, Originally, the LSPT was constructed and applied for testing skilled soccer players. In case the LSPT was used for the investigation, the original test was too difficult for many participants and therefore the tests often couldn’t be completed. The new objective was to find an alternative solution to the already proven LSPT. This alternative method should, on the one hand, challenge the target group adequately, and on the other hand, it should be of high validity just like the original test. For this purpose, the LSPT was simplified by a couple of modifications. In comparison to the original test, the inner rectangle (1 x 2.5 m), originally used for the return of the ball in control after each pass, was removed and the passing zone was increased to cover the entire exterior rectangle (2.5 x 4 m). The assignment of points (time calculation) as a testing criterion was adapted accordingly. The validity of the LSPTm was checked and assessed as sufficient. |
Expert ranking |
There are only a small number of valid and reliable test procedures for the direct assessment of tactical abilities and skills in sports. Some approaches try to assess these procedures through the reactions to computer simulations or video scenes (e.g., French and Thomas, Four soccer coaches with the highest or second-highest level Austrian coaches’ licences, who could also contribute sufficient experience with studying videos and with rating procedures, conducted the assessment of the tactical performance. Each individual performed exercise was stored as a digital video sequence for the expert rating. Then, four video packages were put together for each test subject. There was one package for each of the following before and after the teaching activity: attacking behaviour (player with the ball) and defensive behaviour (player without a ball). Each package contained five to ten video scenes. These video sequences were played to the assessors as many times as they wished. The video functions of slow motion and freeze were available. After looking at a complete video package, the assessors evaluated the performance on a five-point scale (1 = very good, 2 = good, 3 = satisfactory, 4 = adequate, 5 = unsatisfactory). To assist the assessment, the assessors were provided with a criteria catalogue as a guideline for the grading. The experts did not know whether the particular video package contained recordings from before or after the teaching activity. The validity of the test procedure was assured by the high level of the trainers’ expertise while conducting the assessment. Their reliability was checked by presenting the same video package for assessment to two different and independent experts. The resulting correlation coefficient, Spearman’s Rho of 0.506 (p = 0.016), demonstrated sufficient consensus. |
Query |
To evaluate the opinions and assessments of the testing as well as the effects of the teaching activity as anticipated by the participants, two questionnaires were developed. One questionnaire was presented to the treatment group, and one was given to the control group. The first part of the questionnaire presented to the treatment group contained biographical questions about the person’s age and sex, the number of terms and his/her main sports activity. If the main sports activity was soccer, there were further questions related to membership of a club, performance level, position played and frequency of training. The second part of the treatment group’s questionnaire contained questions on the testing itself. The test subjects could state on a five- point scale (i.e., applies, more or less applies, perhaps, does not really apply, does not apply), to what extent they found the testing difficult and to what extent they believed that they had improved between the first and the second measurement. The final part of the questionnaire contained questions on the multimedia-teaching units. The participants assessed, on a five-point scale (see above), questions regarding to the following: to what extent the teaching units were helpful, to what extent their content was well prepared, to what extent the increase in complexity was appropriate in the sequence of the units and to what extent they expected having improved as a result of the teaching units. The questionnaire presented to the control group was the same as described for the treatment group with the exception that the questions on the multimedia units were omitted. In the multimedia section of the questionnaire, the participants were asked whether they would have preferred the use of multimedia content to assist with practical performance improvement. |
Data analysis |
The data analysis was carried out by using SPSS® version 13.0 for Windows. Allocated by sex and active soccer players, the Chi-Square Test for Independence and the Fishers’s Exact Test were used, respectively, to detect any possible differences between Group A and Group B in their biographical details. An independent Student’s T-Test was then used to check for any difference in age and number-of-terms variables. For comparison with the results of the LSPTm test, an independent T-Test was also employed to detect any difference between the initial values of the two groups. A comparison between the two group’s pre-test and post-test results was performed using a dependent Student’s T-Test. Because all of the variables of the expert ranking and the questionnaire results - that were checked for significance - were ordinally scaled, they were analysed with parameter-free procedures. The Wilcoxon Test was used for the comparison of the pre-test results and the post-test results. For all other analyses, an independent U-Test was used. |
|
|
Comparison of the results of the LSPTm |
A comparison between the two groups of the initial values (pre-test Group A versus pre-test Group B), as well as a detection of a change in both groups between the pre-test and post-test, consistently failed to generate any significant results ( |
Comparison of the results of the expert ranking |
In the assessment of tactical skills, a distinction was made between attacking and defensive behaviour. |
Results of the questionnaire |
No difference was found between the two groups (p = 0.797) for the question regarding the subjective assessment of the testing difficulty (in particular the execution of the LSPTm). The testing was perceived as difficult but not too demanding. Furthermore, there was no significant difference in the results for the subjective assessment of whether the test result had improved between the pre-test and post-test (p = 0.458). Neither group believed that there had been any improvement or deterioration. However, there was a difference in the assessment of whether the quality of the soccer skills had improved between the tests (p = 0.043). Whereas Group A evaluated this as neutral, Group B thought to have improved. The questions regarding the multimedia units’ structure design and content were assessed as good and very good, respectively. The majority of the control group participants would have, in principle, also liked to have received support by means of multimedia materials. |
|
|
The study investigated the effects and effectiveness of multimedia-supported instruction, as compared with traditional instruction, in practical sports education. Specifically, two soccer courses held at a university training institution were compared with each other. Traditional instruction methods were used in one course and the other course was supported with multimedia units. To compare the two groups with regard to their progress in practical soccer skills, a soccer-related passing test and an expert rating were used. The applied passing test is accepted as a valid and reliable assessment instrument (Ali et al., Another methodical problem was that the expert ranking used to rate the performance of individual tactical behaviour had only a medium correlation between the several evaluators (Spearman’s Rho = 0.506). Despite that, this instrument was nonetheless used in the investigation because the correlation was statistically significant and there are no other methods known which give reason to expect more validity than a correctly conducted expert assessment. However, the results of the expert ranking should be considered with respect to this. The overall outcome of this empirical investigation produced a uniform picture of results. No differences could be detected between the control and treatment groups for either of the areas of selected soccer technique or soccer tactics. In this setting, multimedia-supported instruction led to no improvement in performance in the specific soccer components tested. Interestingly, the results tended to decline when comparing the pre-test with the post-test. Though no significance was observed, the authors found no explanation for this decline but consider randomness as a main factor. If there would have been an additional factor that negatively influenced the results’ change from the pre-test to the post-test, then it could be assumed that the decline in performance may be lower in the treatment group than in the control group. However, here also, the independent tests (T-Test for the passing test and Mann-Whitney U-Test for the expert ranking) showed no significant results. The main outcome of this investigation corresponds with the conclusions of the Russel, Nevertheless, it must be said that the studies that confirmed the effectiveness of multimedia in sports generally appear to be in the minority. This is also confirmed by a recent review of the literature by Wiemeyer, A crucial factor in whether media-supported instruction can be beneficial may reside in the complexity of the setting analysed. The study investigated a very specific situation involving a learning setting in practical sports skill acquisition. This focus, within a very homogenous constellation of learners’ interactions with a special task and a given environment, seems to be necessary due to the numerous interacting factors that influence multimedia learning. Therefore, the results are only valid for the described setting, and generalisations would only be possible in very similar learning situations. One very important aspect in considering the effectiveness of e-learning environments could not be investigated in this study: long-term learning effects. The authors found similarities between their approach and a blended learning paradigm called “Person-Centered e- Learning - PCeL” (Motschnig and Mallich, |
Future directions |
Multimedia education not only assists students in learning and improving sports motions or tactical behaviour or helps teachers and coaches to better guide exercises. The emphasis in future will probably shift to a development of intelligent systems that not only present multimedia information, but, moreover, account for individual performance data in generating this multimedia feedback. Pervasive computing technology will capture relevant motion data during exercising and give personalised feedback in almost real time. It may be expected that systems of that kind may be more effective when learning or improving sports motions or tactics than traditional systems. |
|
|
The current study analyses the effectiveness of multimedia-supported teaching in motor skill learning. The survey has resulted in one main finding: no significant positive effects could be found for students using digital learning materials compared to students taught traditionally. Although this outcome goes hand in hand with other empirical research on multimedia learning it should not be generalized because the analysed learning situation was embedded in a very specific context. Long-term learning effects might, however, be expected as a consequence of positive motivational experiences made by many participants of the treatment. |
AUTHOR BIOGRAPHY |
|
REFERENCES |
|