Research article - (2016)15, 102 - 110 |
Assessing Motor Skill Competency in Elementary School Students: A Three-Year Study |
Weiyun Chen1,, Steve Mason1, Andrew Hypnar2, Austin Bennett3 |
Key words: Subject matter competency, quality teaching practices, manipulative skills |
Key Points |
|
|
|
Participants and research settings |
Participants in this study were nine elementary physical education teachers and the fourth- and fifth-grade students at nine elementary schools in the same school district located in the suburban area of the Mid-West of the United States. Five physical education teachers were females and four were males. They all were Caucasian. Their ages ranged from 33 to 55 years old and their teaching experience varied from 6 years to 26 years. Students, ranging from 1,387 to 1,398, participated in the pre-intervention; Students between 1,346 and 1,926 participated in the post-intervention year 1; and students between 1,361 and 1,496 participated in the post-intervention year 2; Student population was dominantly White (91.2% Caucasian; 48% female and 52% male). The fourth and fifth grade students had a 60-minute physical education class per week. The class size ranged from 18-28 students. The university institutional review board and the school district granted the permission for conducting this study. All nine physical education teachers signed the consent form to indicate their willingness to participate in this study. The parent/guardian of the fourth and fifth grade also signed the consent form to grant the permission of their child for participating in this study. The assent form was also distributed to the students to have them decide whether or not they wanted to participation in this study, even though their parent/guardian approved their participation in this study. |
Background of this study |
The reason for selecting the nine elementary physical education teachers and their fourth- and fifth-grade students as the participants for this study was that their school district housing nine elementary schools received a three-year Carol White Physical Education Program (PEP) grant which is funded by U.S Department of Education in 2009. Since the PEP program began in 2001, the U.S. Department of Education has awarded more than $ 620 million to local educational agencies and community-based organizations to help them initiate, expand, and/or enhance physical education programs for students in kindergarten through 12th grade to meet their state standards for physical education (U.S. Department of Education, Given the goals and objectives of the PEP grant program, randomly controlled trial (experimental design consisting of control and intervention groups) was not suitable for this study. To help all fourth- and fifth-grade students achieve the content standard 1 (the objective #1 of the PEP project), all nine elementary schools were in the intervention condition in which the CATCH PE curriculum was implemented by the nine physical education teachers during their regular physical education classes. All fourth- and fifth-grade students who enrolled in the nine elementary school students were recruited to participate in this study. To examine the effect of the intervention on the students’ achievement of motor skill competency, pre- and post- tests research design was used for this study. During the PEP year 1 (the pre-intervention phase), all nine physical education teachers participated in a two-day CATCH PE curriculum workshop and staff development. During a full-day the CATCH School Implementation Training Workshop presented by a CATCH training specialist, All nine physical education teachers learned the best practices of the CATCH PE lessons, participated in hands-on CATCH PE training activities, and discussed strategic plans for implementing CATCH PE in their current PE programs. During another full-day staff development and workshop, all nine physical education teachers studied the CATCH PE grade-specific curriculum guidebooks and identified the plan for incorporating a few CATCH PE units into their current PE programs. Meanwhile, to help the teachers effectively conduct the PE Metrics assessments with their students, a full-day workshop on PE Metrics assessments was held. All nine physical education teachers learned grade-specific and skill-specific assessment rubrics, assessment criteria, assessment tasks, and testing protocols. Prior to the intervention, baseline motor skill assessments were conducted with the fourth- and fifth-grade student by their trained physical education teachers using the PE Metrics Assessments, including soccer dribbling, passing, and catching skills, overhand throwing skills, and striking skill. To facilitate the teachers to implement CATCH PE lessons, each teacher was provided with a CATCH PE curriculum package including over 500 activities focusing on skill themes and physical fitness activities, and adequate equipment by specified PEP grant money allocated to the curriculum implementation. During the post-intervention year 1(PEP project year 2), each physical education teacher had taught 72 PE lessons to students in grades 4-5 during the school year. Each teacher was required to teach CATCH PE lessons to their students per week, while using the Curriculum Log to record what specific CATCH PE content they taught per week throughout the school year. Analysis of the Curriculum Log indicated that the nine teachers, on average, taught 37 CATCH PE lessons to their students. In other words, 51% of the PE lessons taught with CATCH PE curriculum lessons, including a variety of locomotor skills and manipulative skills within the context of modified games, basic specialized skills used in team and individual sports, and physical fitness activities. At the end of each CATCH PE unit, the physical education teachers conducted the motor skill assessment with their fourth- and fifth-grade students. During the post-intervention year 2 (PEP project year 3), analysis of the Curriculum Log indicated that the nine teachers, on average, taught 55 CATCH PE lessons to their students. In other words, 77% of the PE lessons taught with CATCH PE curriculum lessons. Similar to the PEP project year 2, the content of CATCH PE lessons consisted of fundamental manipulative skills such as dribbling, kicking, punting, catching, underhand throwing, overarm throwing, volleying, striking with rackets, striking with long handled implements, and basic specialized skills used in team and individual sports as well as a variety of locomotor skills and physical fitness activities. At the end of each CATCH PE unit, the physical education teachers conducted the motor skill assessments with their fourth- and fifth-grade students. To examine how well the nine PE teachers’ teaching practices were associated with quality teaching, the investigators video-recorded the nine PE teachers’ teaching 45 CATCH PE lessons to their students throughout the PEP project year 2 and year 3 and assessed the 45 video-recorded lessons using the Assessing Quality of Teaching Rubrics (Chen et al., |
Motor skill assessments |
Each trained physical education teacher used the PE Metrics assessments rubrics to formally assess their own students’ skill performance during their regular physical education lessons. Each teacher was required to strictly use the PE Metrics Assessment testing protocols, directions, assessment criteria, assessment rubrics, and assessment tasks to conduct the assessment with one student at a time. The PE Metrics Assessment rubric is designed as skill-specific assessment tool. Based on the unique nature of a skill, each assessment rubric has its own unique essential dimensions and performance indicators on each rating scale as well as the number of trial for testing. For the soccer dribbling, passing, and receiving skills assessment, the students’ performance levels were assessed on the three essential dimensions: Dribbling, Passing, and Receiving with a 0-4 rating scale. One trial was allowed for the test. Criteria for Competence (level 3) for Dribbling is: “dribble with control while moving at a slow, consistent jog,” for Passing is: “sends a receiving lead pass to a partner so it can be caught outside the passing lane without a break in the receiver’s stride on at least 3 passes,” and for Receiving is: “moves forward and outside the passing lane to meet the ball and receiving at least 3 receivable passes” (NASPE, In the overhand throwing skill assessment, students were assessed on their performance levels of Form and Accuracy to Target using a 0-4 rating scale. Criteria for Competence (Level 3) for Form are: “throws with selected essential elements: a) throwing elbow shoulder-high, hand back and side orientation in preparation for the throw. b) trunk rotation, with elbow lagging behind hip. c) weight transfer to non-throwing forward foot.” For Accuracy to Target is: “hits target area on wall” (NASPE, For the striking skill assessment, the students’ performance levels were assessed on the two essential dimensions: Form and Continuous Strikes using a 0-4 rating scale. Criteria for Competence (Level 3) for Form are: “usually uses a side orientation” and for Continuous Strikes are: “strikes the ball continuously against the wall 5 times from 10 feet with added strokes that may be in front of the 10-foot striking line” (NASPE, |
Data analysis |
Descriptive statistics and percentages were computed to determine levels and proportions of the students’ demonstration of competency in each of the three skills. ANOVA was utilized to examine the mean score difference in each skill assessment between the pre-intervention cohort, the post-intervention year 1 cohort, and the post-intervention year 2 cohort, followed by a post-hoc Dunnett T3 method. An independent t-test was conducted to examine the mean score difference in each skill assessment between the boys and the girls. An alpha level of .05 was used for all tests. |
|
|
Mean score differences of motor skill competency between three cohorts |
Regarding the overhand throwing skill assessment, a total score of 18 indicates an overall competent level. In the pre-intervention (baseline), 1,397 students who took the test on average demonstrated slightly higher than the competent level ( For the forehand striking skill, a total score of 6 indicates an overall competent level. In the pre-intervention (baseline), 1,387 students who completed the test on average demonstrated lower than the competent level ( |
Gender differences of motor skill competency in three cohorts |
Examination of boys’ mean score differences on the soccer skill assessment between three cohorts by means of ANOVA revealed significant differences between the three groups ( In contrast, examination of girls’ mean score dif-ferences on the soccer skill assessment between three cohorts by means of ANOVA revealed significant differences between the three groups ( In the post-intervention year 1, 974 boys and 812 girls participated in the skill assessment. The boys demonstrated higher than the competent level ( In the post-intervention year 2, 795 boys and 701 girls completed the assessment. The boys scored much higher than the competent level ( Examination of boys’ mean score differences on the overhand throwing assessment between three cohorts by means of ANOVA yielded significant differences between the three groups ( Examination of girls’ mean score differences on the overhand throwing assessment by means of ANOVA yielded significant differences between the three groups ( Examination of boys’ mean score differences on the forehand striking assessment between the three cohorts by means of ANOVA revealed significant differences between the three groups ( Examination of girls’ mean score differences on the forehand striking assessment between the three cohorts by means of ANOVA revealed significant differences between the three groups ( |
|
|
This study was designed to examine the fourth- and fifth-grade students’ demonstration of motor skill competency in relation to achieving the NASPE content standard 1 as a result of participating in CATCH PE curricular. The results of this study showed that the students in the post-intervention year 1 cohort demonstrated moderately higher than the competent level on the soccer dribbling, passing, and receiving, and overhand throwing skills, but slightly lower than the competent level on the forehand striking skill. More encouraging results were found in the post-intervention year 2 cohort. The students demonstrated much higher than the competent level on the overhand throwing skill, moderately higher than the competent level on the soccer dribbling, passing, and receiving skills, and slightly higher than the competent level on the forehand striking skill. Zhu et al. ( Examining the mean score differences of motor skill competency between the three cohorts indicated that the post-intervention year 2 cohort significantly outperformed both the pre-intervention cohort and the post-intervention year 1 cohort on all three skill assessments. The post-intervention year 1 cohort significantly outperformed the pre-intervention cohort on the soccer dribbling, passing, and receiving and the forehand striking assessments, but not on the overhand throwing skill assessment. Similarly, the proportions of the post-intervention year 2 cohort demonstrating the competent level or above were higher than those of the pre-intervention cohort and the post-intervention year 1 cohort on all three skills assessments. The proportions of the post-intervention year 1 cohort reaching the competent level or above were higher than those of the pre-intervention cohort on soccer dribbling, passing, and receiving and the forehand striking assessments, but not higher than the overhand throwing skill assessment. While heredity and growth influence skill development and learning, sequential learning tasks and productive learning environment contribute to motor skill development in children (Clark, It is important to note that in this study the highest number of students (80%) who demonstrated the competent level or above is the overhand throwing skill, followed by the soccer dribbling, passing, and receiving skills (75%) in the post-intervention year 2 cohort. However, the lowest number of students (64%) in the post-intervention year 2 and (56%) in the post-intervention year 1 demonstrated the competent level is forehand striking skill. Forehand striking skill is a basic specialized manipulative skill used in tennis, pickle ball, and badminton. Mastery of striking skill in childhood lays a foundation for adolescents to effectively learn and master related skills and to successfully play these sports. Barnett et al. ( This study shows that the boys in the pre-intervention and the two post-intervention cohorts scored significantly higher than the girls on all three skill assessments. Likewise, McKenzie et al. ( Although gender differences in the three skills were found at baseline and the two post-interventions, it was promising to find that the girls in the post-intervention year 2 cohorts had substantial improvement in all three skills, compared to the girls in the post-intervention year 1 cohort. The most dramatic gain for the girls in the post-intervention year 2 cohort is the overhand throwing skill and followed by the soccer dribbling, passing, and receiving skills. The girls in the post-intervention year 1 cohort had a modest improvement in all three skills, compared to the girls in the pre-intervention cohort. It is also noted that while the girls showed improvement in the forehand striking skill from the pre-intervention, the post-intervention year 1, to the post-intervention year 2, the girls in the two post-intervention cohorts demonstrated lower than the competent level on the tennis striking skill assessment. Okely et al. ( |
Implications |
This study adds to literature on standards-based assessment in physical education settings. This study indicates that the PE Metrics assessment rubrics are feasible tools for physical education teachers to assess levels of students’ demonstration of motor skill competency during a regular physical education lesson. This is the first study of using the PE Metrics assessment rubrics to assess students’ motor skill competency in basic specialized skills for three consecutive years within the context of the physical education teachers’ implementation of CATCH PE curricular. To date, no research has attempted to examine how standards-based quality physical education curricular help students’ achieving the NASPE content standard 1. The results of this study show that the students significantly improved their manipulative skill competency over the course of three years as a result of participating in a well-designed curriculum intervention. This study suggests that CATCH PE are effective curricular used for future intervention programs aiming to improve students’ motor skill competency in relation to physical activity promotion among school-aged children. |
|
|
In conclusion, the results indicated that while heredity and growth are associated with motor skill development, CATCH PE was conducive to improving fourth- and fifth-grade students’ motor skill competency in the three manipulative skills. The post-intervention year 2 cohort performed significantly better than both the pre-intervention cohort and the post-intervention year 1 cohort on all three skills assessments. The post-intervention year 1 cohort significantly outperformed the pre-intervention cohort on the soccer dribbling, passing, and receiving and the forehand striking assessments, but not on the overhand throwing skill assessment. Also, the post-intervention year 2 cohort showed higher proportions of the students reaching the competent level or above on all three skills assessments, compared to the post-intervention year 1cohort. Similarly, the post-intervention year 1 cohort had higher proportions of the students demonstrating the competent level or above than the pre-intervention cohort on the soccer dribbling, passing, and receiving and the forehand striking assessment, except for the overhand throwing skill assessment. While the boys in the three cohorts significantly outperformed the girls in the three cohorts on all three skills assessments, the girls showed substantial improvement on the overhand throwing and the score skills. However, the girls, in particular, need to improve motor skill competency in the forehand striking skill. |
AUTHOR BIOGRAPHY |
|
REFERENCES |
|