Rodney A.
Clifton†
*,
W. George
Baldwin‡
and
Yichun
Wei§
University of Manitoba, Winnipeg, Manitoba, Canada. E-mail: clifton@cc.umanitoba.ca
First published on 6th December 2011
In the 1998–99 academic year, the Department of Chemistry at the University of Manitoba reorganized its first-year course to include two types of sections: “regular sections” for students with high school chemistry grades above 70%, and “developmental sections” for students with grades between 50 and 70%. The regular sections had about 200 students with two or three lectures a week for 150 min and associated labs, and, in contrast, the developmental sections had between 60 and 100 students with five lectures a week for 250 min, weekly tests, and associated labs. By end of the 2006–07 academic year, 7890 students had completed the chemistry course, and 7045 (89%) of these students were included in this study: 5600 in regular sections and 1445 in developmental sections. We found that the students in the developmental sections did better than the students in the regular sections when a number of important variables were controlled. In addition, students' grades in high school chemistry and mathematics were strongly related to their grades in university chemistry, and their attendance in classes and labs, an indicator of their engagement, had strong effects on the developmental students’ chemistry grades.
Before redesigning this course, two lecturers, Dr W. G. Baldwin and Dr N. R. Hunter, examined the admission records of approximately 5000 students who had enrolled in the first-year chemistry courses over the previous five years. They discovered that students with high school chemistry grades below 70% had only about a 50% chance of completing the first-year chemistry course with minimum grades of “C”, which was required for enrolling in advanced courses. As well, they found that the students' success in chemistry was related to their high school grades in mathematics, and that the students who had not come directly to university from high school had lower grades than the students who came directly from high school.
Not surprisingly, the research literature shows that success in university is strongly related to students' success in high school (McFate and Olmsted, 1999; McKenzie and Schweitzer, 2001; Kuh et al., 2005; Association of American Colleges and Universities, 2007), and a number of studies show that the students' prior academic achievement in mathematics also has a very strong effect on their performance in first-year chemistry (Wagner et al., 2002; Tai et al., 2005; Tai and Sadler, 2007; Potgieter et al., 2010; Seery, 2009). The research literature also suggests that males generally have higher grades in science courses than females (Jacobs, 1996; Clifton et al., 2008). But, we could not find any research in this literature that actually examined the effect of changing the structure of first-year courses or the effect of the gap students have in progressing from high school to university (see Potgieter et al., 2010). This study specifically focuses on the effects of these two variables on the grades students receive in a first-year chemistry course.
Seeing the difficulties that students who received relatively low grades in high school chemistry and mathematics and students who waited a year or more before enrolling in university had in first-year chemistry, the Department of Chemistry reorganized the first-year course so there were “developmental sections” for students with high school grades in chemistry below 70%, and “regular sections” for students with high school grades above 70%. Also, students who had been out of school for a year or more were encouraged to enrol in the developmental sections. Unfortunately, the choice of 70% and a one-year gap between high school and university were based on the two lecturers' impressions and not on rigorous statistical procedures that could more clearly identity students who were having difficulties with the course content.
Nevertheless, the developmental sections were organized to be more learner-centred; that is, the lecturers aligned their expectations more tightly with the actual knowledge and skills possessed by the less-prepared students in the developmental sections than in the regular sections. Specifically, the developmental sections met in classrooms of between 60 and 100 students five times a week for 50 minute periods, either from 8:30 to 9:20 am or from 1:30 to 2:20 pm, for 13 weeks. In addition, at the end of each week, the students were given a multiple choice test on the material covered in the previous class periods, and importantly, the students and lecturers discussed the answers. In this way, the lecturers helped the students understand their errors and how to correct them. These in-class tests counted for 10% of the students' final grades.
Essentially, the developmental sections were designed according to the principles of mastery-learning, a theory which assumes that for less-prepared students to succeed, they need to increase the time they spend on the course material (Lee and Pruitt, 1984; Guskey, 1985). As such, the developmental students spent 250 minutes in the classroom each week, and the lecturers organized their lectures into small discrete units. Following this, the lecturers had the students demonstrate their mastery of the subject matter at the end of each week in question and answer sessions (Reid, 2008). From the perspective of cognitive psychology, this organization of the course material helped the students transfer the subject matter from their instructors' lectures and the textbook into their working-memory in small “chunks” which, in turn, helped them transfer the information to their long-term memory, incrementally building their understanding of chemistry. In addition, the weekly tests and question and answer periods helped the students assess their understanding of the course content. Obviously, learning a complex and hierarchically organized subject, like chemistry, requires the integration of new information with information that the students already possess, and then assessing whether or not it has become integrated into the knowledge they have stored in their long-term memory (Ausubel et al., 1978; Cowan, 1995; Reid, 2008). Consequently, it was expected that the students in the developmental sections would become more actively engaged in the course material (Association of American Colleges and Universities, 2007; Eilks and Byers, 2010).
In contrast, the regular sections with about 200 students in a classroom met either three times a week for 50-minute periods or twice a week for 75-minute periods (150 minutes each week) for 13 weeks, which is the normal arrangement of lectures at the University of Manitoba. In these sections, lecturers were not as concerned about integrating the chunks of new information with information that the students already possessed nor did they give the students weekly feedback. Rather, these students were expected to be more independent than the students in the developmental sections. The students completed four take-home assignments during the semester, representing 10% of their final grades (which was the same weight as the weekly tests that the developmental students wrote). Of course, the students in both the developmental and regular sections used the same textbook, completed the same laboratory assignments, and wrote the same mid-term and final examinations which carried the same weight.
Grades | F | D | C | C+ | B | B+ | A | A+ | Mean | S.D. |
---|---|---|---|---|---|---|---|---|---|---|
Coding | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | ||
Regular | 2.4 | 4.6 | 13.9 | 18.2 | 20.2 | 16.7 | 18.8 | 5.2 | 7.00 | 1.71 |
Developmental | 5.5 | 8.2 | 22.8 | 19.4 | 20.2 | 12.2 | 9.7 | 1.9 | 6.26 | 1.69 |
Grades | 50–54 | 55–59 | 60–64 | 65–69 | 70–74 | 75–79 | 80–84 | 85–89 | 90–94 | ≥95 | Mean | S.D. |
---|---|---|---|---|---|---|---|---|---|---|---|---|
Coding | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | ||
Regular | 0.9 | 1.0 | 2.0 | 3.0 | 10.3 | 13.5 | 20.8 | 20.5 | 19.4 | 8.8 | 7.25 | 1.84 |
Developmental | 9.1 | 10.1 | 20.2 | 25.5 | 14.5 | 7.4 | 6.4 | 3.5 | 2.2 | 1.1 | 4.13 | 1.98 |
Grades | 50–54 | 55–59 | 60–64 | 65–69 | 70–74 | 75–79 | 80–84 | 85–89 | 90–94 | ≥95 | Mean | S.D. |
---|---|---|---|---|---|---|---|---|---|---|---|---|
Coding | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | ||
Regular | 1.1 | 1.4 | 4.6 | 5.8 | 10.2 | 11.8 | 16.8 | 18.4 | 18.6 | 11.2 | 7.08 | 2.11 |
Developmental | 6.7 | 8.1 | 16.8 | 14.3 | 17.0 | 12.5 | 11.6 | 7.8 | 3.9 | 1.4 | 4.83 | 2.21 |
Correlation coefficients | Regression coefficients | ||||||
---|---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | Unstandardized | Standardized | |
*p < 0.05; **p < 0.01; ***p < 0.001. | |||||||
1. University I Chemistry | |||||||
2. High School Chemistry | 0.512 | 0.327 | 0.426*** | ||||
3. High School Mathematics | 0.502 | 0.661 | 0.225 | 0.301*** | |||
4. Time from Graduation | −0.092 | −0.275 | −0.232 | 0.257 | 0.063*** | ||
5. Gender | −0.020 | 0.013 | −0.046 | 0.008 | −0.068 | −0.020* | |
6. Program | −0.174 | −0.559 | −0.391 | 0.188 | 0.045 | 0.730 | 0.170*** |
R 2 | 0.334 |
The positive result for the developmental students, in comparison with the regular students, suggests that we should examine this program more closely. Analyses of the 1445 students in the developmental sections are reported in Table 5. Here, we see that the effect of high school chemistry and mathematics are slightly lower (an unstandardized coefficient of 0.278 vs. 0.327 in Table 4 for chemistry and 0.141 vs. 0.225 in Table 4 for mathematics), suggesting that the students in the developmental sections have been able to compensate to a considerable extent for their deficiencies in both chemistry and mathematics probably because of the increased time and attention they spent on the first-year chemistry course. Surprisingly, the time since high school graduation is considerably higher (0.536 vs. 0.257 in Table 4), indicating that for the students in the developmental sections, those who took time off between high school and university did much better than the students who progressed directly to university. Finally, the variance explained by the independent variables is much lower for the developmental students than for the total sample of students (20.3% vs. 33.4% in Table 4), which also suggests that the structure of the developmental course helped the students overcome their academic weaknesses. In other words, the effects that the independent variables have on the students' chemistry grades have decreased because of the combined effects of the structure of the course (the class size, five weekly lectures, tests, and assignments), and possibly because of the lecturers' concerns for the students in the developmental sections, and the students' own motivation and engagement improved as a result of the redesigned course structure.
Correlation coefficients | Regression coefficients | |||||
---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | Unstandardized | Standardized | |
***p < 0.001. | ||||||
1. University I Chemistry | ||||||
2. High School Chemistry | 0.394 | 0.278 | 0.327*** | |||
3. High School Mathematics | 0.315 | 0.432 | 0.141 | 0.184*** | ||
4. Time from Graduation | 0.118 | −0.073 | −0.071 | 0.536 | 0.155*** | |
5. Gender | 0.009 | 0.063 | −0.011 | 0.024 | −0.044 | −0.013 |
R 2 | 0.203 |
Obviously, lecturers can only do a few things to help students learn chemistry, and students need to become engaged in the course material (McKenzie and Schweitzer, 2001; Wagner et al., 2002; Kuh et al., 2005; Tai et al., 2005; Potgieter et al., 2010). For this reason, we hypothesized that students who attended more classes would have higher final grades than students who attended fewer classes. Fortunately, in one developmental section in each of the six academic years from 2001–02 to 2006–07, the students' attendance was collected from 427 students who had complete data on the other independent variables. 4% of these students attended less than 20% of the classes (coded 1); 9.1% attended between 20 and 49% of the classes (coded 2); 30.7% attended between 50 and 79% of the classes (coded 3); 29.0% attended between 80 and 94% of the classes (coded 4); and only 27.2% attended between 95 and 100% of the classes (coded 5).
Table 6 reports the correlation and regression coefficients for these 427 students in developmental sections in which their attendance was recorded. As expected, the strongest regression coefficient for the effects of the independent variables on the grades the students obtained in the first-year chemistry course is their attendance (0.439), in which a one standard deviation change results in a change of 43.9% of a standard deviation in chemistry grades. The other three variables have relatively similar effects; the effect of time from high school graduation is 0.213; the effect of high school chemistry is 0.191; and the effect of high school mathematics is 0.174. The inclusion of the attendance variable seems to decrease the effect of high school chemistry from 0.278 (the unstandardized coefficient reported in Table 5) to 0.147 (Table 6), indicating that students in the developmental sections can compensate for their weaknesses in high school chemistry, to a considerable extent, by enrolling in developmental sections and not skipping classes. Equally important, the variance explained has increased from 20.3% (reported in Table 5) to 33.4%, which supports the notion that attendance has an important effect on the developmental students' final grades in the first-year chemistry course. The effect of high school mathematics is about the same in both analyses (0.141 in Table 5 and 0.129 in Table 6), but the effect of time since high school graduation has increased from 0.536 (in Table 5) to 0.705, indicating that after controlling for the other independent variables, students who have been out of school for one or more years have higher final grades than students without a gap between high school and university.
Correlation coefficients | Regression coefficients | ||||||
---|---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | Unstandardized | Standardized | |
***p < 0.001. | |||||||
1. University I Chemistry | |||||||
2. High School Chemistry | 0.381 | 0.147 | 0.191*** | ||||
3. High School Mathematics | 0.273 | 0.401 | 0.129 | 0.174*** | |||
4. Time from Graduation | 0.080 | −0.044 | −0.124 | 0.705 | 0.213*** | ||
5. Gender | 0.026 | 0.020 | −0.002 | −0.009 | 0.025 | 0.008 | |
6. Attendance | 0.465 | 0.295 | 0.111 | −0.234 | 0.040 | 0.658 | 0.439*** |
R 2 | 0.334 |
These findings, of course, may seem to be common sense, and not surprisingly, both the Association of American Colleges and Universities (2007) and the European Chemistry Thematic Network (Eilks and Byers, 2010) have recommended similar strategies for helping students become more engaged in course material. Specifically, these results demonstrate the importance of increasing the class time with more frequent and better monitored assessments for the less-prepared students. Considerable research shows that the time students spend on learning the course material in chemistry—as well as in other subjects—positively affects their grades (Wagner et al., 2002; Potgieter et al., 2010). Cognitive psychologists tell us that the amount of time students spend studying the subject and practicing the skills is vitally important in ensuring that the knowledge and skills become embedded in their long-term memories. And, only when the subject matter and skills have been embedded in the students’ memories can it be retrieved and used in solving complex problems (Ausubel et al., 1978; Cowan, 1995; Reid, 2008).
In creating the developmental sections, the lecturers in the Chemistry Department made three important assumptions about the first-year students. First, they assumed that almost all of the first-year students could master the course material even if they had relatively low chemistry grades in high school. The key, in the minds the chemistry lecturers, was to put the students in classes with fewer students and with empathetic instructors who assess their understanding of the subject week-by-week. Second, the chemistry lecturers assumed that the less-prepared students would need more time and smaller “chunks” of subject material than the better-prepared students. Third, the lecturers assumed that the less-prepared students would need more frequent assessment and feedback on their progress which was provided by the weekly tests. Not surprisingly, these assumptions are congruent with the theory of mastery learning, a theory that is particularly effective in explaining how less-prepared students learn subject matter, like chemistry, that is hierarchically organized (Lee and Pruitt, 1984; Guskey, 1985; Reid, 2008).
Of course, education is a cooperative enterprise, and lectures can only affect the opportunities for students to learn. The students themselves need to become actively engaged in learning the subject matter by attending classes and labs and actively working at understanding the course material. Thus, it is not surprising to find that in the developmental sections, attendance at classes has the strongest effect on the students' grades in the first-year chemistry course. In fact, attendance is more than twice as strong as the effect of prior achievement in chemistry. Nevertheless, not all students value the learning opportunities that the lecturers and department provided for them. In this study, about 15% of the students in the developmental sections attended less than 50% of the classes.
Overall, these results suggest some additional policies for universities to consider. First, admission tests could be used to assign students to developmental and regular sections of introductory courses (McFate and Olmsted, 1999). Second, the developmental sections, specifically, could have specially selected lecturers who closely monitor the progress of the less-prepared students. Third, at the beginning of courses, the lecturers could tell students that it is very important for them to attend classes and actively engage in learning the subject matter. This may seem obvious to lecturers and to most students, but unfortunately a small proportion of first-year students do not seem to realize the importance of attending classes, engaging in learning the course material, completing all assignments on time, and writing all examination.
This study has some serious limitations which may caution chemistry departments from implementing similar developmental programs. First, the study is limited because we cannot identify the effects of the various aspects of the intervention that account for the differences in the students' achievement. Further research is needed to determine how the smaller classes, increased instructional time, more student-centered curriculum, and more frequent assignments with prompt feedback independently affect the students' grades. This study only assessed the combined effect of the intervention in a first-year chemistry course at one university. Nevertheless, this package of strategies is consistent with the theory of mastery learning and with the recommendations of the Association of American Colleges and Universities (2007) and the European Chemistry Thematic Network (Eilks and Byers, 2010). Second, the evidence suggests that attendance, specifically, has a substantial effect on the academic achievement of the students in the developmental sections. This may suggest that the effect of attendance should be examined more carefully in other courses and at other universities. Third, even though the developmental sections were designed for the less-prepared students, there were better-prepared students in these sections, and there were less-prepared students in the regular sections. Of course, future research should compare the achievement of better-prepared students in the developmental sections with better-prepared students in the regular sections and less-prepared students in the developmental sections with less-prepared students in the regular sections. Finally, 1383 students, around 15% of the sample, withdrew voluntarily from the course. Unfortunately, this is a limitation because the students who withdrew are not random, and potentially this biases the results of the study.
Footnotes |
† Rodney A. Clifton is a professor in the Department of Educational Administration, Foundations, and Psychology, Faculty of Education. |
‡ W. George Baldwin is a visiting fellow in the Department of Chemistry, St. John's College. |
§ Yichun Wei is a PhD candidate in the Department of Educational Administration, Foundations, and Psychology, Faculty of Education. |
This journal is © The Royal Society of Chemistry 2012 |