Julia Y. K.
Chan‡
and
Christopher F.
Bauer
*
Department of Chemistry, University of New Hampshire, Durham, USA. E-mail: christopher.bauer@unh.edu
First published on 11th April 2016
Students in general chemistry were partitioned into three groups by cluster analysis of six affective characteristics (emotional satisfaction, intellectual accessibility, chemistry self-concept, math self-concept, self-efficacy, and test anxiety). The at-home study strategies for exam preparation and in-class learning strategies differed among the three groups. Students in the high group (strongly positive affective characteristics) were more autonomous learners, reporting they understood the notes they took in lecture more frequently than the group with low (more negative) affective characteristics. The high group also relied less on tutors and teaching assistants for help when preparing for exams. Participating in explanatory behavior (with self or other students) was correlated positively with stronger exam performance, whereas rapt attention or assiduous note-taking in lecture was negatively correlated. The high and low affective groups were indistinct in their reports of amount of quality time spent studying, but did differ in their approach to using a practice exam as a resource.
Nevertheless, student learning and achievement is not simply a matter of application of conscious mental effort toward mastering the scientific content. There must be an emotional commitment to engage and a belief that one's efforts have a chance of leading to success (Haertel et al., 1983). Students enter each new learning task with an antecedent set of cognitive characteristics (past achievement, reading comprehension, and verbal facility) and affective characteristics (attitude and self-concept) (Bloom, 1976). A student who starts with positive attitudes, strong self-concepts, and thorough prior knowledge, should find learning to be easier, quicker, and lead to higher achievement. Within the learning process, metacognitive behavior (self-regulation) and immediate motivational status (self-efficacy beliefs, goal orientations, task-value beliefs) also affect learning outcomes (Zusho et al., 2003; Brandriet et al., 2013). Recent research has brought more attention to this interdependent relationship among chemistry students' content knowledge, cognitive processing, affective characteristics, and motivation (Xu et al., 2013; Chan and Bauer, 2014).
This article extends this effort by exploring student diversity in the affective dimension. Specifically, we explored how students approach the task of learning when they differ in their attitudes toward chemistry, concept of themselves as learners of chemistry, and sense of their ability to be successful at chemistry. Chan and Bauer (2014) looked at students entering the general chemistry course at a medium-sized public research university. Arguably these students are the most vulnerable because they are making the initial transition to college, they are in programs of study for which chemistry is required but often considered a roadblock (e.g. biology), and they have backgrounds (cognitive and emotional) which vary tremendously. This previous study identified from the literature six affective variables that had modest relationships with student outcomes. These variables were used to group students via a cluster analysis procedure. Effectively, individual students were distributed across a six-dimensional space, and then assembled into nearest-neighbor groups. The six variables were emotional satisfaction with chemistry, intellectual accessibility of chemistry, chemistry self-concept, mathematics self-concept, self-efficacy for learning chemistry, and chemistry test anxiety.
The previous study found that three clusters with significantly different characteristics could be delineated. In each cluster, the set of characteristics were found to be uniform in direction, e.g. one group was highest on all characteristics but lowest on test anxiety (called the “high” group), another group (called “low”) was lowest on all characteristics but highest on test anxiety, and a middle group was “middle”. Given previous reports of correlations among these variables, the overall unanimity in direction across variables was not surprising. Nevertheless, one is left with the impression of a self-reinforcing positive or negative affective profile. Student performance on tests, both early and at the end of a semester, was directly correlated with the affective profile. Furthermore, other characteristics were also found to be consistent with this picture, e.g. student reports of metacognitive behaviors.
In this study, we sought to explore more directly what students do and how much time they spend in class or at home when they engage in chemistry study behaviors as a function of their affective profile. If students with different affective characteristics exhibit distinctly different study strategies, particularly if the strategies are ineffective ones, then it may be possible to offer some remedy and target that to the students who need it most. Thus the following research questions were pursued:
1. To what extent do chemistry students distinguished by different affective characteristics differ in their use of in-class learning and at-home studying strategies?
2. To what extent is time-on-task and type of study strategy correlated with exam achievement? How is this relationship moderated by student affective characteristics?
Students were asked to talk about three topics: (i) approach to doing practice exams (exams from previous years), (ii) use of learning strategies in lecture, and (iii) use of studying strategies for exams. The interviews were audio-recorded and transcribed verbatim. The lens through which student comments were reviewed and analyzed was metacognitive self-regulation: how did students engage with the material and with others, what resources were used and in what order, how much time was spent and when, to what extent were elaboration and rehearsal behaviors used. The focus was on what students do and on whether they made strategic choices about what they do. Behavioral themes were identified and confirmed using the constant comparative method (Glaser and Strauss, 1999). Summary descriptions were created for student behaviors (Appendix 2, ESI†). Responses were coded by two chemistry education researchers and the first author. After training, all three coders agreed on 91% of the categorizations.
Item | r |
---|---|
4. When I copy things down in class, I understand what I'm writing down. | 0.44* |
21. I memorize answers or steps to solving problems if I don't understand what's going on. | −0.24* |
24. I ask myself questions to make sure I understand what I'm studying. | 0.18* |
25. I practice explaining the material to my friend. | 0.26* |
Component | Label | Items | α | r |
---|---|---|---|---|
1 | Reviewing/processing/organizing/outlining notes before and after lecture |
6. I review my notes within one day after lecture.
9. I review my notes from previous classes before each lecture. 10. After class, I paraphrase, summarize, or reorganize my notes. 11. Before lecture, I skim through the chapters that will be taught. 22. I use flashcards, concept maps, or make outlines of topics covered in class. 27. I read the textbook thoroughly and take notes. |
0.75 | −0.04 |
2 | Making sure not to miss any part of lecture; using technology in lecture |
14. I use my laptop/iPad to take notes.
15. I audiotape the lecture and replay to make sure I don't miss anything. 16. I sit in on another section of Chem 403 (in addition to the one I'm attending). |
0.68 | −0.04 |
3 | Questioning/explaining material to friends, studying in a group |
24. I ask myself questions to make sure I understand what I'm studying.
25. I practice explaining the material to my friend. 26. I study with a group of friends regularly. |
0.68 | 0.24** |
4 | Studying for exams |
17. I usually study the night before the exam to make sure the material is fresh in my mind.
18. I rely on past exams to gauge what I need to know for the exam. 19. I study from the answer keys of past exams. 21. I memorize answers or steps to solving problems if I don't understand what's going on. |
0.60 | −0.16 |
5 | Taking notes in lecture |
1. During class, I write down as much as I can about what I'm hearing and seeing.
2. I try to sit in a spot with less distractions. 13. Instead of taking a lot of notes, I just listen and absorb everything. |
0.60 | −0.19* |
The affective groups were also compared in terms of their exam preparation strategies. Again, cluster group was the independent variable and survey items were the dependent variables. The groups again were different (F(2,162) = 8.9, p < 0.001, η2 = 0.10). Post hoc analysis indicated that item 23 (Appendix 4, ESI†) was the major source. The low affective group reported stronger reliance (3.2 “sometimes” to “very often”) on tutors, teaching assistants (TAs), and Peer-Led Team Learning (PLTL) leaders for help more frequently compared to the high group (2.4 “rarely” to “sometimes”).
The power for the MANOVA analyses (using GPower software) for the conditions of effect size, Type I error rate, sample size, and number of survey items was in the range of 0.7 to 0.8, which is slightly weak given the number of survey items being tested relative to the size of the sample. Reducing the number of variables via principal component analysis should have provided an advantage, but the reliabilities of the components found perhaps worked against this strategy. Nevertheless, the quantitative findings are complemented and confirmed by the student interview work.
Affective group | Practice exam | In-class activity | General exam preparation | |||||
---|---|---|---|---|---|---|---|---|
Category | ||||||||
1 | 2 | 3 | 1 | 2 | 1 | 2 | 3 | |
High | 12 | 0 | 1 | 9 | 4 | 10 | 3 | 4 |
Low | 0 | 4 | 1 | 2 | 3 | 3 | 2 | 3 |
Students used the practice exam in three different ways: they approached, attempted to approach, or did not approach the practice exam like a real exam. In all but one instance, students in the high affective group approached the practice exam as if it were a real exam (code 1). They timed themselves, went to a quiet room, and did all the questions without consulting other resources.
[I] wouldn't have the answer key within reach…if stuck, [I] would skip and star [the] question, then look at the answer key as the last resort and look at the steps from the answer key and make note of how problem was solved in my notes and note down what is confusing to me… [Student 5, high]
Students in the high group mainly relied on themselves and only consulted other resources (notes, textbook, websites, friends) when in desperate need of help. When all of these resources have been used up, they would consult the answer key as the final resource.
If [I get] really stuck, [I will] go to my notes and find a problem that has similar structure to the problem I don't get and transfer it over… if still stuck, I will use answer key as the last resource. [Student 16, high]
I would go as far as I can, then refer to notes, [online] problems, or ask friends for help before consulting the answer key…I tried not to look at answer key because it won't be there on the test… [Student 1, high]
Students in the high group were determined to refer to as few resources as possible when doing the practice exam. Consequently, they felt more confident and secure about the exam material.
If I go into the exam knowing I was able to do the practice exam, and that it wasn't the answer key or notes, I'll walk in the exam feeling better and more confident, not stressing myself out, and not second guessing myself [Student 3, high]
Even after finishing the practice exam, I did not refer to the answer key for the questions I got stuck on but used my notes to look up those questions and made sure I understood everything clearly and [have] no second questions… if I do, I would ask for help [Student 18, high]
Furthermore, students in the high group display characteristics that are typical of autonomous learners (Boud, 1981). These students are independent, responsible, determined, and self-directed learners who function with minimal external guidance.
Anything I do not understand I will attempt to understand on my own. If I still do not understand a concept, I will call my dad, who is a chemistry teacher, or work out the problem with a friend who is in the same class. If [still] stuck, I will skip and come back to it, highlight, and write out all the important stuff…I would use the answer key as the final resource after consulting notes and asking dad for help because I want to ensure that I fully understand [the content] and not being taught by other people… [Student 15, high]
In contrast, students in the low affective group attempted to approach the practice exam like a real exam (code 2). These students started off the exam with no resources but referred to resources for assistance when they got stuck. Compared to students in the high affective group, these students gave-up more readily and relied on the answer key more often when they were stuck.
…looked at exam, tried to do problems…when stuck, went back to notes/answer key to figure out how to do it… [Student 12, low]
These students would often go back and forth between answer key and practice exam because they did not want to “memorize” the incorrect way of solving the problem or in other instances they had no idea how to start the problem.
…started to work on it like an actual test…got stuck and then looked at answer key and from there on went through the exam with answer key alongside for questions I did not understand. [Student 11, low]
[For the] first practice exam, I did a problem, didn't get it so went to look up answer…did another problem, checked answer. For the second practice exam, I treated it the same way as the first practice exam…didn't want to commit to memory the incorrect way of solving the problem [Student 10, low]
The final category describes students who did not approach the practice exam like a real exam (code 3). Only two students were classified into this category. These students often depended on resources for help, did not time themselves when taking the practice exam, or collaborated with other students when doing the practice exam.
…go through each problem and try to solve, did not time myself, had answers and notes on the side while working on practice exam to reference back if needed… [Student 13, low]
…attempted as a group, worked with notes…if didn't understand, talked with group members and go to answer key to see how the answer was derived… [Student 6, high]
The second theme delineated from the interviews was students' use of learning strategies in lecture. Two codes were assigned: student is actively engaged (code 1) or not (code 2) in lecture. The distinction in this instance is less clear: 9/13 (69%) from the high affective group and 2/5 (40%) from the low affective group described active engagement during class. Some students actively engaged in lecture by processing, elaborating, and interpreting notes simultaneously; asking questions; or highlighting confusing concepts (code 1). When practice problems were presented in lecture, they actively attempted the problem alone or in a group before instructor goes over them.
…take notes but also try to understand the way Prof X constructs and analyzes a problem to solve for an answer…when professor writes down stuff on the board, I try to first process, interpret what he writes and then paraphrase in my own words… [Student 4, high]
…use highlighters to mark important facts and terms, also keep a separate sheet to write down questions [that] need further clarification on… [Student 12, low]
Other students who are not actively engaged in lecture mainly record notes and receive information in lecture, passively follow in class by sitting and paying attention, or copy notes verbatim without much processing and interpretation in lecture (code 2). When practice problems are presented in lecture, these students often wait for instructor's explanation instead of attempting it first.
…write everything down that we go over [because] even if I don't understand something, I know I can go back to it later if it's in my notes [Student 7, high]
…take notes but try not to paraphrase because don't want to misinterpret what is said so copy [notes] verbatim…sometimes don't understand the notes… [Student 9, low]
The third theme that emerged from the interviews was students' use of study strategies when studying for exams. Three codes were assigned: student reviews lecture notes, does practice exams, or homework problems and practice metacognitively self-regulated activities (code 1); student reviews lecture notes, does practice exams, or homework problems without explicit metacognitive engagement (code 2); and student makes use of various available resources to assist their studying (code 3). We distinguished students’ use of resources (code 3) from the types of activities they are engaged in when studying for exams (codes 2, 3). In this category, the high affective group was distinct only for code 1. Code 1 describes students who demonstrate metacognitive awareness by monitoring and evaluating their understanding through mental and social interactions such as: self-questioning, self-quizzing, explaining, elaborating, or teaching. Furthermore, he/she is proactive and initiates learning by incorporating a variety of strategies such as: organizing, outlining, or paraphrasing notes, creating study guides, flashcards, or cheat sheets to assist their studying. He/she tend to focus on mastery learning and understanding of the material.
Outline notes, handouts; do practice problems…make flashcards of polyatomic ions; make study guide that consists of definitions, steps to do problems, and the problem itself…re-teaching or re-explaining chemistry to freshmen students help me learn concepts again… [Student 17, high]
Go over notes, do homework, make flashcards, use PhET online simulations, go through CONNECT with textbook, review notes, complete practice exams, ask myself questions when solving problems [Student 10, low]
Alternatively, some students were not as elaborate when studying for exams. These students only completed practice problems, practice exams, or reviewed notes. When students use self-questioning as a learning strategy, they often ask lower-order questions that focus on remembering and understanding (“How do I convert L to mL? What are the six strong acids? What does M stand for?”):
…review notes, go through textbook, reword problems by substituting different numbers into questions that were gone over in class, ask questions while studying like how to change from mL to L, g to mol? [Student 6, high]
…look over old tests, notes, work out problems on a white board, memorize important compound names… ask process questions to ensure understanding of material like would I be able to repeat this again with another [similar] problem? [Student 13, low]
The first research question asked whether students grouped by affective characteristics (emotional satisfaction, intellectual accessibility, chemistry self-concept, math self-concept, self-efficacy, and test anxiety) differed in terms of their in-class learning and at-home studying strategies. Some differences were found. Students in the high affective group reported they understood the notes they took in lecture more frequently than the low affective group. This sense of understanding during information processing is positively correlated with exam performance (Table 1). At the same time, the failure to take notes or simply scribing what happens is negatively correlated (Table 2). This survey result is confirmed by student interviews, which indicate that students in the high affective group are more actively engaged during lecture. These results suggest that the depth of processing is important. Furthermore, the high affective group (and consequently high achievers) shows characteristics typical of autonomous learners, that is they initiate their own learning with minimal external guidance (i.e. from tutors, TAs, and PLTL leaders) and challenge themselves to rely on their own thinking when given a practice exam opportunity. Over 70% of students within the high affective group report the strategies they have been using to be effective, while a lower percentage was reported for students in the low affective group (40–48%). For the most part, students who report that their strategies have not been working successfully plan on modifying their strategies in the future, suggesting they have a desire or motivation to improve and perform better.
Regarding the second research question, the amount of uninterrupted time spent studying chemistry outside of lecture time did not correlate with exam performance and did not appear different among the affective groups. On the other hand, the survey results showed that stronger performance was related to processing information by elaboration and self-questioning or explaining ideas to others.
Triangulation of survey and interview data was necessary to assemble a picture of the learners in this sample of general chemistry students. The results suggest that learning and studying behaviors are different for students who exhibit higher vs. lower sets of affective characteristics, and that those behaviors are linked to better exam performance. These results regarding attitude, motivation, and self-concept complement the work of others, reported in the introduction, which primarily considered student achievement measures. The study strategies survey seems to have provided some insight regarding student learning approaches, but its psychometric characteristics should be more strongly developed and established in future work.
What are the practical implications of the findings from this research? The primary message is that students need assistance in becoming aware that what they do is not so important as what they are thinking while they are doing it. Instructors of chemistry must provide explicit opportunities for students to engage in challenging work that asks them to discuss, explain, and elaborate (Simbo, 1988; Chi et al., 1989), and to work as much as possible without the crutch of having an answer or tutor in front of them. Some students are prepared for this because of their affective profile, and others are not. Of the six affective variables we have considered, test anxiety and self-efficacy seem most accessible as characteristics that could be manipulated. Anxiety about science has been recognized as an issue for students for a long time (Mallow, 1981) and there are approaches that instructors can use to address it, for example, writing about those anxieties (Ramirez and Beilock, 2011). Similarly, self-efficacy is the perception that one is able to accomplish a specific learning task (Zimmerman, 1998). Students need to see pathways and strategies that can lead to more successful outcomes. Peer-Led Team Learning, in which successful students model and guide the learning of other students, may be one approach to achieving this. (Chan and Bauer, 2015).
Footnotes |
† Electronic supplementary information (ESI) available. See DOI: 10.1039/c5rp00205b |
‡ Now at Department of Chemistry, Biochemistry, and Physics, University of Tampa, Tampa, USA. |
This journal is © The Royal Society of Chemistry 2016 |