Learning and studying strategies used by general chemistry students with different affective characteristics

Julia Y. K. Chan and Christopher F. Bauer *
Department of Chemistry, University of New Hampshire, Durham, USA. E-mail: christopher.bauer@unh.edu

Received 16th November 2015 , Accepted 11th April 2016

First published on 11th April 2016


Abstract

Students in general chemistry were partitioned into three groups by cluster analysis of six affective characteristics (emotional satisfaction, intellectual accessibility, chemistry self-concept, math self-concept, self-efficacy, and test anxiety). The at-home study strategies for exam preparation and in-class learning strategies differed among the three groups. Students in the high group (strongly positive affective characteristics) were more autonomous learners, reporting they understood the notes they took in lecture more frequently than the group with low (more negative) affective characteristics. The high group also relied less on tutors and teaching assistants for help when preparing for exams. Participating in explanatory behavior (with self or other students) was correlated positively with stronger exam performance, whereas rapt attention or assiduous note-taking in lecture was negatively correlated. The high and low affective groups were indistinct in their reports of amount of quality time spent studying, but did differ in their approach to using a practice exam as a resource.


Introduction

Many first-year college students experience difficulty not because they lack ability but because they lack awareness of and skill in learning and studying strategies (King, 1992). An array of cognitive skills and processes are involved, such as recording, organizing, synthesizing, remembering, acquiring, and using information in a way that enhances students' understanding. Low-achieving students often use the same ineffective and narrow set of study approaches for all learning tasks, regardless of content or difficulty (Gettinger and Seibert, 2002). They spend more time memorizing and describing (lower level processes) and less time comparing and integrating (higher level processes), using Bloom's taxonomy (Bloom and Krathwohl, 1956) as a framework. Furthermore, low achieving students often take on a passive role and rely mainly on others (such as teachers, tutors, parents) when learning (Gettinger and Seibert, 2002). In contrast, high achieving students are actively engaged and display self-regulatory behaviors, consistently monitoring, regulating, and evaluating their understanding throughout the learning process. They initiate and sustain their own learning processes, have high self-efficacy, are intrinsically motivated, and persist through challenges (Hadwin and Winne, 1996; Purdie and Hattie, 1996; Zimmerman, 1998). Instructors can help low-achieving students develop effective and efficient learning strategies. For example, when first-year general chemistry students were explicitly taught learning strategies in a single 50 minute supplementary class, their average was a full letter grade higher compared to those who did not attend (Cook et al., 2013). In this intervention, students were exposed to a variety of learning strategies and specific metacognitive study strategies that have been proven to work (Hadwin and Winne, 1996; Gettinger and Seibert, 2002; Hodges et al., 2012). These include paraphrasing and rewriting lecture notes, doing homework problems without following an example, previewing material before lecture, studying in groups, and interacting with peers in the role of “teacher” (Cook et al., 2013).

Nevertheless, student learning and achievement is not simply a matter of application of conscious mental effort toward mastering the scientific content. There must be an emotional commitment to engage and a belief that one's efforts have a chance of leading to success (Haertel et al., 1983). Students enter each new learning task with an antecedent set of cognitive characteristics (past achievement, reading comprehension, and verbal facility) and affective characteristics (attitude and self-concept) (Bloom, 1976). A student who starts with positive attitudes, strong self-concepts, and thorough prior knowledge, should find learning to be easier, quicker, and lead to higher achievement. Within the learning process, metacognitive behavior (self-regulation) and immediate motivational status (self-efficacy beliefs, goal orientations, task-value beliefs) also affect learning outcomes (Zusho et al., 2003; Brandriet et al., 2013). Recent research has brought more attention to this interdependent relationship among chemistry students' content knowledge, cognitive processing, affective characteristics, and motivation (Xu et al., 2013; Chan and Bauer, 2014).

This article extends this effort by exploring student diversity in the affective dimension. Specifically, we explored how students approach the task of learning when they differ in their attitudes toward chemistry, concept of themselves as learners of chemistry, and sense of their ability to be successful at chemistry. Chan and Bauer (2014) looked at students entering the general chemistry course at a medium-sized public research university. Arguably these students are the most vulnerable because they are making the initial transition to college, they are in programs of study for which chemistry is required but often considered a roadblock (e.g. biology), and they have backgrounds (cognitive and emotional) which vary tremendously. This previous study identified from the literature six affective variables that had modest relationships with student outcomes. These variables were used to group students via a cluster analysis procedure. Effectively, individual students were distributed across a six-dimensional space, and then assembled into nearest-neighbor groups. The six variables were emotional satisfaction with chemistry, intellectual accessibility of chemistry, chemistry self-concept, mathematics self-concept, self-efficacy for learning chemistry, and chemistry test anxiety.

The previous study found that three clusters with significantly different characteristics could be delineated. In each cluster, the set of characteristics were found to be uniform in direction, e.g. one group was highest on all characteristics but lowest on test anxiety (called the “high” group), another group (called “low”) was lowest on all characteristics but highest on test anxiety, and a middle group was “middle”. Given previous reports of correlations among these variables, the overall unanimity in direction across variables was not surprising. Nevertheless, one is left with the impression of a self-reinforcing positive or negative affective profile. Student performance on tests, both early and at the end of a semester, was directly correlated with the affective profile. Furthermore, other characteristics were also found to be consistent with this picture, e.g. student reports of metacognitive behaviors.

In this study, we sought to explore more directly what students do and how much time they spend in class or at home when they engage in chemistry study behaviors as a function of their affective profile. If students with different affective characteristics exhibit distinctly different study strategies, particularly if the strategies are ineffective ones, then it may be possible to offer some remedy and target that to the students who need it most. Thus the following research questions were pursued:

1. To what extent do chemistry students distinguished by different affective characteristics differ in their use of in-class learning and at-home studying strategies?

2. To what extent is time-on-task and type of study strategy correlated with exam achievement? How is this relationship moderated by student affective characteristics?

Method

Affective instruments and cluster analysis

Clustering variables were selected from three instruments. The Chemistry Self-Concept Inventory (CSCI) (Bauer, 2005) provided two dimensions of students' concepts of themselves as learners, in chemistry and in mathematics. The shortened version of the Attitude toward the Subject of Chemistry Inventory (ASCIv2) provided two dimensions of attitude toward chemistry, emotional satisfaction and intellectual accessibility (Bauer, 2008; Xu and Lewis, 2011). The Motivated Strategies for Learning Questionnaire (MSLQ) (Pintrich and De Groot, 1990) has subscales for the dimensions of self-efficacy and text anxiety. All scales have four to ten response items in Likert format and have been validated with higher-education student populations. A detailed description of the instruments and clustering variables is described elsewhere (Chan and Bauer, 2014). Student responses were collected on-line using Qualtrics survey software. Clustering was accomplished with the following steps. Survey response data from the three separate instruments were converted to Z-scores (subtracting the scale mean and dividing by the standard deviation). This puts each of the six variables onto the same relative scale so each contributes evenly to inter-cluster distances. A procedure called Ward's method was implemented using the commercial product SPSS (original acronym for Statistical Package for the Social Sciences). Ward's method minimizes internal cluster sum-of-squares and maximizes between-cluster sum of squares. This cluster procedure provided a satisfactory and interpretable result; nevertheless, it is important to recognize that other procedures might group the students in alternative yet acceptable ways.

Study strategies survey

To ascertain the types of in-class learning and at-home studying strategies used by students, a new study strategies survey (Appendix 1, ESI) was developed. The survey consists of both open-ended and forced choice questions assembled from several previously-reported in the literature (Pintrich et al., 1991; Weinstein and Palmer, 2002). The open-ended questions ask students to list the types of strategies used in two different settings: during lecture and when preparing for exams, with the intention of capturing spontaneous responses and minimizing acquiescence bias. The choice questions come next. They list strategies (generated by one of the authors) in which students rate frequency of use on a 5-point Likert scale (1-never, 2-rarely, 3-sometimes, 4-very often, 5-always). Questions regarding perceived effectiveness of and satisfaction with study strategies were also asked. The study strategies survey was made available online immediately after the first exam when scores had been made known to students.

Course achievement

Early course achievement was taken as the score on the first exam, approximately four weeks into the semester. This instructor-written, 80 minute exam consisted of 70% written and 30% multiple-choice questions covering topics of atomic theory, chemical elements and compound symbols, nomenclature, molar mass, and stoichiometry.

Office consultation

To triangulate results gathered from the study strategy survey, students identified in high and low affective profile groups were randomly selected for a short “office hour consultation” with the first author. Random selection was accomplished by generating in Microsoft Excel a random number for the students in each group, and then issuing email invitations using that sequence. Those who were not selected had an equal opportunity to attend any of the professor's regular office hours. During the invited visit, a short 15–25 minute semi-structured interview was conducted. Questions were designed to get a deeper understanding about the study strategies students were using. Thirty students who had completed all affective instruments and study strategies survey were invited for a consultation (fifteen in high and fifteen in low affective groups). A second round of invitations was sent to students in the low affective group due to low participation, however, this only attracted one additional student. Ultimately, eighteen students agreed to participate (n = 13, high; n = 5, low).

Students were asked to talk about three topics: (i) approach to doing practice exams (exams from previous years), (ii) use of learning strategies in lecture, and (iii) use of studying strategies for exams. The interviews were audio-recorded and transcribed verbatim. The lens through which student comments were reviewed and analyzed was metacognitive self-regulation: how did students engage with the material and with others, what resources were used and in what order, how much time was spent and when, to what extent were elaboration and rehearsal behaviors used. The focus was on what students do and on whether they made strategic choices about what they do. Behavioral themes were identified and confirmed using the constant comparative method (Glaser and Strauss, 1999). Summary descriptions were created for student behaviors (Appendix 2, ESI). Responses were coded by two chemistry education researchers and the first author. After training, all three coders agreed on 91% of the categorizations.

Participants

The study population is identical to the study population previously reported in Chan and Bauer's (2014) paper. The course is the first semester of a two-semester sequence typically required for students in the biological and health sciences, who make up about two-thirds of the enrollment. Students were predominantly in their first-semester at college. All surveys were available on-line: the affective and metacognitive instruments (ASCIv2, CSCI, and MSLQ) for a week at the beginning of the semester and the study strategies survey for a week immediately after the return of the first exam. Of the 554 students in class (three lecture sections), 164 (30%) completed all four surveys and consented to participate. (This constitutes list-wise deletion of students). Students were reminded of survey opportunities throughout the semester by email, announcements in the web-based course management system, and in lecture. As an incentive for completing the surveys or for participating in an interview, students earned extra credit (∼1%) toward their course grade regardless of their consent status. This protocol was approved by the authors' Institutional Review Board. Students who completed the survey outperformed the students who did not by about 5% points on exams (significant at p < 0.05). Those who completed the survey also were more likely to have course grades that were A or B (about 66%) vs. those who did not (about 44%). The consequences of this imbalance are considered in the Conclusion section.

Statistical analysis

For all statistical analysis, SPSS version 20.0 was used. Where repetitive inferential tests were performed (e.g. survey items), a Bonferonni correction was applied to control for increased risk of Type I error. (When many inferential tests are done, the likelihood that at least one will result in “significantly different” increases. Consequently, reducing the threshold for significance to 0.01 or 0.001 rather than say 0.05 avoids potential false positives.) Because the intent of this study was to see the extent to which learning and studying strategies differed among cluster groups, responses that were extreme relative to the mean on each survey question category were kept. No ceiling or floor effects were observed.

Results

I. Study strategies survey: relationship of items with course achievement

As part of the study strategies survey, students were asked to report the frequency (never to always) of use of twenty-eight possible learning or study behaviors (Appendices 3 and 4, ESI). Correlations were calculated for these items with the variable of exam performance. Four items (items 4, 21, 24, and 25) were significantly but modestly correlated with exam scores (Table 1).
Table 1 Correlation of learning behaviors with exam performance (*p < 0.001)
Item r
4. When I copy things down in class, I understand what I'm writing down. 0.44*
21. I memorize answers or steps to solving problems if I don't understand what's going on. −0.24*
24. I ask myself questions to make sure I understand what I'm studying. 0.18*
25. I practice explaining the material to my friend. 0.26*


II. Study strategies survey: principal component analysis

Since the study strategies survey was newly created, it is possible that certain items were related because they measure a common idea (because students responded to them in a similar way). Combining those items could improve reliability of the average. Principal component analysis (an option in SPSS factor analysis procedures) with varimax rotation was used to create linear combinations of items that might explain more of the variance in responses. Five major components were found (Table 2), accounting for 46% of the common variance (Appendix 5, ESI). Reliabilities (Cronbach) for each component are modest (0.6 to 0.7) and a bit lower than desirable. Further development of survey items, in particular, increasing the number that contribute to each component, would help increase reliability. Weak but significant correlations of two items were found with exam performance for “Questioning/Explaining Behavior” component 3 (r(228) = 0.24, p < 0.001) and “Class note-taking” component 5 (r(228) = −0.19, p < 0.01) (Table 2, right column). Component 3 includes two of the items previously linked to higher test scores.
Table 2 Five components found from principal component analysis (**p < 0.001, *p < 0.01), Cronbach alpha reliability, and Pearson r correlation with exam scores
Component Label Items α r
1 Reviewing/processing/organizing/outlining notes before and after lecture 6. I review my notes within one day after lecture.

9. I review my notes from previous classes before each lecture.

10. After class, I paraphrase, summarize, or reorganize my notes.

11. Before lecture, I skim through the chapters that will be taught.

22. I use flashcards, concept maps, or make outlines of topics covered in class.

27. I read the textbook thoroughly and take notes.

0.75 −0.04
 
2 Making sure not to miss any part of lecture; using technology in lecture 14. I use my laptop/iPad to take notes.

15. I audiotape the lecture and replay to make sure I don't miss anything.

16. I sit in on another section of Chem 403 (in addition to the one I'm attending).

0.68 −0.04
 
3 Questioning/explaining material to friends, studying in a group 24. I ask myself questions to make sure I understand what I'm studying.

25. I practice explaining the material to my friend.

26. I study with a group of friends regularly.

0.68 0.24**
 
4 Studying for exams 17. I usually study the night before the exam to make sure the material is fresh in my mind.

18. I rely on past exams to gauge what I need to know for the exam.

19. I study from the answer keys of past exams.

21. I memorize answers or steps to solving problems if I don't understand what's going on.

0.60 −0.16
 
5 Taking notes in lecture 1. During class, I write down as much as I can about what I'm hearing and seeing.

2. I try to sit in a spot with less distractions.

13. Instead of taking a lot of notes, I just listen and absorb everything.

0.60 −0.19*


III. Study strategies survey: differences in studying and learning strategies among affective groups

Using individual study strategies survey questions as dependent variables, the three cluster groups (Chan and Bauer, 2014) were compared using one-way multivariate analysis of variance (MANOVA). Two separate MANOVAs were conducted: One for in-class learning strategies (16 items) and another for exam preparation strategies (12 items). Post hoc pairwise comparisons showed that a major difference between the high and low affective groups was their approach used when taking notes in class (F(2,162) = 9.6, p < 0.001, η2 = 0.11). An eta squared value of 0.11 represents a small effect size. Students in the high group reported more frequent understanding of the notes they take in class (4.0 “very often” response on scale of 1 to 5) compared to students in the low group (3.2, closer to “sometimes”).

The affective groups were also compared in terms of their exam preparation strategies. Again, cluster group was the independent variable and survey items were the dependent variables. The groups again were different (F(2,162) = 8.9, p < 0.001, η2 = 0.10). Post hoc analysis indicated that item 23 (Appendix 4, ESI) was the major source. The low affective group reported stronger reliance (3.2 “sometimes” to “very often”) on tutors, teaching assistants (TAs), and Peer-Led Team Learning (PLTL) leaders for help more frequently compared to the high group (2.4 “rarely” to “sometimes”).

The power for the MANOVA analyses (using GPower software) for the conditions of effect size, Type I error rate, sample size, and number of survey items was in the range of 0.7 to 0.8, which is slightly weak given the number of survey items being tested relative to the size of the sample. Reducing the number of variables via principal component analysis should have provided an advantage, but the reliabilities of the components found perhaps worked against this strategy. Nevertheless, the quantitative findings are complemented and confirmed by the student interview work.

IV. Study strategies survey: evaluating the effectiveness of in-class learning and at-home studying strategies among affective groups

Open-ended questions asked students to evaluate the effectiveness of the learning and studying strategies they had been using and reasons they had for modifying or not modifying strategies (Appendix 1, ESI). Fig. 1 (in-class learning strategies) and Fig. 2 (at-home study strategies for exam preparation) summarize these results in pie charts. Each affective group has its own pie chart. For the low affective group, fewer than half of the students reported their strategies have been effective (blue slice: 40% (in-class learning); 48% (at-home studying)). The percentage of students who were satisfied with their strategies increases substantially in the medium and high affective groups. The second largest response category is from students who report that their strategies have not been effective and they plan on modifying them. A very small percentage of students (8% or less in any group) did not plan on modifying their strategies.
image file: c5rp00205b-f1.tif
Fig. 1 Pie graphs summarizing effectiveness of in-class learning strategies and reasons for modifying strategies (or not) according to affective groups. Refers to questions 4–7 on study strategies survey. (Low: N = 25, medium: N = 70, high: N = 70.)

image file: c5rp00205b-f2.tif
Fig. 2 Pie graphs summarizing effectiveness of at-home studying strategies and reasons for modifying strategies (or not) according to affective groups. Refers to questions 10–13 on study strategies survey. (Low: N = 25, medium: N = 70, high: N = 70.)

V. Study strategies survey: student interviews

Students invited for an office consultation were asked to talk about three topics: (i) approach to doing practice exams (made available via course website), (ii) use of in-class learning strategies, and (iii) use of at-home studying strategies when preparing for exams. Table 3 summarizes the reported student behaviors as identified using the category descriptions in Appendix 2 (ESI). Data for each individual student is listed in Appendix 6 (ESI). In general, a larger proportion of students in the high affective group were classified as exhibiting stronger intellectual engagement in how they used the practice exam and in their behavior during class. Students in the low affective group either did not exhibit the behavior or did so less frequently. To support these classifications, excerpts from students' transcripts are here organized by the three topics and according to the affective group.
Table 3 Classification of interviewed student behaviors (Appendix 2 (ESI) has category descriptions)
Affective group Practice exam In-class activity General exam preparation
Category
1 2 3 1 2 1 2 3
High 12 0 1 9 4 10 3 4
Low 0 4 1 2 3 3 2 3


Students used the practice exam in three different ways: they approached, attempted to approach, or did not approach the practice exam like a real exam. In all but one instance, students in the high affective group approached the practice exam as if it were a real exam (code 1). They timed themselves, went to a quiet room, and did all the questions without consulting other resources.

[I] wouldn't have the answer key within reach…if stuck, [I] would skip and star [the] question, then look at the answer key as the last resort and look at the steps from the answer key and make note of how problem was solved in my notes and note down what is confusing to me… [Student 5, high]

Students in the high group mainly relied on themselves and only consulted other resources (notes, textbook, websites, friends) when in desperate need of help. When all of these resources have been used up, they would consult the answer key as the final resource.

If [I get] really stuck, [I will] go to my notes and find a problem that has similar structure to the problem I don't get and transfer it over… if still stuck, I will use answer key as the last resource. [Student 16, high]

I would go as far as I can, then refer to notes, [online] problems, or ask friends for help before consulting the answer key…I tried not to look at answer key because it won't be there on the test… [Student 1, high]

Students in the high group were determined to refer to as few resources as possible when doing the practice exam. Consequently, they felt more confident and secure about the exam material.

If I go into the exam knowing I was able to do the practice exam, and that it wasn't the answer key or notes, I'll walk in the exam feeling better and more confident, not stressing myself out, and not second guessing myself [Student 3, high]

Even after finishing the practice exam, I did not refer to the answer key for the questions I got stuck on but used my notes to look up those questions and made sure I understood everything clearly and [have] no second questions… if I do, I would ask for help [Student 18, high]

Furthermore, students in the high group display characteristics that are typical of autonomous learners (Boud, 1981). These students are independent, responsible, determined, and self-directed learners who function with minimal external guidance.

Anything I do not understand I will attempt to understand on my own. If I still do not understand a concept, I will call my dad, who is a chemistry teacher, or work out the problem with a friend who is in the same class. If [still] stuck, I will skip and come back to it, highlight, and write out all the important stuff…I would use the answer key as the final resource after consulting notes and asking dad for help because I want to ensure that I fully understand [the content] and not being taught by other people… [Student 15, high]

In contrast, students in the low affective group attempted to approach the practice exam like a real exam (code 2). These students started off the exam with no resources but referred to resources for assistance when they got stuck. Compared to students in the high affective group, these students gave-up more readily and relied on the answer key more often when they were stuck.

…looked at exam, tried to do problems…when stuck, went back to notes/answer key to figure out how to do it… [Student 12, low]

These students would often go back and forth between answer key and practice exam because they did not want to “memorize” the incorrect way of solving the problem or in other instances they had no idea how to start the problem.

…started to work on it like an actual test…got stuck and then looked at answer key and from there on went through the exam with answer key alongside for questions I did not understand. [Student 11, low]

[For the] first practice exam, I did a problem, didn't get it so went to look up answer…did another problem, checked answer. For the second practice exam, I treated it the same way as the first practice exam…didn't want to commit to memory the incorrect way of solving the problem [Student 10, low]

The final category describes students who did not approach the practice exam like a real exam (code 3). Only two students were classified into this category. These students often depended on resources for help, did not time themselves when taking the practice exam, or collaborated with other students when doing the practice exam.

…go through each problem and try to solve, did not time myself, had answers and notes on the side while working on practice exam to reference back if needed… [Student 13, low]

attempted as a group, worked with notes…if didn't understand, talked with group members and go to answer key to see how the answer was derived… [Student 6, high]

The second theme delineated from the interviews was students' use of learning strategies in lecture. Two codes were assigned: student is actively engaged (code 1) or not (code 2) in lecture. The distinction in this instance is less clear: 9/13 (69%) from the high affective group and 2/5 (40%) from the low affective group described active engagement during class. Some students actively engaged in lecture by processing, elaborating, and interpreting notes simultaneously; asking questions; or highlighting confusing concepts (code 1). When practice problems were presented in lecture, they actively attempted the problem alone or in a group before instructor goes over them.

take notes but also try to understand the way Prof X constructs and analyzes a problem to solve for an answer…when professor writes down stuff on the board, I try to first process, interpret what he writes and then paraphrase in my own words… [Student 4, high]

use highlighters to mark important facts and terms, also keep a separate sheet to write down questions [that] need further clarification on… [Student 12, low]

Other students who are not actively engaged in lecture mainly record notes and receive information in lecture, passively follow in class by sitting and paying attention, or copy notes verbatim without much processing and interpretation in lecture (code 2). When practice problems are presented in lecture, these students often wait for instructor's explanation instead of attempting it first.

write everything down that we go over [because] even if I don't understand something, I know I can go back to it later if it's in my notes [Student 7, high]

take notes but try not to paraphrase because don't want to misinterpret what is said so copy [notes] verbatim…sometimes don't understand the notes… [Student 9, low]

The third theme that emerged from the interviews was students' use of study strategies when studying for exams. Three codes were assigned: student reviews lecture notes, does practice exams, or homework problems and practice metacognitively self-regulated activities (code 1); student reviews lecture notes, does practice exams, or homework problems without explicit metacognitive engagement (code 2); and student makes use of various available resources to assist their studying (code 3). We distinguished students’ use of resources (code 3) from the types of activities they are engaged in when studying for exams (codes 2, 3). In this category, the high affective group was distinct only for code 1. Code 1 describes students who demonstrate metacognitive awareness by monitoring and evaluating their understanding through mental and social interactions such as: self-questioning, self-quizzing, explaining, elaborating, or teaching. Furthermore, he/she is proactive and initiates learning by incorporating a variety of strategies such as: organizing, outlining, or paraphrasing notes, creating study guides, flashcards, or cheat sheets to assist their studying. He/she tend to focus on mastery learning and understanding of the material.

Outline notes, handouts; do practice problems…make flashcards of polyatomic ions; make study guide that consists of definitions, steps to do problems, and the problem itself…re-teaching or re-explaining chemistry to freshmen students help me learn concepts again… [Student 17, high]

Go over notes, do homework, make flashcards, use PhET online simulations, go through CONNECT with textbook, review notes, complete practice exams, ask myself questions when solving problems [Student 10, low]

Alternatively, some students were not as elaborate when studying for exams. These students only completed practice problems, practice exams, or reviewed notes. When students use self-questioning as a learning strategy, they often ask lower-order questions that focus on remembering and understanding (“How do I convert L to mL? What are the six strong acids? What does M stand for?”):

review notes, go through textbook, reword problems by substituting different numbers into questions that were gone over in class, ask questions while studying like how to change from mL to L, g to mol? [Student 6, high]

look over old tests, notes, work out problems on a white board, memorize important compound names… ask process questions to ensure understanding of material like would I be able to repeat this again with another [similar] problem? [Student 13, low]

VI. Study strategies survey: differences in quality time spent on chemistry and exam achievement among affective groups

The study strategies survey included a question pertaining to amount of out-of-class study time. Quality time is defined here as the time in which students are fully engaged on a task without distractions (i.e. social media texting, watching TV, etc.). Students reported less than 1 hour (3.1%), 1–2 hours (19.2%), 3–6 hours (50.2%), 6–8 hours (21.2%), or more than 8 hours (6.3%). We found the amount of “quality time” spent on chemistry outside of the required class was not significantly correlated with exam achievement (r(244) = −0.078, p = 0.23). In addition, no differences were found among the affective cluster groups. This finding is consistent with other investigations. Weak relationships with test scores were found between total study time and time spent reviewing (Dickinson and O'Connell, 1990). This result is consistent across various disciplines (natural sciences, social sciences, humanities), even after controlling for college aptitude exam scores, such as the SAT (Schuman et al., 1985). Many college students believe the more time they spend “studying,” the better they will perform on exams, however, our findings confirm other research suggesting this assumption that time alone will help is incorrect.

Conclusions and implications

Students who completed all of the necessary surveys had stronger course performances than the students who did not do so. This student self-selection may affect the MANOVA results by narrowing the range of responses included in the analysis. Consequently, one should be cautious about quantitative generalization to the entire population of students in this course. Nevertheless, it is important that the students in the study did include those with a range of course outcomes (25% A, 40% B, 25% C, 10% D or F). This imbalanced participation does not present a serious problem for this study since we are not making an absolute claim about the frequency of study strategy behaviors. Rather, we are identifying relationships among behaviors, performance, and affective characteristics.

The first research question asked whether students grouped by affective characteristics (emotional satisfaction, intellectual accessibility, chemistry self-concept, math self-concept, self-efficacy, and test anxiety) differed in terms of their in-class learning and at-home studying strategies. Some differences were found. Students in the high affective group reported they understood the notes they took in lecture more frequently than the low affective group. This sense of understanding during information processing is positively correlated with exam performance (Table 1). At the same time, the failure to take notes or simply scribing what happens is negatively correlated (Table 2). This survey result is confirmed by student interviews, which indicate that students in the high affective group are more actively engaged during lecture. These results suggest that the depth of processing is important. Furthermore, the high affective group (and consequently high achievers) shows characteristics typical of autonomous learners, that is they initiate their own learning with minimal external guidance (i.e. from tutors, TAs, and PLTL leaders) and challenge themselves to rely on their own thinking when given a practice exam opportunity. Over 70% of students within the high affective group report the strategies they have been using to be effective, while a lower percentage was reported for students in the low affective group (40–48%). For the most part, students who report that their strategies have not been working successfully plan on modifying their strategies in the future, suggesting they have a desire or motivation to improve and perform better.

Regarding the second research question, the amount of uninterrupted time spent studying chemistry outside of lecture time did not correlate with exam performance and did not appear different among the affective groups. On the other hand, the survey results showed that stronger performance was related to processing information by elaboration and self-questioning or explaining ideas to others.

Triangulation of survey and interview data was necessary to assemble a picture of the learners in this sample of general chemistry students. The results suggest that learning and studying behaviors are different for students who exhibit higher vs. lower sets of affective characteristics, and that those behaviors are linked to better exam performance. These results regarding attitude, motivation, and self-concept complement the work of others, reported in the introduction, which primarily considered student achievement measures. The study strategies survey seems to have provided some insight regarding student learning approaches, but its psychometric characteristics should be more strongly developed and established in future work.

What are the practical implications of the findings from this research? The primary message is that students need assistance in becoming aware that what they do is not so important as what they are thinking while they are doing it. Instructors of chemistry must provide explicit opportunities for students to engage in challenging work that asks them to discuss, explain, and elaborate (Simbo, 1988; Chi et al., 1989), and to work as much as possible without the crutch of having an answer or tutor in front of them. Some students are prepared for this because of their affective profile, and others are not. Of the six affective variables we have considered, test anxiety and self-efficacy seem most accessible as characteristics that could be manipulated. Anxiety about science has been recognized as an issue for students for a long time (Mallow, 1981) and there are approaches that instructors can use to address it, for example, writing about those anxieties (Ramirez and Beilock, 2011). Similarly, self-efficacy is the perception that one is able to accomplish a specific learning task (Zimmerman, 1998). Students need to see pathways and strategies that can lead to more successful outcomes. Peer-Led Team Learning, in which successful students model and guide the learning of other students, may be one approach to achieving this. (Chan and Bauer, 2015).

Acknowledgements

We would like to acknowledge Drs Daniel Pyburn and Cary Kilner for their assistance in coding the student interviews and their feedback.

References

  1. Bauer C. F., (2005), Beyond “Student Attitudes”: chemistry self-concept inventory for assessment of the affective component of student learning, J. Chem. Educ., 82, 1864–1869.
  2. Bauer C. F., (2008), Attitude towards Chemistry: A Semantic Differential Instrument for Assessing Curriculum Impacts, J. Chem. Educ., 85, 1440–1445.
  3. Bloom B. S., (1976), Human Characteristics and School Learning, New York: McGraw-Hill.
  4. Bloom B. S. and Krathwohl D. R., (1956), Taxonomy of educational objectives: the classification of educational goals, handbook I: cognitive domain, New York: Longmans, Green.
  5. Boud D. (1981), Developing student autonomy in learning, 2nd edn, New York: Taylor & Francis.
  6. Brandriet A. R., Ward R. M. and Bretz S. L., (2013), Modeling meaningful learning in chemistry using structural equation modeling, Chem. Educ. Res. Pract., 14, 421–430.
  7. Chan J. Y. K. and Bauer C. F. (2014), Identifying at-risk students in general chemistry via cluster analysis of affective characteristics, J. Chem. Educ., 91, 1417–1425.
  8. Chan J. Y. K. and Bauer C. F., (2015), Effect of Peer-Led Team Learning (PLTL) on student achievement, attitude, and self-concept in college general chemistry in randomized and quasi experimental designs, J. Res. Sci. Teach.52, 319–346.
  9. Chi M. T. H., Bassok M., Lewis M. W., Reimann P., and Glaser R., (1989), Self-explanations: how students study and use examples in learning to solve problems, Cognit. Sci., 13, 145–182.
  10. Cook E., Kennedy E. and McGuire S. Y. (2013), Effect of teaching metacognitive learning strategies on performance in general chemistry courses, J. Chem. Educ., 90, 961–967.
  11. Dickinson D. J. and O'Connell D. Q., (1990), Effect of quality and quantity of study on student grades, J. Educ. Res., 83, 227–231.
  12. Gettinger M. and Seibert J. K., (2002), Contributions of study skills to academic competence, School Psychol. Rev., 31, 350–365.
  13. Glaser B. and Strauss A., (1999), The discovery of grounded theory: strategies for qualitative research, New York: Aldine de Gruyter.
  14. Hadwin A. F. and Winne P. H., (1996), Study strategies have meager support: a review with recommendations for implementation, J. High. Educ., 67, 692–715.
  15. Haertel G. D., Walberg H. J. and Weinstein T., (1983), Psychological models of educational performance: a theoretical synthesis of constructs, Rev. Educ. Res., 53, 75–91.
  16. Hodges R., Simpson M. S. and Stahl N. (ed.), (2012), Teaching study strategies in developmental education, New York: Bedford St. Martin's.
  17. King A., (1992), Comparison of self-questioning, summarizing, and notetaking-review as strategies for learning from lectures, Am. Educ. Res. J., 29, 303–323.
  18. Mallow J. V., (1981), Science Anxiety: Fear of Science and How to Overcome It, New York: Elsevier North Holland.
  19. Pintrich P. R. and De Groot E. V., (1990), Motivational and self-regulated learning components of classroom academic performance, J. Educ. Psychol., 82, 33–40.
  20. Pintrich P. R., Smith D. A. F., Garcia T. and McKeachie W. J., (1991), A manual for the use of the motivated strategies for learning questionnaire (MSLQ). From the National center for research to improve postsecondary teaching and learning project on instructional processes and educational outcomes, Ann Arbor, http://files.eric.ed.gov/fulltext/ED338122.pdf (accessed Feb 15, 2014).
  21. Purdie N. and Hattie J., (1996), Cultural differences in the use of strategies for self-regulated learning, Am. Educ. Res., 33, 845–871.
  22. Ramirez G. and Beilock S. L., (2011), Writing about testing worries boosts exam performance in the classroom, Science, 331(6014), 211–213.
  23. Schuman H., Walsh E., Olsen C. and Etheridge B., (1985), Effort and reward: the assumption that college grades are affected by quantity of study, Soc. Forces, 63, 945–966.
  24. Simbo F. K., (1988), The effects of notetaking approaches on student achievement in secondary school geography, J. Educ. Res., 81, 377–381.
  25. Weinstein C. E. and Palmer D. R., (2002), Learning and study strategies inventory (LASSI): user's manual, 2nd edn, Clearwater, FL: H & H Publishing.
  26. Xu X. and Lewis J. E., (2011), Refinement of a chemistry attitude measure for college students, J. Chem. Educ., 88, 561–568.
  27. Xu X., Villafane S. M. and Lewis J. E., (2013), College students' attitudes toward chemistry, conceptual knowledge and achievement: structural equation model analysis, Chem. Educ. Res. Pract., 14, 188–200.
  28. Zimmerman B. J., (1998), Academic studying and the development of personal skill: a self-regulatory perspective, Educ. Psychol., 33, 73–86.
  29. Zusho A., Pintrich P. R. and Coppola B., (2003), Skill and will: the role of motivation and cognition in the learning of college chemistry, Int. J. Sci. Educ., 25, 1081–1094.

Footnotes

Electronic supplementary information (ESI) available. See DOI: 10.1039/c5rp00205b
Now at Department of Chemistry, Biochemistry, and Physics, University of Tampa, Tampa, USA.

This journal is © The Royal Society of Chemistry 2016
Click here to see how this site uses Cookies. View our privacy policy here.