Caroline Z.
Muteti
a,
Carolina
Zarraga
b,
Brooke I.
Jacob
c,
Tuli M.
Mwarumba
d,
Dorothy B.
Nkhata
a,
Mwarumba
Mwavita
e,
Smita
Mohanty
a and
Jacinta M.
Mutambuki
*a
aDepartment of Chemistry, Oklahoma State University, Stillwater, OK 74078, USA. E-mail: caroline.z.muteti@okstate.edu; dnkhata@okstate.edu; smita.mohanty@okstate.edu; jacinta.mutambuki@okstate.edu
bDepartment of Applied Exercise Science, Oklahoma State University, Stillwater, OK 74078, USA. E-mail: carolina.zarraga@okstate.edu
cDepartment of Integrative Biology, Oklahoma State University, Stillwater, OK 74078, USA. E-mail: brooke.i.jacob@okstate.edu
dDepartment of Biology, Oglethorpe University, Atlanta, GA 30319, USA. E-mail: tulimwarumba@gmail.com
eDepartment of Research, Evaluation, Measurement, and Statistics, Oklahoma State University, Stillwater, OK 74078, USA. E-mail: mwavita@okstate.edu
First published on 2nd October 2020
Many students transitioning from high school to college are faced with challenges of getting acclimated to college life and managing their time and heavy course load that is cognitively demanding. Students planning to major in science, technology, engineering, and mathematics (STEM) programs in the United States are mostly required to enroll in general chemistry courses as prerequisites. Unfortunately, these courses are among the STEM gateway courses in which many first-year students struggle to get through, or are weeded out. This is partly due to the use of ineffective study strategies that require more than rote memorization, a common learning approach in high schools. One way to prepare first-year college students for STEM trajectories is by teaching them metacognitive strategies early in their study programs to enable early adoption and sustainability of metacognition knowledge and metacognition regulation skills as they progress to the advanced courses. While a handful of studies have investigated study strategies among students in the general chemistry courses as well as the impact of metacognitive activities on student performance in chemistry, very few in-depth qualitative studies investigating the influence of explicit teaching of metacognition on students’ study strategies have been reported. Using open-ended questionnaires, this unique study investigated general chemistry students’ study strategies that they employed prior to a 50 minute metacognition lesson; strategies they reported to have gained from the instruction; and the influence of the metacognition instruction on students’ study strategies and performance in the final exam. Findings indicated more reported use of rote memorization over higher-order study strategies prior to the metacognition instruction, but more reported gains on higher-order study strategies and fewer strategies related to rote memorization immediately after the metacognition instruction. Furthermore, 67% reported a positive influence of the metacognition instruction on study strategies, with 7% lower DFs in the final exam compared to those who reported ‘no influence’. Findings revealed that most general chemistry students were unaware of effective study strategies; thus, there is a critical need to explicitly teach students in general chemistry courses metacognitive strategies.
Zhao et al. (2014) conducted a study with general chemistry students in which they completed a structured pre-post survey on study strategies before and after a metacognition intervention (aspects of metacognition and Study Cycle) including applying thinking skills based on Bloom's taxonomy (Bloom, 1976). Findings indicated that to score AB grades in college, most students indicated in the pre-survey that they would use lower-order thinking skills, such as remembering and understanding; however, they switched to higher-order thinking skills (i.e., applying and analyzing) after the metacognition intervention (post-survey). Participants also reported low use of evaluation and creative skills in scoring ABs in college for both surveys (Zhao et al., 2014).
Chan and Bauer (2016) also conducted a study with chemistry undergraduates by administering online surveys to ascertain the relationship between types of study strategies used and course achievement. They found a negative correlation between study strategies focused on memorizing answers or steps to solving problems and achievement. However, there was a positive relationship between achievement and use of study strategies involving peer instruction, as well as the use of self-assessment when studying.
Other studies have reported a limited use of planned study schedules among undergraduate students (Cepeda et al., 2006; Kornell and Bjork, 2007). For instance, Kornell's and Bjork's (2007) study with 472 undergraduate students comprised a structured survey on study habits. Findings showed that students’ study schedules were largely driven by deadlines or crises, such as upcoming midterm exams and quizzes rather than their own decision. When asked how they decided on what to study next, a majority (59%) indicated they made choices based on the most pressing due date or what was overdue, and only 11% indicated they planned their study schedules ahead of time and followed their study schedules. Kornell and Bjork (2007) also found that 80% of undergraduate students’ study strategies were improvised, and not taught to them in a formal manner. Together, these findings allude to the need to teach undergraduate students, including those studying chemistry, metacognition, and effective study strategies. From the few studies reported on metacognition in chemistry education at the college level (Kipnis and Hofstein, 2008; Delvecchio, 2011; Askell-Williams et al., 2012; Cook et al., 2013; Zhao et al., 2014; Casselman and Atwood, 2017), most have focused on assessing student development of metacognitive skills through engagement in learning activities or assessments (e.g., Kipnis and Hofstein, 2008; Delvecchio, 2011; Askell-Williams et al., 2012; Casselman and Atwood, 2017); thus, metacognition is implicitly taught (Arslantas et al., 2018). We define metacognition as a conscious knowledge of what one knows and how they know it.
Development of metacognitive skills is associated with accrued benefits on student outcomes, such as improved conceptual understanding (Rickey and Stacy, 2000; Delvecchio, 2011) and problem-solving abilities (Rickey and Stacy, 2000), improved performance in science (Akyol et al., 2010), and increased self-efficacy in chemistry (Kirbulut, 2014). Nevertheless, research on study strategies and metacognition in general chemistry have mostly focused on quantitative measurements and a few mixed-methods approaches with more weight placed on quantitative components than qualitative (Cook et al., 2013; Zhao et al., 2014; Chan and Bauer, 2016); thus, very few studies focused on in-depth qualitative investigations of study strategies in general chemistry courses have been reported. Additionally, little is known about how general chemistry students’ study strategies might change as a result of metacognition instruction on study strategies. Ultimately, this is important for equipping students with cognition and self-regulation skills (Flavell, 1979; Cook et al., 2013) beneficial for shifting from lower-order thinking to higher-order study strategies (Flavell, 1979; Cook et al., 2013). Unfortunately, Arslantas et al.'s review of metacognition implementation in postsecondary education revealed that seldom metacognition is explicitly taught in undergraduate chemistry courses (Arslantas et al., 2018). Subsequently, the authors called for investigations centered on the effects of explicit instruction in metacognition.
Cook et al. (2013) reported a metacognition model, in which students were taught metacognitive strategies after the first midterm exam, several weeks into the semester, and assessed the effect of the metacognition instruction on students’ performance. One caveat of this model is that students were not provided with opportunities to learn effective study strategies early in the semester. A related study by Zhao et al. (2014) revealed that most students reported more use of lower-order study skills over higher-order study strategies in a general chemistry course at the beginning of the semester; thus, infusing metacognition instruction in general chemistry courses early in the semester can be beneficial especially to students who might not be aware of other study strategies beyond rote memorization. Apparently, there is little evidence on the assessment of the impact of metacognition instruction on students’ study strategies.
This study is one of a kind to report findings on students’ self-reported study strategies, through a qualitative lens, as a result of metacognition instruction. Specifically, we investigated general chemistry students’ study strategies that they reported to have used prior to a metacognition instruction, the new strategies that they learned and have the potential for adoption in the course, and the influence of the instruction on their performance in the cumulative final exam. Through open-ended questionnaires, the authors sought to address the following research questions: (RQ1) What self-reported study strategies and habits do STEM majors in the general chemistry course employ in their courses prior to a metacognition instruction, and what new study strategies that have the potential for adoption do they report to have learned from the metacognition instruction? (RQ2) How does explicit teaching of metacognition influence general chemistry students’ study strategies and performance in the final cumulative exam? Metacognition framework (Flavell, 1979; Lai, 2011) was employed to guide data analyses and interpretations.
Fig. 1 Shows the metacognition framework adopted from Flavell (1979) and Lai (2011). |
Strategy or conditional knowledge involves awareness of existing strategies, how to apply them, and when and why they should be employed (Flavell, 1979; Tanner, 2012; McGuire, 2015; Stanton et al., 2015). According to Stanton et al., students with metacognitive knowledge can distinguish between the concepts they have mastered and ones to study further (Stanton et al., 2015). Metacognition regulation involves planning, monitoring, and evaluating one's learning (Lai, 2011). Therefore, one would expect that students who have metacognitive knowledge know what and how they learn; have the toolkit for effective learning strategies and procedures; and know when and why to use certain strategies. Additionally, students with metacognitive regulation skills know how to plan, or set goals prior to undertaking a task; can monitor their own learning including identifying hindrances to learning and learning boosters; and can evaluate their own learning including assessing the products from a given task (e.g., exam, homework, laboratory experiment, or a learning activity).
For Phase II, students were reminded of the previously taught metacognitive strategies one to two weeks prior to help them prepare for each of the four exams (three midterm exams and a final cumulative exam). The assumption was that with the metacognition instruction administered early in the semester, students will gain effective study strategies and adopt them in preparation for Exam I, after which they can self-reflect and draw study plans in preparation for the Exam II. For Phase III, students were engaged in an intensive reflective activity, metacognition homework 2, after the first two midterm exams, which were scheduled three weeks apart. The reinforced-reflective activity involved asking students to identify the study strategies that worked and did not work for Exam I and Exam II, then developing a plan of study for the remaining two exams. With Exam I and Exam II scheduled quite close to each other, students were able to reflect on study strategies employed in both exams especially when studying for Exam I while learning the content for Exam 2. Students’ responses were reviewed and strategies perceived as either useful or not were discussed during the class by the instructor. Individual meetings were held with individual students, who struggled with various concepts during the instructor's office hours. Subsequently, students were reminded to follow through on their plan of study, derived from the reflective activity, prior to Exam 3 and the Final exam.
Research question (RQ) | Data sources | Data collection timeline and the type of questionnaire | Number of study participants |
---|---|---|---|
RQ1 | Metacognition homework I | Immediately after the metacognition instruction at the beginning of the semester; online open-ended questionnaire (Appendix A) | 259 |
RQ2 | End of semester metacognition survey | At the end of the semester, prior to the cumulative final exam; paper-based questionnaire (Appendix B) | 166 |
Cumulative final exam letter grades | End of semester cumulative final exam scores | 150 |
A more experienced researcher, CZM, independently reviewed the responses against the categories developed and refined by CZ and BIJ. While there was no change in the number and types of categories generated by CZ and BIJ, there were discrepancies on the placement of some responses, which called for rearrangement within the correct categories. The third researcher, CZM, discussed the noted discrepancies and resolved the differences in coding of the participants’ responses with JMM, who has expertise in qualitative research. A total of 13 categories were generated among the coders for RQ1 Part A and 12 categories for Part B (Appendix C). Similar categories were then merged into major categories by CZM and JMM, bringing the final number of major categories for RQ1 Part A to 6 and for RQ1 Part B to 5. The generated major categories and subcategories, and representative participants’ responses for RQ1 Part A and Part B are provided in Appendix D and Appendix E, respectively.
For RQ2, investigating participants’ reported influence of the metacognition lesson on their study strategies, a total of 166 completed the end-of-semester survey (61.5% response rate). Seven of the 166 respondents provided two responses. Therefore, a total of 173 responses were included in the analyses. The survey responses were typed in a word document prior to analyses. The Metacognition framework dimensions and subdimensions previously described were applied in the coding of data while keeping an open mind for emerging codes. Metacognition framework was applied for this question to identify any metacognition-related strategies or skills developed and employed in the course as a result of the metacognition lesson. The coding involved an iterative process to secure coherence in coding. Researchers JMM and CZ together coded about 30% of the responses and identified salient categories related to the metacognition framework. CZ coded the remaining data by applying the identified categories while allowing for new ones to emerge.
A third researcher, BJ, together with CZ reviewed the developed categories against the responses to secure coherence and alignment with the metacognition framework dimensions with merging of similar dimensions applied as needed. The coded data were reviewed by a fourth researcher, CZM, who read through the individual participants’ responses against the categories generated by CZ and BIJ. The intercoder agreement between CZ-BIJ and CZM was over 90%. The final phase involved reviewing the generated categories against the responses by JMM for confirmation audit (Tashakkori et al., 1998) in which 100% agreement was established between JM and CZM. JMM and CZM together discussed the categories and merged similar categories into major categories. These categories were then classified as metacognition knowledge, or metacognition regulation skills. A summary of the metacognitive dimensions, major categories and sub-categories, and representative participants’ responses are presented in the results section. Additional participants’ responses are available in Appendices F and G.
RQ1. What study strategies and habits do STEM majors in the general chemistry Course employ in their learning?
Finding: Participants’ reported study strategies shifted from Lower-order study strategies (LOSSs) to gains in higher-order study strategies (HOSSs). Fig. 2 shows participants’ reported strategies they employed in their courses prior to the metacognition instruction and perceived new strategies learned and have the potential for adoption after the instruction. LOSSs, such as rote memorization strategies—reading and rereading, flashcards and quizlets, and memorization/cramming, and poor planning and procrastination were the most frequently reported among the participants. A few participants reported the use of HOSSs, such as practicing problems, reflective learning, collaborative learning, and self-assessment.
Reported strategies before and after the metacognition instruction shifted from LOSSs to mostly HOSSs and other effective study strategies after the metacognition instruction. Specifically, time management/planning/goal setting was the most frequently reported gain followed by reflective learning, utilization of outside-class resources, collaborative learning, and self-assessment. Rote memorization and practicing problems were less frequently reported after the metacognition instruction, whereas studying with notetaking and utilizing outside-class resources were equally frequently reported. We describe the detailed findings in the subsequent subsections. We begin by presenting the reported study strategies prior to the metacognition instruction followed by reported gains in study strategies as a result of the instruction.
Finding 1: Rote memorization strategies (LOSSs) were the most dominantly employed study strategies reported by the participants prior to the metacognition instruction . Table 2 shows a summary of major categories and subcategories generated from the analyses and selected participants’ responses. 236 out of 633 responses (37.3%) were associated with rote memorization strategies. Of the 236 responses, 56.4% (133 responses) related to reading and rereading notes or textbooks, 32.2% (76 responses) pointed to use of flashcards and quizlets to memorize definitions, terminologies or formulas, and 11.4% (27 responses) were about memorizing or cramming information in preparation for exams or quizzes. Higher-order study strategies (157 out of 633 responses, 24.8%) were second to rote memorization strategies. Of these strategies, 31.2% comprised practicing problems similar to what students expected in the assessments (49 responses); 27.4% were on reflective learning, in which participants reported drawing diagrams and pictures to retrieve information on specific concepts, identifying key points learned in each lecture and areas of struggle, or reflections on knowledge gaps; and self-assessment (27 responses, 17.2%) through self-quizzing on specific concepts.
Major categories (N = responses, %) | Subcategories (N = responses, %) | Selected participants’ responses |
---|---|---|
Rote memorization (lower-order study strategies – LOSS) (N = 236, 37.3%) | Reading and rereading (N = 133, 56.4%) | – I reread the information until I can memorize it without hesitation. |
– What I have found that has worked for me when studying is repetition. | ||
– My current study habits include rereading chapter sections, rereading the sections allow me to look through all of the information again, and to reiterate the concepts that I learned in the pre-reading and lecture. | ||
Flashcards and Quizlets (N = 76, 32.2%) | – Flashcards help me remember definitions or formulas needed on the test. | |
– I mainly use flashcards when I cannot understand specific vocab words and I need to fully understand their definitions. | ||
– Things like quizlets and flashcards work really well for me. | ||
Memorization/cramming (N = 27, 11.4%) | – For one, I try to cram all the subjects that I am studying into one study session and sometimes I get really confused. | |
– Typically, I cram the night before an exam. | ||
– I will cram right before an exam because I get overwhelmed. | ||
Higher-order study strategies (N = 157, 24.8%) | Practicing problems (N = 49, 31.2%) | – I find practice problems from each chapter in the book and redo/practice these problems until their fully learned. |
– I do practice problems and see how well I do and then decide which problems I should work on more. | ||
Reflective learning (N = 43, 27.4%) | – I reflect upon key points from daily lectures and review areas in which I struggle or have misunderstandings. | |
– I draw diagrams and pictures of processes and phenomena. | ||
Collaborative learning (N = 38, 24.2%) | – I study in a group because when I study alone I get easily distracted. | |
– I also always study with other people in the class to further help me understand. | ||
– I also do my best to explain the material I am learning to others that way I can make sure I truly understand the content taught in the lecture. | ||
Self-assessment (N = 27, 17.2%) | – Test my understanding through quizzes over the subject that I find on the internet. | |
– I spend most of my time testing myself and trying different types of problems. | ||
– I quiz myself over my notes and have others quiz me if they are up to it. | ||
Poor planning and procrastination (N = 68, 10.7%) | — | – Procrastination is my biggest problem when it comes to completing work. I always end up waiting until the last minute to complete work, study for tests, and end up cramming the information. |
– I do have a terrible procrastinating habit. I work better under deadlines so when the stress of a deadline is put on me, I get it done. | ||
– I have a habit of waiting until the day before/day of the exam or quiz to begin studying. | ||
Time management and planning (N = 65, 10.3%) | — | – I pre-read lecture material, take detailed notes, and review all material within the same day. |
– I also try my best to read the textbook before class so that I am prepared for lecture. | ||
– My current study habits are to first do all assignments, readings, and other required things in a reasonable time frame. | ||
Studying with notetaking (N = 56, 8.8%) | — | – I read and highlight the book whether it be hard copy or paperback and keep note of the words that are bolded or italicized. |
– While studying I tend to highlight definitions and key concepts that are major materials for upcoming tests and of high importance. | ||
– My current study strategies are to read through the textbook while taking notes. | ||
Utilizing outside-class resources (e.g., videos, office hours, supplemental instruction (ESI) sessions (N = 51, 8.1%)) | — | – If still confused about a concept, I look up educational videos to hear it taught in a different way. |
– When studying/learning new material I find it beneficial to seek out further instruction on the topic from outside sources such as educational videos. | ||
– I try to attend study sessions with TA's or my professor. | ||
– In the case of lower scores, I begin by finding large problem areas and scheduling meetings with my teacher or an ESI leader to review them. | ||
– I tend to get a tutor and go over the material that I am testing over. |
In addition to the study strategies mentioned above, some participants’ reported study habits related to planning to learn or study and the use of resources outside classrooms. Specifically, 10.7% (68 out of 633 responses) responses pointed to poor planning and procrastination in completing assignments or preparing for high stakes assessments, for example, exams. In contrast, about the same percentage of responses (10.3%, 65 responses) were associated with good time management, planning learning, or setting goals. For instance, participants mentioned reviewing lecture material before and/or after each lesson, and developing and following charted schedules to enable completion of tasks within a reasonable timeline (Table 2).
For studying, 8.8% (56 responses) indicated participants took notes while studying (studying with notetaking) rather than mere reading. Some also mentioned highlighting key concepts likely to be assessed in tests while studying. Lastly, a few participants (51 responses, 8.1%) mentioned utilizing resources outside class to facilitate mastery of the material. Mentioned resources included learning videos from the internet, supplemental instruction (ESI†) sessions led by peers on problem-solving in specific disciplines, or help from course instructors and teaching assistants (TAs) during their office hours. Examples of participants’ responses are presented in Table 2 as well as in Appendix D.
Overall, rote memorization strategies were the most dominant study strategies reported among the participants. This finding may suggest that most students in the introductory general chemistry courses employ rote memorization study strategies which might be ineffective for excelling in these courses. Additionally, the use of metacognitive strategies, such as planning for lessons and setting goals, and HOSSs—reflective learning and self-assessment were less popular among participants in this study.
Finding 2: A large number of participants reported new study strategies and adoptable on mostly HOSSs, and good time management and planning/setting goals in the course.
[Reflective learning]: When I am going to start learning about a new topic, I will ask the declarative questions like, “okay, what do I already know about this topic?” [Also] asking myself questions after each lecture hopefully but also definitely after every homework, quiz, and test.
[Collaborative Learning]: I am going to start studying with my friend in my class that understands chemistry well and could help reword things that may or may not be challenging to me.
[Self-Assessment]: I will monitor my progress by self-testing, as well as quizzing myself to check my retention of the information.
[Practicing Problems]: I would like to start studying more practice problems before a test rather than just memorization.
A few adjustments I could make to my current study habits are to not procrastinate on my assignments or studying itself…. Procrastinating on one class or assignment will often times put me behind schedule either for additional assignments or other subjects I should be studying for at that particular time.
I think time management will benefit me the most. I have always struggled with putting assignments off and it ultimately hurts my grade when I am rushing to get assignments turned in.
I should set learning goals for myself to reach so I can stay on the right track.
Other gained strategies with potential for adoption included: utilizing outside-class resources (65 responses, 6.9%), such as attending supplemental instruction (ESI†) sessions and office hours, and using supplemental learning materials including online educational learning videos and simulations; and studying with notetaking (51 responses, 5.4%). Some participants said:
[Utilizing Outside-Class Resources]: … “I need to utilize multiple resources, such as watching videos.” … “I will go to the Professor, or my TA whenever I have questions on the [content] material; this way I will not fall behind and feel overwhelmed before tests.” … “I will actively go to the ESI,† sessions.”
[Studying with Notetaking]: I also want to start taking notes while reading. I tend to only read without taking notes. … I thought that just reading is alright but it does make sense that you do not actually fully get help to only read.
Interestingly, a few participants (43 responses) mentioned they will continue utilizing rote memorization strategies (43 responses, 4.6%) including reading and rereading, using flashcards or quizlets, and memorization or cramming in the course.
[Reading and rereading]: I know re-reading my notes is going to be really important for me to retain the information.
[Flashcards/Quizlets]: Using flashcards has helped me a lot in the past when I did study more… Also using tools such as quizlet really helps me a lot because it is hard for me to stay engaged when I do study.
[Memorization/Cramming]: I could probably find a more effective way to memorize information other than flashcards.
Additional responses are provided in Appendix E. The finding suggests that the metacognition lesson was beneficial in uncovering new study strategies among study participants. Many participants reported they learned higher-order study strategies and would adopt them; rather than rote memorization strategies. Nevertheless, the findings revealed that some participants were resistant to switch from rote memorization (Fig. 2).
(RQ2) How does explicit teaching of metacognition influence general chemistry students’ study strategies and performance in the final cumulative exam?
A Majority of Participants Reported Gains in Metacognition Knowledge and Metacognition Regulation Strategies
Descriptive analyses of participants’ coded responses revealed that 67% (n = 115) of the total respondents (N = 172) reported a positive influence of the metacognition lesson on their study strategies and habits. About 32% of the respondents (n = 55) reported no influence, while 1% (n = 2) were nonresponses. Further descriptive analyses conducted by applying the metacognition framework indicated 69.6% (n = 80 responses) of reported adjusted strategies were attributed to metacognitive knowledge, and 30.4% (n = 35) to metacognitive regulation skills. A summary of reported metacognitive skills and strategies gained is shown in Fig. 3. We articulate specific metacognitive knowledge and regulation skills the participants reported they gained from the metacognition lesson below. Additionally, we provide selected representative participants’ responses to support our claims on the findings. More participants’ responses are available in Appendix F.
Finding 1: Participants’ reported gains in metacognition knowledge—strategy or conditional and declarative knowledge. Metacognition knowledge skills reported by participants related to the following strategy or conditional knowledge, and declarative knowledge. For strategy or conditional knowledge, participants expressed gains in knowledge of effective study strategies (21.7%, n = 25); applying suitable learning strategies (17.4%, n = 20); and adopting a problem-solving approach (5.2%, n = 6). For declarative knowledge, participants reported they developed the ability to identify and address knowledge gaps on chemistry concepts (17.4%, n = 20), and improved understanding of concepts (7.8%, n = 9) due to the metacognition lesson (Fig. 3). We describe these findings in detail below.
“I realized that what I was doing was not working, so I changed it and got better grades.”… “The metacognition lesson taught me new study methods that I otherwise wouldn’t have done.”… “Metacognition lesson showed me what I have been doing wrong and what I chose replaced that bad learning behavior with.”
“It [metacognition] helped me learn to practice concepts instead of memorizing information.”… “It [metacognition] made learning concepts easier and faster because the practicing made concepts ingrained in my head.” …“Using different study tools and reading [studying] with notes helped hard concepts stick.”… “When reading, I take notes and I began studying easier now.”
“Metacognition helped me to realize where I went wrong with studying for a test and change my habits for the next test.”… “It helped me analyze what I already know and what I need to work on.”… “I went over my homework and exams every time to make sure I understand what I originally got wrong.”… “it has helped me determine my strengths and weaknesses in my study habits.”
These participants’ descriptions suggest that metacognition instruction not only increased perceived awareness of effective study strategies, but also enhanced participants’ perceived knowledge of concepts, bolstered their selection of suitable study strategies, and helped them to identify and address their learning gaps.
Finding 2: Participants reported gains in metacognitive regulation skills. As shown in Fig. 3, major metacognitive regulation skills mentioned included: planning—planning, preparing for lessons, or setting goals (18.3%, n = 21); and monitoring—improved thinking about learning (10.4%, n = 12). Two participants (1.7%) also expressed the ability to evaluate or self-reflect on their learning (evaluation skills). The first two major constructs are presented below.
Reported positive influence of the metacognition lesson was associated with lower DFs
Findings also showed that out of 150 participants who completed the end of semester questionnaire and took the final exam, 66% reported a positive influence and 34% no influence of the metacognition lesson on their study strategies. Results from descriptive statistics (Fig. 4) showed that about 51% of participants who reported a positive influence of metacognition scored ABCs compared to 43% who scored the same letter grades but reported ‘no influence’. Additionally, there were fewer DFs for 50% of participants who reported a positive influence of metacognition compared to 57% who reported no influence. This finding suggests that the adoption of metacognitive strategies may lower the DF grades in a course.
Fig. 4 Shows the reported use of metacognition and versus performance, in terms of letter grades, in the cumulative final exam in general chemistry I course. |
Together, these findings suggest that explicit teaching of metacognition can increase students’ awareness and adoption of effective study strategies in the course. Moreover, metacognition instruction may improve performance in a general chemistry course, if the metacognitive strategies are adopted.
These findings are consistent with the literature (Karpicke et al., 2009; Cook et al., 2013; Zhao et al., 2014). For instance, Karpicke et al. found 84% of reported study strategies among undergraduates were focused on reading and rereading, 40% on flashcards, and 19% on memorization/cramming. Zhao et al. (2014) also found that most students in general chemistry courses reported the use of lower-order thinking skills, such as remembering and understanding, and perceived these strategies would lead to AB grades in college. These authors’ findings also indicated limited use of higher-order study strategies, for example, preparing for lessons or setting learning goals and reviewing lecture notes after class (self-reflection on learning). Together, these findings indicate most students in general chemistry courses choose to apply rote memorization strategies and capitalize on LOSSs with hopes of excelling in the courses. One explanation for the dominant use of LOSSs might be due to the lack of explicit teaching of effective study strategies in high school and early in college years.
Immediate assessment of participants’ reported gains on new study strategies likely to be adopted after the metacognition instruction indicated that HOSSs were the most frequently (48.3% responses) reported compared to LOSSs (4.6% of responses). Specifically, there were more responses on gains and likeliness to adopt HOSSs, such as reflective learning, collaborative learning, and self-assessment after the metacognition instruction compared to reported study strategies prior to the instruction (Fig. 2). However, reported gains on practicing problems were fewer after the metacognition lesson. This is not surprising as practicing problem sets might appear apparent to some students due to the nature of STEM courses they pursue; however, many students may be oblivious to the use of this approach in chemistry.
Notably, changes in participants’ responses before and after the metacognition instruction revealed a shift from rote memorization strategies and toward better time management and planning or setting goals after the instruction. During the metacognition instruction, students were taught how to best manage their time outside class by prioritizing tasks based on importance and urgency, such as drawing charts in which they can document tasks as (1) important and urgent, (2) not important but urgent, (3) important but not urgent, and (4) not important and not urgent. Additionally, students were encouraged to utilize google calendars or planners to schedule their daily tasks (e.g., homework and study times in preparation for quizzes or exams). For study times, they were encouraged to identify the time when they are most productive and utilize it for reflective learning to boost retention of the material, and to consider rewarding themselves, such as engaging with their hobbies, only after meeting their set goals. For reflective learning, students were encouraged to reflect on their learning experiences and think about what they learned. Specific strategies that were emphasized to enhance reflections included writing down the most important points they learned from the lessons without consulting their notes, identifying patterns on different concepts and drawing diagrams, such as simple flow charts, to show relationships between concepts (Nilson, 2016).
Interestingly, a few participants mentioned they will adopt rote memorization, even after the metacognition lesson. One explanation might be that such strategies might have previously worked out for these participants; hence, seeing no value in ditching them. Remarkably, current findings indicated a large increase in responses related to reflective learning—reviewing lessons prior to and after classes, a metacognition regulation skill, after the metacognition instruction. That is, 264 more responses to those reported prior to the metacognition instruction.
The current findings contradict the findings reported in Zhao et al.'s study in which general chemistry students in their study reported decreased tendency to plan for and review lessons prior to and after the lectures, respectively, after the metacognition intervention. The current findings suggest that offering metacognition instruction early in the semester can be beneficial in increasing participants’ awareness of new effective study strategies and metacognitive skills they may find valuable or potential for adoption in the course. Ultimately, this may catalyze the adoption of HOSSs over LOSSs especially for students who are not aware of the former. The ineffectiveness of LOSSs, such as rote memorization on performance in general chemistry is well founded (Zhao et al., 2014; Chan and Bauer, 2016). These authors found that students who reported the use of HOSSs performed better than their counterparts who reported the use of LOSSs. For instance, Chan and Bauer found the use of HOSSs, such as peer instruction, collaborative learning, and reflective learning was significantly and positively correlated with performance. Conversely, rote memorization strategies, “memorizing answers or steps to solving problems,” were significantly and negatively correlated with performance (Chan and Bauer, 2016). Often, both quantitative and conceptual problems in a general chemistry course I require students to use strategies than enhance deep understanding and retention of the material; thus, employing rote memorization can be ineffective especially for cognitively demanding chemistry concepts that students face later in the course (Mutambuki et al., 2020).
Findings on the influence of the metacognition instruction on students’ study strategies over the course showed that a majority of the participants reported benefits in enhancing their metacognitive knowledge and metacognitive regulation skills. Not surprisingly, responses on the use of metacognitive knowledge strategies were twice on the reported use of metacognitive regulation skills, with knowledge of effective study strategies (metacognition knowledge) being the most frequently reported benefit of the instruction. Identifying and addressing gaps in knowledge or learning gaps and applying suitable learning strategies (metacognitive knowledge), and planning/preparing for class or setting goals for the course (metacognition regulation) received equal responses and were among the frequently reported benefits. Improved thinking about learning was the second top reported metacognitive regulation skill. Strikingly, only two participants mentioned the impact of the instruction on evaluating their learning. This might be partly due to minimal modeling of this practice by the instructor in the classroom after the instruction. Embedding graded or ungraded assignments in which students can be asked to summarize the important points from the day's lesson then turn in the writeup for feedback should be considered in future metacognitive training to enhance the adoption of this skill. Overall, the large number of positive responses indicates that most students were receptive to learning metacognitive strategies.
A minority of participants reported no influence of the metacognition lesson in adjusting their study strategies (Fig. 3). For students who reported ‘no influence’, this might be partly due to being aware of metacognitive strategies, or delayed activation of the metacognition skills (Flavell, 1979). Interestingly, descriptive statistics on the responses revealed about 8% more ABs and 7% lower DFs for participants who reported positive influence and use of metacognition compared to those who reported ‘no influence’ (Fig. 4). This finding is consistent with findings from other related studies on metacognition training at the college level. For chemistry education studies, Cook et al. (2013) found that attending a 50 minute metacognition lesson increased performance in the general chemistry course by one letter grade. Casselman and Atwood (2017) also found that students performed better in midterm and final exams when engaged in developing study plans and predicting their exam scores compared to their counterparts who did not engage in these tasks. Based on the current metacognition model described herein, Mutambuki et al. (2020) also reported a 10% higher mean score in the final cumulative exam for students exposed to a 50 minute metacognition instruction and active learning combination compared to their counterparts who were subjected to active learning alone in a general chemistry I course, after controlling for ACT math scores. Descriptive statistics further revealed 10% lower DFs in the final cumulative exam, as a result of the metacognition instruction, for the treatment group over the comparison group (Mutambuki et al., 2020).
Similar results have been reported in biology education studies (Stanton et al., 2015; Sebesta and Bray, 2017). These authors’ findings revealed that students who did not employ effective study strategies, or follow their generated plans of study drawn from exam wrappers scored poor grades compared to their counterparts who implemented their study plans or metacognitive strategies (Stanton et al., 2015; Sebesta and Bray, 2017). Specifically, Sebesta and Bray found that a majority of students who reported not to have followed their study plans maintained their low grades (CDFs) or scored a lower letter grade (BCDF) in the subsequent exam, while a majority of those who were adaptive maintained ABs grades or their grade increased to ABCs. In their study, Stanton et al., revealed four categories of students on “metacognitive-regulation continuum, namely: “not engaging”—students unwilling to reflect and adjust approaches to learning; “struggling”—students willing to reflect and adjust but do not know what to do; “emerging”—students who know what to do, but choose not to follow through; and “developing”—students who follow through. Current study participants can be categorized into these groups, except the “struggling” category. In the light of the Stanton et al.'s developed categories, our findings revealed that by the end of the semester, a majority of our participants were in the “developing” category. Furthermore, unlike Karpicke et al.'s study in which they found that students self-tested for the feedback about what they knew and did not; rather than as a means to enhance meaningful learning (Karpicke et al., 2009), current findings indicated that the metacognition instruction was beneficial in helping participants to identify and address their learning gaps when studying.
By and large, current findings indicate explicitly teaching metacognitive strategies to students early in the semester can increase general chemistry students’ awareness of effective study strategies and metacognitive skills, and promote adjustment from ineffective study strategies over time. However, the change might not be instant for many students till they face more cognitively demanding assessments (Mutambuki et al., 2020), which can trigger a shift from LOSSs to HOSSs. Additionally, adoption of metacognitive strategies can improve performance in general chemistry courses (Cook et al., 2013; Casselman and Atwood, 2017; Mutambuki et al., 2020). We, however, note that based on the current study design, is it difficult to assess if the reported adopted study strategies impacted the grades of the higher performing students, or more likely, these students were also “better students” when it comes to adopting metacognitive strategies. In retrospect, it can be argued that students who would benefit most from the metacognition intervention are those who did not see the value in learning the metacognitive strategies, that is, the lower performing students. Further research is needed to address this issue.
Findings from the end of semester questionnaire revealed that the metacognition instruction positively influenced participants’ study strategies, particularly in adopting metacognitive knowledge strategies and regulation skills. Top benefits reported included knowledge of effective study strategies, identifying and addressing learning gaps, applying suitable learning strategies—metacognitive knowledge strategies, and planning/setting goals or preparing for class, and improved thinking about learning—metacognitive regulation skills. The least reported impacts of the instruction on metacognitive knowledge strategies were improved thinking about learning and improved problem-solving approach, and reinforced self-reflection on learning—metacognitive regulation skill. Consequently, many students who reported a positive influence of the metacognition lesson scored more ABs and fewer DFs in the cumulative final exam compared to those who reported “no influence”.
Importantly, the scarce studies on metacognition instruction and models reveal the critical need for more tested metacognition instruction models to advance this research area. Future research studies can compare different models with different spaced-assessment activities for reflections and assess the impacts on students’ adoption of metacognitive strategies, and on performance. One such model could be teaching metacognitive strategies at the beginning of a course, then asking students to reflect on their study strategies before and after each exam; write the strategies that worked and did not work for an individual assessment; and develop a plan of study to prepare for subsequent assessments. Ultimately, findings from different models can inform future adoption and implementation of effective metacognition instruction in chemistry and other STEM courses.
Moreover, while qualitative methodologies provide rich opportunities for describing a phenomenon, self-reported data may not necessarily reflect the actual experiences or practices employed by the participants. For example, participants might underestimate or overestimate their study strategies—Dunning-Kruger effect (Kruger and Dunning, 1999); thus, generating inaccurate results. Future studies should therefore utilize data triangulation, such as open-ended surveys, interviews, and structured surveys to secure the credibility of self-reported data (Creswell and Poth, 2016).
Footnote |
† Electronic supplementary information (ESI) available. See DOI: 10.1039/d0rp00217h |
This journal is © The Royal Society of Chemistry 2021 |