The evolution of an assignment: how a Writing-to-Learn assignment's design shapes organic chemistry students’ elaborations on reaction mechanisms

Ina Zaimi , Amber J. Dood and Ginger V. Shultz *
Department of Chemistry, University of Michigan, Ann Arbor, Michigan 48109, USA. E-mail: gshultz@umich.edu

Received 26th July 2023 , Accepted 26th October 2023

First published on 8th November 2023


Abstract

Asking students to explain why phenomena occur at a molecular level is vital to increasing their understanding of chemistry concepts. One way to elicit students’ mechanistic reasoning and guide construction of knowledge is through Writing-to-Learn (WTL), which is a promising approach for students in organic chemistry courses. In the design of WTL assignments, rhetorical aspects provide an authentic context by designating a role, genre, and audience for students. This context can support students’ learning, but, if the rhetorical aspects misalign with the learning objectives of the assignment, they can hinder students’ ability to achieve these objectives. In this project, we designed a WTL assignment about a base-free Wittig reaction, which we implemented in an organic chemistry laboratory course. Here, we explore how changes in the rhetorical aspects of this assignment can influence the way students explain two different comparisons of reaction mechanisms. We consider how students use explicit and implicit properties and how the use of these features compares within the context of the reaction. Results indicate that, when the rhetorical aspects align with the learning objectives of the assignment, students provide more productive elaborations that use both explicit and implicit properties. This is supported by both the analysis of students’ writing and students’ feedback about the assignments.


Introduction

Learning organic chemistry reactions – including but not limited to drawing reaction mechanisms and describing what they are as well as explaining how and why they happen (i.e., reasoning) – is challenging. However, reasoning is broadly a scientific practice (Russ et al., 2008) and specifically a disciplinary practice (Goodwin, 2003). Therefore, an objective of organic chemistry education research is and organic chemistry instruction should be supporting organic chemistry students’ reasoning (Graulich, 2015; Dood and Watts, 2022, 2023).

Reasoning in organic chemistry

Organic chemistry students can draw reaction mechanisms and describe what they represent, although their descriptions tend to be memorized (Graulich, 2015; Dood and Watts, 2022, 2023). Students can also explain how they happen, or they can explain why they happen (Graulich, 2015; Dood and Watts, 2022, 2023). Explanations that include how and why reactions happen are part of reasoning about organic reaction mechanisms. Mechanistic reasoning can be broadly defined as an explanation of how reaction mechanisms happen at the electronic level, or at “a lower level” than the observed phenomena does (Russ et al., 2008; Yan and Talanquer, 2015; Cooper et al., 2016; Crandell et al., 2018; Bodé et al., 2019; Crandell et al., 2020; Dood and Watts, 2022). Instead of describing the molecular transformation, mechanistic reasoning incorporates the electronic transformation with structural entities, such as electrons, atoms, and chemical bonds. Mechanistic reasoning can be used in combination with causal reasoning (Graulich, 2015; Dood and Watts, 2022, 2023). Causal reasoning can be broadly defined as an explanation of why reaction mechanisms happen at the molecular level (Russ et al., 2008; Yan and Talanquer, 2015; Cooper et al., 2016; Crandell et al., 2018; Bodé et al., 2019; Crandell et al., 2020; Dood and Watts, 2022) with explicit properties, such as charges, and implicit properties, such as electrophilicity, nucleophilicity, and leaving group ability. Mechanistic reasoning and causal reasoning can be combined into causal mechanistic reasoning (Graulich, 2015; Dood and Watts, 2022, 2023). Throughout this study, we cite these definitions.

It has been reported in several contexts that students can draw mechanistic arrows and describe how reaction mechanisms happen, but not explain the concepts behind the mechanistic arrows (Graulich, 2015; Dood and Watts, 2022, 2023). While students are consistently tasked to draw and describe reaction mechanisms, they are not always required to explain them or provide underlying reasoning for how and why the reaction mechanisms happen. Research recommends using writing to support students in practicing their mechanistic reasoning and their causal reasoning and, thus, in constructing a deep understanding of organic chemistry reactions (Dood and Watts, 2022, 2023; Finkenstaedt-Quinn et al., 2023).

Researchers have examined a variety of tasks designed to engage students in aspects of reasoning. They designed and studied short-response writing tasks and constructed-response questions (Cooper et al., 2016; Crandell et al., 2018; Dood et al., 2018; Dood et al., 2019; Crandell et al., 2020; Dood et al., 2020a, 2020b; Yik et al., 2021). For example, Cooper et al. (2016) designed a writing task on acid–base reactions where students drew the reaction mechanisms and were asked “how” and “why” the reaction mechanisms happen. Cooper et al. (2016) determined that students provided more elaborated, more detailed explanations when they asked students the questions separately, rather than jointly. Subsequent research has elicited students’ reasoning by using these types of constructed-response questions (Crandell et al., 2018, Dood et al., 2018, Dood et al., 2019; Crandell et al., 2020; Dood et al., 2020a, 2020b; Yik et al., 2021).

Additionally, researchers recommended using case-comparison questions (Graulich and Schween, 2018; Caspari and Graulich, 2019; Graulich et al., 2019; Graulich and Caspari, 2020; Rodemer et al., 2020; Watts et al., 2021). For example, Graulich et al. (2019) designed a writing task on substitution reactions where students selected two molecules with similar reactivities out of three molecules. While Graulich et al. (2019) did not analyse for mechanistic explanations and causal explanations, they did analyse for explicit properties and implicit properties, which compose causal explanations. In comparison to students who identified explicit properties, students who identified implicit properties tended to select the correct two molecules (Graulich et al., 2019). Prior and subsequent research has elicited students’ reasoning by using these case-comparison questions (Graulich and Schween, 2018; Caspari and Graulich, 2019; Graulich and Caspari, 2020; Rodemer et al., 2020; Watts et al., 2021).

Alternatively, researchers have designed long-response writing assignments, and they have recommended using Writing-to-Learn (WTL) assignments (Schmidt-Mccormack et al., 2019; Watts et al., 2020; Brandfonbrener et al., 2021). Research has shown that WTL assignments support students’ understanding, specifically their understanding of acids and bases (Schmidt-Mccormack et al., 2019), their understanding of nucleophiles and electrophiles (Watts et al., 2020), and their understanding of resonance structures (Brandfonbrener et al., 2021). Moreover, research has suggested that WTL assignments support students’ reasoning about reaction mechanisms (Watts et al., 2020). For example, Watts et al. (2020) designed a WTL assignment on acid–base reactions where students explained reaction mechanisms. While Watts et al. (2020) did not analyse for mechanistic explanations and causal explanations, they did analyse for entities, which compose mechanistic explanations, and properties, which compose causal explanations. All students identified entities, and most students identified properties (Watts et al., 2020). This finding suggests that subsequent research is required to explore how WTL assignments elicit students’ reasoning.

Writing-to-Learn assignments elicit student explanations of organic chemistry reactions

Learning organic chemistry is challenging, and writing supports students’ reasoning. However, students may lack motivation because the content may lack relevance (Gilbert, 2006; Stuckey et al., 2013). Increasing relevance by contextualizing the content leads to increasing motivation (Ültay and Çalık, 2012). Studies have shown that “effective” WTL assignments are those that contextualize the content and provide rhetorical aspects (i.e., genre, role, and audience) (Rivard, 1994; Bangert-Drowns et al., 2004; Anderson et al., 2015; Gere et al., 2018, 2019; Finkenstaedt-Quinn et al., 2021a, 2023). Students have perceived these rhetorical aspects to be relevant (Petterson et al., 2021), and, because meaningful learning requires relevance (Bretz, 2001), students have perceived these WTL assignments to be meaningful learning experiences (Gupte et al., 2021). Thus, WTL assignments might motivate students’ reasoning, or, minimally, writing more elaborated, more detailed explanations.

Inclusion of rhetorical aspects in a WTL assignment is well documented as a best practice (Rivard, 1994; Bangert-Drowns et al., 2004; Anderson et al., 2015; Gere et al., 2018, 2019; Finkenstaedt-Quinn et al., 2021a, 2023). WTL assignments provide a specified audience because this elicits explanations based on assumptions students hold about the audience (Hand et al., 2004; Chen, 2013; Chen et al., 2016). However, students are still cognizant of the instructor and may address the instructor in their writing as well as the specified audience. For example, Gere et al. (2018) found that students’ explanations changed if students addressed the audience more than the instructor, if students addressed the instructor more than the audience, or if the students balanced between audiences. Sometimes, the audience (e.g., a statistical consultant) and the instructor had shared knowledge, and this encouraged students’ explanations (Gere et al., 2018). Other times, the audience (e.g., students’ grandparents) and the instructor had unshared knowledge, and this constrained students’ explanations (Gere et al., 2018). Gupte et al. (2021) echoed this finding. These findings suggest that subsequent research is required to explore how WTL assignments’ rhetorical aspects shape students’ reasoning. Therefore, in response, this study explores not only how a WTL assignment elicits students’ reasoning but also how its rhetorical aspects shape students’ reasoning.

Succinctly, we designed the Wittig WTL assignment where students explained a traditional intermolecular Wittig reaction mechanism, explained a modified intramolecular Wittig reaction mechanism (Schirmer et al., 2015; Grandane et al., 2019), and compared them. We redesigned the writing assignment, keeping its learning objective but changing its rhetorical aspects. Herein, we explore how students' writing changed when the writing assignment's rhetorical aspects changed.

Theoretical framework

Flower and Hayes's (1981) “A Cognitive Process Theory of Writing” defines writing cognitively for the writing process and socially for the writing assignment and response.

Cognitively, this theory defines the writing process as a recursive, cyclic process (Fig. 1) (Emig, 1971, 1977; Hayes and Flower, 1980; Flower and Hayes, 1981, 1984). First, students plan. Second, students write, or transform internal representations of knowledge (i.e., thinking) into external representations of knowledge (i.e., writing). As delineated by this theory, students’ writing captures their thinking, and, specifically, organic chemistry students’ writing captures their reasoning, as demonstrated by Watts et al. (2020). Third, students review, which moves them on or moves them into planning and writing. This theory informed the implementation of the Wittig WTL assignment, where students planned and wrote first drafts, provided and received peer reviews, and reviewed and wrote final drafts. Consequently, this theory informed our collection of students’ final drafts. Students decided to include – or not to include – concepts from their first drafts to their final drafts in the peer-review process. Watts et al. (2020) asserted that students’ final drafts “best captures the features they found important to include.” Therefore, students’ final drafts should capture more complete reasoning than their first drafts would.


image file: d3rp00197k-f1.tif
Fig. 1 The cognitive process theory of writing. A writing response and students’ writing process (the dark grey arrows) are in response to a writing assignment and students’ motivations (the light grey circle).

Socially, this theory defines a writing assignment as a “rhetorical problem” with its learning objectives and its rhetorical aspects (i.e., genre, audience, and role) and a writing response as a “rhetorical solution” (Fig. 1) (Hayes and Flower, 1980; Flower and Hayes, 1981, 1984). Hayes (1996) proposed that students’ motivations mediate between the two. Accordingly, students plan, write, and review in response to the writing assignment's learning objectives (e.g., Should I include this concept?), the writing assignment's rhetorical aspects (e.g., Does my audience know this concept? Should I explain this concept?), and their motivations (e.g., Do I want to include this concept? Do I want to explain this concept?). This theory informed our design of the Wittig WTL assignment and our redesigns of its rhetorical aspects, intending to align problem and solution. Therefore, one assignment's rhetorical aspects should shape more complete reasoning than another assignment's rhetorical aspects would, if the assignment addresses the problem or if students’ motivation does.

Finally, this theory informed our assessment of the Wittig WTL assignment. We assessed an “effective” assignment as one that effectively aligned the problem, determined by the assignment's learning objective and rhetorical aspects, and the solution, demonstrated by students’ final drafts.

Analytical framework

The Wittig WTL assignment targeted implicit properties (i.e. “Students will explain the mechanism's changes by connecting its explicit structures to their implicit properties”) because reasoning depends on decoding implicit properties. Considering the assignment's learning objective, we were interested in characterizing one of the first steps in students’ reasoning, as Graulich et al. (2019) were. We were not interested in characterizing all of the steps in students’ reasoning. Thus, we adopted and applied Graulich et al.'s (2019) four-code rubric.

Adopting the codes required exemplifying them in regard to the context, the base-free Wittig reaction. Graulich et al. (2019) presented two explicit codes: the explicit-descriptive code and the explicit-functional code. We exemplified the explicit-descriptive code, where students stated explicit structures (e.g., an ester group) and explicit properties (e.g., a negative charge) (Table 1). Additionally, we exemplified the explicit-functional code, where students placed explicit structures and explicit properties within a context (e.g., the base-free Wittig reaction) and provided them with a function (e.g., acting as a base) (Table 1). Graulich et al. (2019) also presented two implicit codes: the implicit-descriptive code and the implicit-functional code. We exemplified the implicit-descriptive code, where students stated implicit properties (e.g., resonance effects) (Table 1). Additionally, we exemplified the implicit-functional code, where students placed implicit properties within a context (e.g., the base-free Wittig reaction) and provided them with a function (e.g., acting as a base) (Table 1).

Table 1 The codes for the Wittig Writing-to-Learn responses. The Wittig WTL responses were coded as explicit descriptive (top row), explicit functional (top middle row), implicit descriptive (bottom middle row), and implicit functional (bottom row)
Code Graulich et al.'s (2019) definition Our definition Examples
Explicit descriptive The student states an explicit property of the molecules. The student states an explicit structure (e.g., the hydrogen atom, the oxygen atom, the alkene group, the ester group, a resonance structure or a resonance contributor, and a conjugated structure), or the student states an explicit property (e.g., an electron source, an electron sink, the charge of an atom, the symmetry of a group, the acidity of a molecule, the basicity of a molecule, or the stability of a molecule). “The starting materials are different by having a ketone [in Scheme 1] and an ester [in Scheme 2].”
“Acrylate [in Scheme 3] has one CO 2 Et, compared to the two [CO 2 Ets] that maleate [in Scheme 2] has.”
Explicit functional The student states the role of the entity in the problem context, or the student states an explicit property and the problem context. The student states an explicit structure or an explicit property, and the student provides the explicit structure or the explicit property with a role (e.g., acting as an electrophile, acting as a nucleophile, causing stability, increasing favourability, or increasing likelihood) within the base-free Wittig reaction. “[In Scheme 2], an external base is not required, and the deprotonation occurs intramolecularly.”
“[In Scheme 3], this is not possible because the [acrylate] does not have carbon–oxygen double-bonds to push electrons to.”
Implicit descriptive The student states an implicit property of the molecules, or the student adds an implicit property to an explicit-functional elaboration. The student states an implicit property (e.g., the size of an atom, the electronegativity of an atom, the dipole of a bond, the partial charges from the dipole of a bond, the delocalization of electrons in resonance, the conjugation of electrons in resonance, the resonance effects of a group, the induction effects of a group, the electrophilicity of a molecule, the nucleophilicity of a molecule, the acidity of a molecule, the basicity of a molecule, the pKa of a molecule, or the stability of a molecule), or the student adds an implicit property to an explicit-functional elaboration. “[In Scheme 2], these features include resonance and the presence of electron withdrawing groups.”
“[In Scheme 3], acrylate does not have this resonance stabilization since it only has one carbonyl group [instead of two carbonyl groups that malate has].”
Implicit functional The student states an implicit property and refers to its role in the problem context. The student states an implicit property, and the student provides the implicit property with a role (e.g., acting as an electrophile, acting as a nucleophile, causing stability, increasing favourability, or increasing likelihood) within the base-free Wittig reaction. “[Maleate's] ester groups stabilize the negative charge by resonance; [the deprotonation] is favourable, however unstable the carbanion is.”
“This is because […] both esters in maleate are used to stabilize the ylide, [but the] acrylate does not have an additional [ester] group to provide resonance stabilization, so the base-free reaction could not proceed for acrylate.”


Applying the codes required differentiating explicit properties from implicit properties in regard to the content, or the depth of students’ statements. Acidity, basicity, and stability are implicit properties, and we found that students could state them as implicit properties. For example, a student stated, “The acidity is due to the ester group drawing electron density away from the carbon […].” Here, acidity was based on the implicit property of induction effects. We read acidity as an implicit property; therefore, we coded the statement as an implicit-descriptive elaboration. However, we found that students could state them as explicit properties. For example, a student stated, “The [hydrogens] contained in the double bond [of malate] are much more acidic than [the hydrogens] contained in the double bond of acrylate.” Here, acidity was based on the explicit structure of hydrogen, neither based on the explicit property of charge nor based on the implicit properties of pKa, electronegativity, induction effects, or resonance effects. We read acidity as an explicit property; therefore, we coded the statement as an explicit-descriptive elaboration. We had to code the depth of students’ statements, although students could have had deeper knowledge and acidity is an implicit property.

Notably, Graulich et al. (2019) defined the codes by the depth of students’ statements, not by the correctness of them. Implicit statements do support correct statements (Graulich et al., 2019); however, an implicit statement can be either a correct or an incorrect statement, and it is not necessarily more correct than an explicit statement is. Therefore, through our analysis, we captured the elicitation of students’ elaborations in contrast to the correctness of their elaborations in order to assess our Wittig WTL assignment.

Research questions

1. How does the Wittig WTL assignment's rhetorical aspects elicit second-semester organic chemistry students’ elaborations?

2. How do second-semester organic chemistry students’ elaborations change when the Wittig WTL assignment's rhetorical aspects change?

Methods

Our study was situated in a large-enrolment, second-semester organic chemistry laboratory course at the University of Michigan. The course was composed of a four-hour, once-a-week laboratory that was facilitated by graduate teaching assistants (GTAs) and a one-hour, once-a-week lecture that was taught by faculty. The design of this course was guided by the theme of “reasoning,” and reasoning was defined and implemented in a few requirements. In-lab requirements included lab work, lab notebooks, case-comparison activities, and quizzes. These case-comparison activities targeted the reasoning in multivariable reasoning (Alfieri et al., 2013; Graulich and Schween, 2018; Caspari and Graulich, 2019; Graulich and Caspari, 2020; Watts et al., 2021). Out-of-lab requirements included lab write-ups and WTL assignments (Gupte et al., 2021), recurringly including the Wittig WTL assignment. These lab write-ups targeted the reasoning in argumentation (Erduran et al., 2004; Cruz-Ramí Rez De Arellano and Towns, 2014), and these WTL assignments targeted the reasoning in causal mechanistic reasoning (Graulich, 2015; Dood and Watts, 2022, 2023). WTL assignments were facilitated and graded by undergraduate teaching assistants (UTAs), or “MWrite Writing Fellows” (Finkenstaedt-Quinn et al., 2021a). Otherwise, assignments were graded by GTAs.

Implementing the Wittig Writing-to-Learn assignment

The assignment spanned two weeks. Using the assignment's directions and questions (Appendix 1), students planned and wrote first drafts in one week. The assignments were submitted onto Canvas, a course management system. Using the peer review's directions and questions (Appendix 2), students reviewed three peers’ first drafts and received at least three but at most five peer reviews in three days. The peer review process was a double-blind process that was facilitated by an automated peer review tool (Finkenstaedt-Quinn et al., 2021a) and integrated into Canvas. UTAs assigned first drafts and peer reviews completion-based grades. Using the peer review's directions and questions (Appendix 2) as well as the rubric (Appendix 3), students reviewed their first drafts and wrote final drafts in four days. UTAs assigned final drafts rubric-based grades. After we implemented the assignment, we administered a survey. The surveys were submitted onto Qualtrics, a survey management system. The surveys were optional, so UTAs did not grade them.

Designing the Wittig Writing-to-Learn assignment

Succinctly, we designed, redesigned, and implemented five assignments. Throughout the implementation, we kept the assignment's learning objective (Fig. 2). Scheme 1 was an intermolecular Wittig reaction, but Scheme 2 was an intramolecular Wittig reaction (Schirmer et al., 2015; Grandane et al., 2019). Exploring this, the assignment directed students to propose a reaction mechanism for Scheme 2 (Question 1) and to “compare the mechanistic steps in Scheme 2 to those in Scheme 1” (Question 2) (Appendix 1). The comparison was basicity – either an intermolecular deprotonation or a conjugate addition followed by an intramolecular deprotonation. Moreover, Scheme 2 was a successful intramolecular Wittig reaction, but Scheme 3 was an unsuccessful intramolecular Wittig reaction (Schirmer et al., 2015; Grandane et al., 2019). Exploring this, the assignment directed students to “compare the mechanistic steps in Scheme 2 to those in Scheme 3” (Question 3) (Appendix 1). The comparison was acidity – either a stabilized maleate or an unstabilized acrylate. Throughout the implementation, however, we changed the assignment's rhetorical aspects (Table 2). The five assignments were: the 2018 Essay; the 2018 Feature Article; the 2019 Cover Letter; the 2020 Grant Proposal, and the 2021 Grant Proposal.
image file: d3rp00197k-f2.tif
Fig. 2 The Wittig Writing-to-Learn assignment. Scheme 1 was an intermolecular Wittig reaction. Scheme 2 was a successful intramolecular Wittig reaction, but Scheme 3 was an unsuccessful intramolecular Wittig reaction.
Table 2 The Wittig Writing-to-Learn assignment's rhetorical aspects. In 2018, one section was assigned the 2018 essay – the assignment without rhetorical aspects – and two sections were assigned the 2018 feature article – the assignment with rhetorical aspects. In 2021, the three sections choose either the 2021 medicinal grant proposal or the 2021 ecological grant proposal
Year Number of sections (N = 3) Genre Role Audience
2018 1 An essay for a laboratory course A student in a laboratory course An instructor of a laboratory course
2 A feature article for C&EN A reporter for C&EN Readers of C&EN
2019 3 A cover letter for DowDuPont An industrial chemist for DowDuPont Management at DowDuPont
2020 3 A section of a grant proposal for NIH A synthetic chemist in a medicinal research group Reviewers at NIH
2021 3 A section of a grant proposal for NIH A synthetic chemist in a medicinal research group Reviewers at NIH
A synthetic chemist in an ecological research group


Specifically, a team of faculty (GVS), postdoctoral scholars (e.g., AJD), graduate research assistants (e.g., IZ), and undergraduate research assistants designed and redesigned five assignments. These changes were based on the Cognitive Process Theory of Writing (Hayes and Flower, 1980; Flower and Hayes, 1981, 1984; Hayes, 1996), the WTL research (Gupte et al., 2021; Petterson et al., 2021), and reflections from research (i.e., the data analysis and our memos) throughout design and from practice (i.e., our conversations with students and UTAs and UTAs’ notes) throughout implementation. Yearly, we have considered how vocational interests motivate students (Stuckey et al., 2013) and how students’ motivations elicit their responses (Hayes, 1996). For example, in 2020, we discussed relevance, and we situated the assignment's rhetorical aspects in pre-health students’ vocational interests. Therefore, the 2020 Grant Proposal role was a synthetic chemist in a medicinal research group (Table 2). However, Petterson et al. (2021) reported that students felt that the assignment's rhetorical aspects, including the Wittig WTL assignment's, were too situated in pre-health students’ interests. In 2021, we discussed agency, and changed the assignment's rhetorical aspects. Therefore, the 2021 Grant Proposal role was a synthetic chemist in either a medicinal research group or an ecological group. This shifted the focus from instructor-assumed relevancy to student-determined relevancy. We recognize that the assignment's role is a small choice, but we believe that an assignment's design is a series of small choices with a big effect on teaching, learning, and, importantly and specifically, eliciting students’ responses.

Designing the Wittig Writing-to-Learn survey

The survey presented students a series of short-response questions. “What did you find challenging?” and other questions solicited students’ feedback on the assignment's design. Contrastingly, “What did you find unclear?” and other questions solicited students’ feedback on the assignment's requirements, the assignment's directions, the peer review's directions, and the rubric.

Data collection

We obtained the Institutional Review Board's approval. We obtained students’ consent and anonymized their responses to the assignment and the survey.

We collected final drafts, and, hereafter, “final drafts” and “responses” are synonymous. Although we collected all responses, we found that a random subset of the responses reached saturation. We considered saturation to be when we could present representative, descriptive results but also when we could pull significant conclusions from those results. Therefore, we collected the 2018 Essay responses (n = 100; N = 471), the 2018 Feature Article responses (n = 100, N = 215), the 2019 Cover Letter responses (n = 100; N = 735), the 2020 Grant Proposal responses (n = 100; N = 714), and the 2021 Grant Proposal responses (n = 100; N = 788) via Canvas. We collected the 2018 surveys (N = 147), the 2019 surveys (N = 237), and the 2020 surveys (N = 83) via Qualtrics. No survey was administered in 2021.

Data analysis

Deductively coding the Wittig Writing-to-Learn responses. Two researchers (IZ and AJD) coded the responses (N = 500) via Google Documents. Separately, we coded a subset of the responses (n = 25; N = 500) (κ = 0.8059). Jointly, we adopted the codes, re-coded the subset of the responses, and negotiated consensus (Table 1). Because Cohen's kappa (κ = 0.8059) indicated strong agreement (Cohen, 1960; Watts and Finkenstaedt-Quinn, 2021), one researcher (IZ) coded half of the responses (n = 237; N = 500), and another researcher (AJD) coded half of the responses (n = 238; N = 500).

Our analysis produced two sets of five distributions of four codes. To determine if the distributions of the codes changed when the assignments changed, we conducted a Pearson's chi-square test for homogeneity (McHugh, 2013) via StataSE 17.0. We infrequently applied the explicit-descriptive code, so we removed it, and we only evaluated the explicit-functional, implicit-descriptive, and implicit-functional codes. To determine which distributions of the codes changed, we separated the data by comparison (i.e., the comparison between Schemes 1 and 2 and the comparison between Schemes 2 and 3) and conducted Bonferroni pairwise comparisons for each pair of the assignments (Haynes, 2013). We used an adjusted alpha value (α = 0.005) to account for multiple comparisons (Haynes, 2013).

Inductively coding the Wittig Writing-to-Learn surveys. Coding the responses emphasized how students’ elaborations changed, but coding the surveys emphasized why students’ elaborations changed, with respect to the assignment's rhetorical aspects (i.e., genre, audience, and role). Two researchers (IZ and AJD) coded the surveys (N = 970) via Google Sheets. One researcher (IZ) coded half of the surveys (n = 485; N = 970), and another researcher (AJD) coded half of the surveys (n = 485; N = 970). Separately, we generated codes, capturing these rhetorical aspects. Jointly, we compared and consolidated codes, re-coded all of the surveys, and negotiated consensus. Lastly, we constructed themes, capturing alignment. The Cognitive Process Theory of Writing (Hayes and Flower, 1980; Flower and Hayes, 1981, 1984; Hayes, 1996) posits that the assignment, with its learning objective and its rhetorical aspects, is a “rhetorical problem” but that the response can be a “rhetorical solution.” Some students mentioned dissatisfaction in solving, so the first theme captured this misalignment between the rhetorical aspects and the learning requirements (Table 3). However, some students mentioned satisfaction in solving, so the second theme captured this alignment between the rhetorical aspects and the learning requirements (Table 3). Moreover, some students mentioned engagement in solving, and Hayes (1996) proposed that motivation can be a mediator between a problem and a solution, so the third theme captured this mediation (Table 3).
Table 3 The themes for the Wittig Writing-to-Learn surveys. The Wittig Writing-to-Learn surveys were sorted as rhetorical aspects misaligning with learning requirements (top row), rhetorical aspects aligning with learning requirements (middle row), or rhetorical aspects engaging students (bottom row)
Theme Definition Examples
Rhetorical aspects misaligning with learning requirements The assignment's rhetorical aspects misalign with its learning requirements, which hinders students’ depth of the elaboration. The students focus on writing the response rather than on explaining the assignment's learning objective. “It was unclear – the [audience's] knowledge […] of organic chemistry. It was stated that they knew some but not all, and it was hard finding that in between point.”
“I [found] it difficult to describe chemistry terminology in a way that is simple but also accurate for the target audience.”
Rhetorical aspects aligning with learning requirements The assignment's rhetorical aspects align with its learning requirements, which helps students’ depth of the elaboration. The students focus on explaining the assignment's learning objective rather than on writing the response. “I liked that [the genre] challenged me to explain this to [the audience] very clearly, but without […] the technical words that I want to use.”
“It was pretty cool writing a hypothetical grant proposal. […] I also liked that [the prompt's genre] allowed me to dig deeper about the implications of this reaction.”
Rhetorical aspects engaging students The assignment's rhetorical aspects engaged the students, which helps students’ depth of the elaboration. The students connect the assignment's learning objective to their laboratory course, their lecture course, or their out-of-class experiences. “I liked how [the genre] allowed us to put the experiment that we used in the lab into a different situation and perspective.”
“I liked how a lot of the information could be found by reading scientific journals, as [the role] made me practice analysing academic literature.”


Limitations

We acknowledge that we were educators, designing and implementing the Wittig WTL assignment, while we were researchers, collecting and analysing students’ responses. We rewrote the assignment's rhetorical aspects, and, simultaneously, we revised its questions. These revisions affected the assignment's transparency. We believe transparency builds an equitable learning experience (Winkelmes et al., 2015, 2016); therefore, we were obliged as educators to make these revisions.

An example of these revisions is the 2020 Grant Proposal, which required two pages and recommended that students “write organized and logical paragraphs” and “use clear and concise language.” With this assignment, we noticed that the students’ responses were longer than the assignment's two-page requirement, and UTAs repeatedly reported that the students’ responses were redundant, neither “organized and logical” nor “clear and concise.” We interpreted that the assignment's learning objective (i.e., “Students will explain the mechanism's changes by connecting its explicit structures to their implicit properties”) and its questions were misaligned. Thus, students were writing more than they should, oftentimes writing what we wanted them to but sometimes not. In 2021, we pared and revised the questions, where we provided broad directions (e.g., Compare the mechanistic steps in Scheme 2 to those in Scheme 1”), provided specific directions and questions (e.g., “What step allows for the formation of the ylide without the use of an external base?” and “Explain the structural features and electronic, chemical properties that are present or absent in this step”), and defined the vocabulary (e.g., “Structural features are atoms or functional groups”) (Appendix 1). Potentially, these transparent questions directed students’ responses from superfluous information to explicit and implicit elaborations.

Consequently, these revisions limit our claims. However, we revised how we asked the questions, not the focus of questions themselves or the assignment's learning objective. We found that students’ elaborations changed when the assignment's rhetorical aspects changed. Students’ surveys and prior research corroborated this influence (Gupte et al., 2021; Petterson et al., 2021). While we cannot claim that the rhetorical aspects were the sole influence, we interpret that the rhetorical aspects were a meaningful influence and that appropriate rhetorical aspects in combination with transparent questions are likely a more meaningful influence.

Additionally, we acknowledge that we implemented this assignment in a single course at a single institution. This implementation affects the assignment's transferability and, consequently, our claims’ generalizability. We encourage instructors and researchers to implement the 2021 Grant Proposal; however, we encourage them to reflect on the assignment's learning objective, their course's learning objectives, and their institution's context and, accordingly, to alter the assignment.

Results and discussion

Second-semester organic chemistry students’ elaborations changed when the Wittig WTL assignment's rhetorical aspects changed. Addressing the first research question, we discuss the results from the responses, presenting how students’ elaborations changed. Addressing the second research question, we discuss the results from the surveys, proposing why students’ elaborations changed.

How students’ elaborations changed with changes in the assignment's rhetorical aspects

Students compared a traditional intermolecular Wittig reaction (Scheme 1) to a modified intramolecular Wittig reaction (Scheme 2), in order to connect explicit structures to implicit properties (Fig. 2). This comparison was a multivariate comparison, but one of the prime comparisons was the base, which was either a base with a negative charge or the enolate itself with a negatively-charged oxygen and a carbon–carbon double bond. Analysing students’ responses, we captured explicit-descriptive, explicit-functional, implicit-descriptive, and implicit-functional elaborations, and Fig. 3 presents these elaborations for this first comparison.
image file: d3rp00197k-f3.tif
Fig. 3 The distributions of elaborations for the comparison between Schemes 1 and 2 in Fig. 2. The Wittig WTL responses were coded as explicit descriptive (white bar), explicit functional (white dotted bar), implicit descriptive (black dotted bar), and implicit functional (black bar).

As the assignments changed, explicit-functional elaborations decreased and implicit-functional elaborations increased by 2021 (Fig. 3). A Pearson's chi-square test (χ2(6) = 41.5; p = < 0.001) confirmed that the assignments had significantly different distributions, and Bonferroni pairwise comparisons (Table 4) found that the 2018 Essay and the 2018 Feature Article had significantly different distributions. Both assignments had more explicit elaborations than implicit elaborations. However, the 2019 Cover Letter, the 2020 Grant Proposal, and the 2021 Grant Proposal had more implicit elaborations than explicit elaborations. Therefore, a cover letter or a grant proposal met the assignment's learning objective more than an essay or a feature article did for the comparison between Schemes 1 and 2 (Fig. 2). Exemplifying this finding, we describe one of the first assignments (the 2018 Feature Article) and the final assignment (the 2021 Grant Proposal).

Table 4 Bonferroni pairwise comparisons between the distributions of elaborations for the comparison between Schemes 1 and 2 in Fig. 2. “2018E” is the 2018 Essay, and “2018FA” is the 2018 Feature Article
Bonferroni pairwise comparison χ 2(2) p
a p ≤ 0.005.
2018E–2018FA 0.8 0.656
2018E–2019 19.8 <0.001a
2018E–2020 9.2 0.01
2018E–2021 28.5 <0.001a
2018FA–2019 13.8 0.001a
2018FA–2020 5.2 0.072
2018FA–2021 21.1 <0.001a
2019–2020 2.4 0.308
2019–2021 1.1 0.581
2020–2021 6.4 0.040


In one of the first assignments (the 2018 Feature Article), students’ elaborations were mainly explicit-functional elaborations (Fig. 3). Demonstrating explicit-functional elaborations, students stated explicit structures, such as the hydrogen atom, the carbon–oxygen double bond, or the carbon–carbon double bond. For example, a student connected having a hydrogen atom to being an acid, “This hydrogen is acidic due to the carbonyl group […].” Acidity was based on the hydrogen atom and the ester group, pulling on explicit structures. Also demonstrating explicit-functional elaborations, students stated explicit properties, such as the negatively-charged oxygen, the negatively-charged carbon, or the positively-charged phosphorus. For example, a different student connected having a negatively-charged carbon to being a base,

“The electrons on the O slide down, and the C–C double bond deprotonates the acidic H attached to the C with the P group […].

[Those] electrons fall into a C–P double bond […]. [In the] traditional mechanism, a separate base deprotonates […]. In this mechanism, the deprotonation occurs intramolecularly – hence why no base is needed.”

Basicity was based on the negatively-charged oxygen or the negatively-charged carbon, pulling on explicit properties. This focus on decoding explicit structures and explicit properties is a focus on explaining how the step happens, with explicit structures (e.g., “a base deprotonates”) and explicit properties (e.g., “the electrons slide down”) being actors in the step. Thus, these elaborations can be read as students practicing their mechanistic reasoning (Russ et al., 2008; Yan and Talanquer, 2015; Cooper et al., 2016; Crandell et al., 2018; Bodé et al., 2019; Crandell et al., 2020; Dood and Watts, 2022).

Contrastingly, in the last assignment (the 2021 Grant Proposal), students’ elaborations were mainly implicit-functional elaborations (Fig. 3). Demonstrating implicit-functional elaborations, students stated implicit properties, such as induction effects or resonance effects. For example, a student connected having induction effects to being an acid,

“The structural differences [between] the base-free Wittig reaction [and] the Wittig reaction are the carbonyl groups and the alkene. [These] double bonds provide electron shifting […]. […] Specifically, the hydrogen is acidic – or is easier to deprotonate – because the carbonyl groups withdraw electron density from the [neutral] carbon…”

Acidity was based not only on the hydrogen atom and the ester group but also on induction effects, pulling on an implicit property. The same student continued and connected having resonance effects to being a base,

“…and because the negatively-charged carbon [will be] resonance-stabilized by the carbonyl groups […]. [Resonance and induction] confer the deprotonation by the alkene and the elimination of a strong, external base.”

Basicity was based on not only the negatively-charged oxygen and the negatively-charged carbon but also on resonance effects, pulling on an implicit property. This focus on decoding implicit properties is a focus on explaining why the step happens, with implicit properties (e.g., “easier to deprotonate”) being descriptors of the step. Thus, these elaborations can be read as students practicing their causal reasoning (Russ et al., 2008; Yan and Talanquer, 2015; Cooper et al., 2016; Crandell et al., 2018; Bodé et al., 2019; Crandell et al., 2020; Dood and Watts, 2022).

Additionally, students compared a successful intramolecular Wittig reaction (Scheme 2) to an unsuccessful Wittig reaction (Scheme 3), in order to connect explicit structures to implicit properties (Fig. 2). This comparison was a univariate comparison, and the prime comparison was the acid, either the maleate with two ester groups or the acrylate with one ester group. Analysing students’ responses, we captured explicit-descriptive, explicit-functional, implicit-descriptive, and implicit-functional elaborations, and Fig. 4 presents these elaborations for this second comparison.


image file: d3rp00197k-f4.tif
Fig. 4 The distributions of elaborations for the comparison between Schemes 2 and 3 in Fig. 2. The Wittig WTL responses were coded as explicit descriptive (white bar), explicit functional (white dotted bar), implicit descriptive (black dotted bar), and implicit functional (black bar).

As the assignments changed, implicit-functional elaborations stayed constant from 2018 to 2020, but they increased by 2021 (Fig. 4). A Pearson's chi-square test (χ2(6) = 31.5; p = <0.001) confirmed that the assignments had significantly different distributions, and Bonferroni pairwise comparisons (Table 5) found that the 2021 Grant Proposal had the significantly different distribution. The 2021 Grant Proposal had the most implicit elaborations, although all assignments had more implicit elaborations than explicit elaborations. Therefore, an essay, a feature article, a cover letter, or a grant proposal meets the assignment's objective for the comparison between Schemes 2 and 3 (Fig. 2). Exemplifying this finding, we describe the last assignment (the 2021 Grant Proposal).

Table 5 Bonferroni pairwise comparisons between the distributions of elaborations for the comparison between Schemes 2 and 3 in Fig. 2. “2018E” is the 2018 Essay, and “2018FA” is the 2018 Feature Article
Bonferroni pairwise comparison χ 2(2) p
a p ≤ 0.005.
2018E–2018FA 0.1 0.958
2018E–2019 2.0 0.366
2018E–2020 0.5 0.767
2018E–2021 23.8 <0.001a
2018FA–2019 1.3 0.521
2018FA–2020 0.8 0.678
2018FA–2021 22.0 <0.001a
2019–2020 3.7 0.156
2019–2021 18.5 <0.001a
2020–2021 22.3 <0.001a


In the last assignment (the 2021 Grant Proposal), students’ elaborations were mainly implicit-functional elaborations (Fig. 4). Demonstrating implicit-functional elaborations, students stated implicit properties, such as induction effects or resonance effects. For example, a student connected having induction effects to being an acid,

[Scheme 3] lacks a second electron-withdrawing carbonyl group […]. […] The C–H bond in acrylate is stronger than the C–H bond in maleate [since] acrylate lacks the electron-withdrawing carbonyl that inductively weakens [maleate's] C–H bond. [This] makes [acrylate's] H less acidic, [and], if deprotonated, the structure would lack resonance stabilization. As this H cannot be intramolecularly deprotonated and no other bases [are] present, the acrylate cannot be turned into a ylide.” Acidity was based on: the ester group, starting with an explicit structure; induction effects, continuing with an implicit property; and bond strength, ending with another implicit property. Like the implicit-functional elaborations in the first comparison, these elaborations focus on decoding implicit properties (e.g., “is stronger”), focus on explaining why the step happens, and can be read as students practicing their causal reasoning (Russ et al., 2008; Yan and Talanquer, 2015; Cooper et al., 2016; Crandell et al., 2018; Bodé et al., 2019; Crandell et al., 2020; Dood and Watts, 2022). Unlike the implicit-functional elaborations in the first comparison, these elaborations start with an explicit structure, connect the explicit structure to an implicit property, and continue with a series of implicit properties (e.g., “acrylate lacks the electron-withdrawing carbonyl that inductively weakens [maleate's] C–H bond”) or “chain” (Graulich et al., 2019) and can be read as students practicing more chained, more elaborated causal reasoning.

Both comparisons are engaging students in decoding implicit properties; thus, both comparisons are engaging students in causal reasoning (Russ et al., 2008; Yan and Talanquer, 2015; Cooper et al., 2016; Crandell et al., 2018; Bodé et al., 2019; Crandell et al., 2020; Dood and Watts, 2022). However, the second comparison is engaging students in chaining implicit properties, or in more chained, more elaborated causal reasoning. This difference in the depth could be due to the difference in the comparison. The second comparison is a univariate comparison, where students decoded one explicit structure and constructed an elaboration from this explicit structure to multiple implicit properties. Contrastingly, the first comparison is a multivariate comparison, where students decoded multiple explicit structures and they constructed an elaboration from one of these explicit structures to one implicit property. Presumably, students weighed these explicit structures, after they decoded them and before they explained one of them. Accordingly, these elaborations are engaging students in multivariate reasoning (Kraft et al., 2010; Strickland et al., 2010; Sevian and Talanquer, 2014; Weinrich and Talanquer, 2016; Bodé et al., 2019; Moreira et al., 2019; Deng and Flynn, 2020), in addition to their causal reasoning (Russ et al., 2008; Yan and Talanquer, 2015; Cooper et al., 2016; Crandell et al., 2018; Bodé et al., 2019; Crandell et al., 2020; Dood and Watts, 2022). Engaging in both may be limiting the depth. Research has shown that a case comparison elicits multivariate reasoning (Caspari et al., 2018; Caspari and Graulich, 2019; Graulich and Caspari, 2020; Watts et al., 2021). Consequently, we assume that students’ multivariate reasoning is shaped by the question's case comparison, but we conjecture that their causal reasoning may be shaped by the assignment's rhetorical aspects.

Why elaborations changed according to how students perceived the assignment's rhetorical aspects

Students responded to surveys and commented on the assignment, including but not limited to the assignment's rhetorical aspects and its learning requirements. Analysing students’ comments and guided by the Cognitive Process Theory of Writing (Hayes and Flower, 1980; Flower and Hayes, 1981, 1984; Hayes, 1996), we constructed three themes: rhetorical aspects misaligning with learning requirements; rhetorical aspects aligning with learning requirements; and rhetorical aspects engaging students (Table 3). This theory posits that the assignment, with its learning objective and its rhetorical aspects, is a “rhetorical problem” but that the response can be a “rhetorical solution.” Exemplifying our themes, we describe one of the first assignments (the Feature Article) and one of the final assignments (the Grant Proposal).

In one of the first assignments (the Feature Article), students’ comments suggested that the rhetorical aspects and the learning requirements were misaligned. Defining this theme, the specified audience frustrated students. Specifically, a student felt frustrated interpreting C&EN readers’ knowledge, “It was unclear – the [audience's] knowledge […] of organic chemistry. It was stated that they knew some but not all, and it was hard finding that in between point.” This student interpreted that readers have some knowledge. Similarly, a student felt frustrated translating C&EN readers’ knowledge, “The translation of organic chemistry was unclear. How was I supposed to talk about [organic chemistry to] someone who doesn't know a lot about [organic chemistry]?” This student interpreted that C&EN readers do not have any knowledge. Students interpreted that C&EN readers are not a scientific audience, without any or with some knowledge, although we intended that they would be a general scientific audience.

Also defining this theme, the specified audience appeared to constrain students’ elaborations. Specifically, a student focused on formatting the response, “[The audience] was counterproductive and caused me to spend more time worrying about the formatting and writing style of the assignment instead of the content.” Similarly, a student focused on simplifying the response, “I [found] it difficult to describe chemistry terminology in a way that is simple but also accurate for the target audience.” Both students focused on writing the response, including style and length, rather than explaining the assignment's objective. Because students interpreted that C&EN readers are not a scientific audience, they assumed that vocabulary, phrases, and concepts were not shared and should be explained. However, the explanation must be “simplified” and explicit but also elaborated and implicit. Therefore, the audience poses an unsolvable rhetorical problem, choosing either fulfilling the assignment's rhetorical aspects or explaining the assignment's learning objective. This could account for the 2018 Feature Article not meeting the assignment's learning objective.

Contrastingly, in one of the final assignments (the Grant Proposal), students’ comments suggested that the rhetorical aspects and the learning requirements were aligned. Defining this theme, the audience satisfied students. For example, a student felt satisfied translating NIH readers’ knowledge, “I liked that [the genre] challenged me to explain this to [the audience] very clearly, but without […] the technical words that I want to use.” This student interpreted that reviewers have most knowledge. Students interpreted that NIH readers are a scientific audience, without all but with most knowledge, and we intended that they would be a specific scientific audience.

Also defining this theme, the specified audience appeared to encourage students’ elaborations. For example, a student focused on “working out” the reaction mechanisms, “[I]t is a fun challenge to write a highly technical essay. Working out the mechanism is very rewarding, as I feel like I have done something really difficult well.” This student focused on explaining the assignment's objective rather than on writing the response, including style and length. If students focused on writing the response, they focused on the length because they wanted to write more, not because they could not write more or did not know how much to write. For example, a student felt frustrated keeping to an assigned length, “A challenging part of the assignment was […] keeping my word [count] to a minimum.” Because students interpreted that NIH readers are a scientific audience, they assumed that most vocabulary, phrases, and concepts were shared and that the salient ones should be explained. Moreover, the explanation could be elaborated and implicit. Therefore, the audience poses a solvable rhetorical problem, balancing the assignment's rhetorical aspects and explaining the assignment's learning objective. This could account for the 2020 and 2021 Grant Proposals meeting the assignment's learning objective.

These findings show the influence of specifying an appropriate audience. We conjecture that students’ elaborations may be shaped by the assignment's audience, but we recognize that their elaborations may be truly shaped by their interpretations of the assignment's audience. Therefore, WTL assignments should not only specify an audience (Gere et al., 2019) but also detail an appropriate, transparent audience and describe the audience's level of knowledge or provide examples.

Additionally, we recognize that students’ elaborations may be shaped by their motivations. The Cognitive Process Theory of Writing (Hayes and Flower, 1980; Flower and Hayes, 1981, 1984; Hayes, 1996) proposes that students not only write in response to the assignment's learning objectives (e.g., Should I include this concept?) and its rhetorical aspects (e.g., Does my audience know this concept? Should I explain this concept?) but also in response to their motivations (e.g., Do I want to include this concept? Do I want to explain this concept?). Students’ comments suggested that they were engaged. Defining this theme, students commented that the assignment “motivated [them],” the assignment “seemed meaningful,” or the assignment “seemed relevant.” Expanding on the assignment's relevance, a student connected the 2018 Feature Article to their laboratory course, “I like how [the assignment] incorporated what we were doing in the lab.” Similarly expanding on the assignment's relevance, a student connected the 2020 Grant Proposal to their lecture course, “I like that this assignment built upon [what] we had covered in lecture. The material was not totally unfamiliar, so I could actually attempt to explain it on my own.” Students found this assignment to be relevant, and studies corroborate that students find our assignments to be relevant (Petterson et al., 2021) and, because meaningful learning requires relevance (Bretz, 2001), that they find them to be meaningful learning experiences (Gupte et al., 2021). Relatedly, because motivation requires relevance (Stuckey et al., 2013), students might find our assignments to be motivating experiences. These findings inform ours, as students’ motivations have been proposed to mediate between an assignment's rhetorical problem (e.g., the audience) and its rhetorical solution (Hayes, 1996). Thus, we suspect that appropriate rhetorical aspects are those that motivate students in addition to – or in order to – encourage their elaborations.

Conclusion and implications

WTL assignments support a variety of learning objectives, including those specific to organic chemistry (Schmidt-Mccormack et al., 2019; Watts et al., 2020; Brandfonbrener et al., 2021). Expanding these learning objectives, we iteratively designed a WTL assignment that targeted implicit properties (i.e., “Students will explain the mechanism's changes by connecting its explicit structures to their implicit properties”). We implemented five assignments. Previous research demonstrated that implementing WTL assignments does not guarantee that students’ learning will be supported (Applebee, 1984; Rivard, 1994; Bangert-Drowns et al., 2004; Anderson et al., 2015; Gere et al., 2019; Finkenstaedt-Quinn et al., 2021a, 2023). Specifying rhetorical aspects is identified as important in supporting students’ learning, but different assignments, depending on their genre, audience, and role, have different learning outcomes (Hand et al., 2004; Chen, 2013; Chen et al., 2016; Gere et al., 2018). Therefore, we not only explored how the assignment elicited students’ writing but also how students’ writing changed when the assignment's rhetorical aspects changed.

The assignments elicited students’ explicit and implicit elaborations. Mechanistic reasoning depends on explicit elaborations, or decoding explicit structures (e.g., electrons, atoms, and chemical bonds); similarly, causal reasoning depends on implicit elaborations, or decoding implicit properties (e.g., acidity, induction effects, or resonance effects) (Russ et al., 2008; Yan and Talanquer, 2015; Cooper et al., 2016; Crandell et al., 2018; Bodé et al., 2019; Crandell et al., 2020; Dood and Watts, 2022). Thus, these elaborations can be interpreted as students practicing their reasoning and demonstrating their reasoning to researchers or instructors. The 2018 Essay and the 2018 Feature Article did not elicit these implicit elaborations to the extent that the 2019 Cover Letter, the 2020 Grant Proposal, and the 2021 Grant Proposal did, and, thus, the latter assignments better met the learning objective. Consistent with Watts et al.'s (2020) findings, our findings suggest that WTL assignments can support the learning objective of reasoning, in addition to the learning objectives of conceptual understanding that have been documented previously (Schmidt-Mccormack et al., 2019; Watts et al., 2020; Brandfonbrener et al., 2021; Finkenstaedt-Quinn et al., 2023).

Moreover, the assignments shaped students’ elaborations, moving from explicit elaborations to implicit elaborations. According to Flower and Hayes, the writing assignment is the “rhetorical problem,” and the writing response is the “rhetorical solution” (Hayes and Flower, 1980; Flower and Hayes, 1981, 1984; Hayes, 1996) and an assignment's rhetorical aspects are one of the mediators between problem and solution (Hayes and Flower, 1980; Flower and Hayes, 1981, 1984; Hayes, 1996). The 2018 Feature Article constrained students’ elaborations into explicit elaborations. Contextualizing this finding, students’ comments expressed that this assignment's audience presented a challenging and disengaging problem. Students interpreted that C&EN readers are not a scientific audience, although we intended that they would be a general scientific audience. They reported feeling frustrated, focusing on writing the response. Thus, the assignments’ rhetorical aspects and learning requirements were misaligned. Contrastingly, the 2020 and 2021 Grant Proposal assignments encouraged their elaborations into implicit elaborations. Contextualizing this finding, students' comments expressed that this assignment's audience presented a challenging but engaging problem. We intended that NIH reviewers would be a specific scientific audience, and students interpreted that they were. They reported feeling satisfied and capable, focusing on explaining the assignment's learning objective. Therefore, the assignments’ rhetorical aspects and learning requirements were aligned. These findings show how WTL assignments need to detail appropriate rhetorical aspects in order to encourage more implicit elaborations and, correspondingly, more complex reasoning.

Students’ motivations are also one of the mediators between problem and solution (Hayes and Flower, 1980; Flower and Hayes, 1981, 1984; Hayes, 1996). Students’ comments expressed that all assignments “motivated them,” “seemed relevant,” and “seemed meaningful.” Studies corroborate that students find WTL assignments to be relevant (Petterson et al., 2021) and to be meaningful learning experiences (Gupte et al., 2021). Supporting these findings, we report how WTL assignments need relevant rhetorical aspects in order to encourage more implicit elaborations and, correspondingly, more complex reasoning.

Implications for research

Our findings support previous reports that WTL assignments can elicit organic chemistry students’ reasoning on reaction mechanisms. Researchers can transform our writing assignment into a writing task, interview questions, or survey questions, aiding them in eliciting students’ reasoning. However, we designed this assignment on a single case (i.e., the Wittig reaction), and we implemented this assignment in a single course at a single institution. We encourage designing writing assignments on other reaction cases and implementing them in other contexts.

Implications for instruction

Organic chemistry instructors can implement our writing assignment, aiding them in assessing students’ reasoning. However, we recommend adapting the assignment, especially setting learning objectives for a type of reasoning or parts of reasoning, detailing appropriate and relevant rhetorical aspects, and aligning the learning objectives and the rhetorical aspects. These rhetorical aspects can be inspired by historical moments (e.g., synthesizing aspirin or thalidomide), scientific aspirations (e.g., writing a grant proposal) and vocational interests (e.g., a synthetic chemist in a medicinal research group), or students themselves (e.g., What organic molecule is important to you?). We suggest Finkenstaedt-Quinn et al. (2021a) and Finkenstaedt-Quinn et al. (2023) for guidance on designing and implementing WTL assignments in STEM courses as well as Finkenstaedt-Quinn et al. (2021b) for guidance on peer review in all courses and, possibly, peer assessment in courses without UTAs or GTAs.

Author contributions

All authors contributed. I. Z. and A. J. D. contributed to the conceptualization, the data collection, analysis, and presentation, and the writing of this study. G. V. S. contributed to the design and implementation of the assignment as well as the revising of this study. The manuscript was written by I. Z., with extensive, valuable feedback from A. J. D. and G. V. S. All authors read and approved the manuscript.

Conflicts of interest

There are no conflicts to declare.

Appendices

Appendix 1: the 2021 grant proposal assignment

Motivation and significance

Benzoxepine (Fig. 5) is a heterocycle composed of a six-membered benzene ring and a seven-membered oxepin ring. Some benzoxepine analogs inhibit tuberculosis, and other benzoxepine analogs inhibit cancers by inducing activation of the apoptosis pathway. Specifically, benzoxepinoisoxazolone (Fig. 6) is a benzoxepine analog whose anticancer activity is attributed to its functionalization with phenyl and azole groups.
image file: d3rp00197k-f5.tif
Fig. 5 Benzoxepine.

image file: d3rp00197k-f6.tif
Fig. 6 Benzoxepinoisoxazolone.

Benzoxepine analogs are important intermediates in the synthesis of therapeutic drugs. However, the isolation of benzoxepine analogs from natural sources is inefficient. Recently, German researchers synthesized benzoxepine analogs (Fig. 7) using a base-free Wittig reaction (Fig. 8). This reaction allows for the synthesis of therapeutic drugs on an industrial scale.


image file: d3rp00197k-f7.tif
Fig. 7 Synthesis of benzoxepinoisoxazolone using the base-free Wittig reaction.

image file: d3rp00197k-f8.tif
Fig. 8 Generalized schemes of the base-free Wittig reaction. Scheme 1 shows the standard Wittig reaction, and Scheme 2 shows an example of the base-free Wittig reaction using a maleate starting material. Scheme 3 shows a limitation of the base-free Wittig, where the reaction fails when using an acrylate starting material.

Application

You are a medicinal drug developer in a research group that primarily studies anticancer compounds. Inspired by the benzoxepinoisoxazolone in Fig. 6, one of the group's current goals is synthesizing benzoxepine analogs using the base-free Wittig synthesis (Fig. 8) and evaluating the analogs for anticancer activities. To do so, your project team is drafting a grant proposal for the National Institute of Health (NIH) that summarizes the project's goals and argues for the project's significance, innovation, and impact. You, the organic chemist expert, must write the section of the grant proposal that explains the base-free Wittig reaction. Because the reaction is critical for the success of the project, you must demonstrate to the committee that your project team understands how the reaction works and why it is selective. The committee who will review the proposal is made up of scientists from many disciplines, including chemistry, biology, and medicine. Therefore, they may not be experts when it concerns mechanisms or organic-specific terms. The NIH recommends that you:

• write organized and logical paragraphs with headers;

• include figures that assist the reviewers in understanding complex information;

• use clear and concise language, striking a balance between organic jargon and oversimplifications.

Requirements

Your section of the grant proposal should be approximately between 500–700 words (1–2 pages) in length. It should address the following points:

1. What changes occur from the starting materials and the reagents to the products for the reaction in Scheme 2?

a. Describe the mechanistic steps.

b. Explain the structural features (e.g., atoms or functional groups) and the electronic, chemical properties (e.g., electronegativity, resonance, or induction) of the starting materials, reagents, and intermediates, and, moreover, explain their role (e.g., electrophile, nucleophile, acid, or base) or arrows in the mechanistic step.

c. Focus on the how and why as well as the what.

2. Compare the mechanistic steps in Scheme 2 to those in Scheme 1.

a. What step allows for the formation of the ylide without the use of an external base? (Note that the ylide is not shown in this scheme.)

b. Explain the structural features and electronic, chemical properties that are present or absent in this step.

3. Compare the mechanistic steps in Scheme 2 to those in Scheme 3.

a. Why does the reaction work with maleate but not work with acrylate?

b. Explain the structural features and electronic, chemical properties that are present or absent in this step.

You can and should include figures of schemes, structures, or mechanisms, if that supports your response. We suggest that you have the figure(s) in front of you — ready to color-code or mark-up in various ways — and that you use your visible thinking to guide your audience through your writing. Any images that you include in your response, including the figures in this prompt or those that you draw in ChemDraw or on paper, must have the original source cited using either ACS or APA format. Given your audience, your written response should suffice so that the written response is as representative and descriptive as the figures. You will be graded only on your written response.

Appendix 2: the 2021 peer review

Directions

• Print and read over your peer's response to quickly get an overview of the piece.

• Read the response more slowly, keeping the rubric in mind.

• Highlight the pieces of text that let you directly address the rubric in your online responses.

• In your online responses, focus on higher-order concerns, like content and argument, rather than lower-order concerns, like grammar and spelling.

• Be very specific in your responses, referring to your peer's actual language, mentioning terms and concepts that are either present or missing, and following the directions in the rubric.

• Use respectful language, whether you are suggesting improvements to or praising your peer.

Questions

1. Does the author describe and explain the mechanistic steps in Scheme 2 so that the committee can easily, swiftly understand how the reaction works? Comment on the parts of the response where the author could improve their mechanistic descriptions of what electronic movement occurs as well as their mechanistic explanations of how and why electronic movement occurs.

2. Does the author's comparison provide a description (the what) as well as an explanation (the how and why) of Scheme 1 occurring intermolecularly but Scheme 2 occurring intramolecularly? Comment on the structure and the electronic, chemical property that the author attributes as the reason.

3. Does the author's comparison provide a description as well as an explanation of Scheme 2 occurring but Scheme 3 not occurring? Comment on the structure and the electronic, chemical property that the author attributes as the reason.

Appendix 3: the 2021 grant proposal rubric

Criteria “Attempts” this criterion Points (___/25)
Description and explanation of Scheme 2 Includes: 10
• A CORRECT description of the structural features OR what changes happen in the reaction mechanism AND
• A CORRECT explanation of the electronic, chemical properties OR how and why changes happen in the reaction mechanism
Comparison of Schemes 1 and 2 Provides: 3
• A structural feature as the comparison OR
• A structural feature and its electronic, chemical property as the comparison
Criterion (2) may be repetitive of Criterion (1), but Criterion (2) adds onto Criterion (1)'s explanation with a direct comparison between Schemes 1 and 2
Comparison of Schemes 2 and 3 Includes: 10
• A CORRECT description of the structural features OR what changes happen in the reaction mechanism AND
• A CORRECT explanation of the electronic, chemical properties OR how and why changes happen in the reaction mechanism
Appropriate language Attempts: 1
• Clear, concise sentences and logical, organized paragraphs
DO NOT omit the point if they do not adhere to the grant proposal style
Citations Attempts: 1
• Citations for figures they did not produce
• Indications for figures they did produce (either ChemDraw or hand-drawn)

Acknowledgements

We wish to thank the undergraduate students for participating in our study as well as the Undergraduate Researcher Katiya A. Barkho for helping with the data preparation. Additionally, we wish to thank group members Field M. Watts and Solaire A. Finkenstaedt-Quinn for providing feedback on our manuscript. This study was supported by the University of Michigan Third Century Initiative and the NSF GRFP (000884418).

References

  1. Alfieri L., Nokes-Malach T. J. and Schunn C. D., (2013), Learning Through Case Comparisons: A Meta-Analytic Review, Educ. Psychol., 48, 87–113.
  2. Anderson P., Anson C. M., Gonyea R. M. and Paine, C., (2015), The Contributions of Writing to Learning and Development: Results from a Large-Scale Multi-institutional Study, Res. Teach. Engl., 50, 199–235.
  3. Applebee A. N., (1984), Writing and Reasoning, Rev. Educ. Res., 54, 577–596.
  4. Bangert-Drowns R. L., Hurley M. M. and Wilkinson, B., (2004), The Effects of School-Based Writing-to-Learn Interventions on Academic Achievement: A Meta-Analysis, Rev. Educ. Res., 74, 29–58.
  5. Bodé N. E., Deng J. M. and Flynn A. B., (2019), Getting Past the Rules and to the WHY: Causal Mechanistic Arguments When Judging the Plausibility of Organic Reaction Mechanisms, J. Chem. Educ., 96, 1068–1082.
  6. Brandfonbrener P. B., Watts F. M. and Shultz G. V., (2021), Organic Chemistry Students’ Written Descriptions and Explanations of Resonance and Its Influence on Reactivity, J. Chem. Educ., 98, 3431–3441.
  7. Bretz S. L., (2001), Novak's Theory of Education: Human Constructivism and Meaningful Learning, J. Chem. Educ., 78, 1107.
  8. Caspari I. and Graulich N., (2019), Scaffolding the Structure of Organic Chemistry Students’ Multivariate Comparative Mechanistic Reasoning, Int. J. Phys. Chem. Educ., 11, 31–43.
  9. Caspari I., Kranz D. and Graulich N., (2018), Resolving the Complexity of Organic Chemistry Students’ Reasoning through the Lens of a Mechanistic Framework, Chem. Educ. Res. Pract., 19, 1117–1141.
  10. Chen Y.-C., (2013), Writing an Argument to a Real Audience: Alternative Ways to Motivate Students in Writing about Science, Teach. Sci., 59, 8–12.
  11. Chen Y.-C., Park S. and Hand B., (2016), Examining the Use of Talk and Writing for Students’ Development of Scientific Conceptual Knowledge Through Constructing and Critiquing Arguments, Cogn. Instr., 34, 47.
  12. Cohen J., (1960), A Coefficient of Agreement for Nominal Scales, Educ. Psychol. Meas., 20, 37–46.
  13. Cooper M. M., Kouyoumdjian H. and Underwood S. M., (2016), Investigating Students’ Reasoning about Acid−Base Reactions, J. Chem. Educ., 93, 46.
  14. Crandell O. M., Kouyoumdjian H., Underwood S. M. and Cooper M. M., (2018), Reasoning about Reactions in Organic Chemistry: Starting It in General Chemistry, J. Chem. Educ., 96, 213–226.
  15. Crandell O. M., Lockhart M. A. and Cooper M. M., (2020), Arrows on the Page Are Not a Good Gauge: Evidence for the Importance of Causal Mechanistic Explanations about Nucleophilic Substitution in Organic Chemistry, J. Chem. Educ., 97, 313–327.
  16. Cruz-Ramí Rez De Arellano D. and Towns M. H., (2014), Students’ understanding of alkyl halide reactions in undergraduate organic chemistry, Chem. Educ. Res. Pract., 15, 501.
  17. Deng J. M. and Flynn A. B., (2020), Reasoning, Granularity, and Comparisons in Students’ Arguments on Two Organic Chemistry Items, Chem. Educ. Res. Pract., 22, 749–771.
  18. Dood A. J. and Watts F. M., (2022), Mechanistic Reasoning in Organic Chemistry: A Scoping Review of How Students Describe and Explain Mechanisms in the Chemistry Education Research Literature, J. Chem. Educ., 99, 2864–2876.
  19. Dood A. J. and Watts F. M., (2023), Students’ Strategies, Struggles, and Successes with Mechanism Problem Solving in Organic Chemistry: A Scoping Review of the Research Literature, J. Chem. Educ., 100, 53–68.
  20. Dood A. J., Fields K. B. and Raker J. R., (2018), Using Lexical Analysis to Predict Lewis Acid-Base Model Use in Responses to an Acid-Base Proton-Transfer Reaction, J. Chem. Educ., 95, 1267–1275.
  21. Dood A. J., Fields K. B., Cruz-Ramírez De Arellano D. and Raker J. R., (2019), Development and Evaluation of a Lewis Acid–Base Tutorial for Use in Postsecondary Organic Chemistry Courses, Can. J. Chem., 97, 711–721.
  22. Dood A. J., Dood J. C., Cruz-Ramírez De Arellano D., Fields K. B. and Raker J. R., (2020a), Analyzing Explanations of Substitution Reactions Using Lexical Analysis and Logistic Regression Techniques, Chem. Educ. Res. Pract., 21, 267–286.
  23. Dood A. J., Dood J. C., Cruz-Ramírez De Arellano D., Fields K. B. and Raker J. R., (2020b), Using the Research Literature to Develop an Adaptive Intervention to Improve Student Explanations of an SN1 Reaction Mechanism, J. Chem. Educ., 97, 3551–3562.
  24. Emig J., (1971), The Composing Processes of Twelfth Graders, Urbana, IL: National Council of Teachers of English.
  25. Emig J., (1977), Writing as a Mode of Learning, Coll. Compos. Commun., 28, 122–128.
  26. Erduran S., Simon S. and Osborne J., (2004), TAPping into Argumentation: Developments in the Application of Toulmin's Argument Pattern for Studying Science Discourse, Sci. Educ., 88, 915–933.
  27. Finkenstaedt-Quinn S. A., Petterson M., Gere A. R. and Shultz G. V., (2021a), Praxis of Writing-to-Learn: A Model for the Design and Propagation of Writing-to-Learn in STEM, J. Chem. Educ., 98, 1548–1555.
  28. Finkenstaedt-Quinn S. A., Polakowski N., Gunderson B., Shultz G. V. and Gere A. R., (2021b), Utilizing Peer Review and Revision in STEM to Support the Development of Conceptual Knowledge Through Writing, Writ. Commun., 38, 1–29.
  29. Finkenstaedt-Quinn S. A., Watts F. M., Shultz G. V. and Gere A. R., (2023), A Portrait of MWrite as a Research Program: A Review of Research on Writing-to-Learn in STEM through the MWrite Program, Int. J. Scholarsh. Teach. Learn., 17, 1–15.
  30. Flower L. and Hayes J. R., (1981), A Cognitive Process Theory of Writing, Coll. Compos. Commun., 32, 365–387.
  31. Flower L. and Hayes J. R., (1984), Images, Plans, and Prose: The Representation of Meaning in Writing, Writ. Commun., 1, 120–160.
  32. Gere A. R., Knutson A. V., Limlamai N., McCarty R. and Wilson E., (2018), A Tale of Two Prompts: New Perspectives on Writing-to-Learn Assignments, WAC J., 29, 147–188.
  33. Gere A. R., Limlamai N., Wilson E., MacDougall Saylor K. and Pugh R., (2019), Writing and Conceptual Learning in Science: An Analysis of Assignments, Writ. Commun., 36, 99–135.
  34. Gilbert J. K., (2006), On the Nature of “Context” in Chemical Education, Int. J. Sci. Educ., 28, 957–976.
  35. Goodwin W., (2003), Explanation in organic chemistry, Ann. N. Y. Acad. Sci., 988, 141–153.
  36. Grandane A., Longwitz L., Roolf C., Spannenberg A., Escobar H. M., Junghanss C., Suna E. and Werner T., (2019), Intramolecular Base-Free Catalytic Wittig Reaction: Synthesis of Benzoxepinones, J. Org. Chem., 84, 1320–1329.
  37. Graulich N., (2015), The Tip of the Iceberg in Organic Chemistry Classes: How Do Students Deal with the Invisible? Chem. Educ. Res. Pract., 16, 9–21.
  38. Graulich N. and Caspari I., (2020), Designing a Scaffold for Mechanistic Reasoning in Organic Chemistry, Chem. Teach. Int., 3, 1–12.
  39. Graulich N. and Schween M., (2018), Concept-Oriented Task Design: Making Purposeful Case Comparisons in Organic Chemistry, J. Chem. Educ., 95, 376–383.
  40. Graulich N., Hedtrich S. and Harzenetter R., (2019), Explicit versus Implicit Similarity – Exploring Relational Conceptual Understanding in Organic Chemistry, Chem. Educ. Res. Pract., 20, 924–936.
  41. Gupte T., Watts F. M., Schmidt-McCormack J. A., Zaimi I., Gere A. R. and Shultz G. V., (2021), Students’ Meaningful Learning Experiences from Participating in Organic Chemistry Writing-to-Learn Activities, Chem. Educ. Res. Pract., 22, 396–414.
  42. Hand B., Hohenshell L. and Prain V., (2004), Exploring Students’ Responses to Conceptual Questions When Engaged with Planned Writing Experiences: A study with Year 10 Science Students, J. Res. Sci. Teach., 41, 186–210.
  43. Hayes J. R., (1996), A New Framework for Understanding Cognition and Affect in Writing, in Levy C. M. and Ransdell S. (ed.), The Science of Writing: Theories, Methods, Individual Differences, and Applications, Mahwah, NJ: Lawrence Erbaum Associates, pp. 1–27.
  44. Haynes W., (2013), Bonferroni Correction, Encycl. Syst. Biol., 154.
  45. Hayes J. R. and Flower L. S., (1980), Identifying the Organization of Writing Processes, in Gregg L. W. and Steinberg E. R. (ed.), Cognitive Processes in Writing, Mahwah, NJ: Lawrence Erbaum Associates, pp. 3–30.
  46. Kraft A., Strickland A. M. and Bhattacharyya G., (2010), Reasonable Reasoning: Multi-Variate Problem-Solving in Organic Chemistry, Chem. Educ. Res. Pract., 11, 281–292.
  47. McHugh M. L., (2013), The Chi-Square Test of Independence, Biochem. Medica, 23, 143–149.
  48. Moreira P., Marzabal A. and Talanquer, V., (2019), Using a Mechanistic Framework to Characterise Chemistry Students’ Reasoning in Written Explanations, Chem. Educ. Res. Pract., 20, 120–131.
  49. Petterson M. N., Finkenstaedt-Quinn S. A., Gere A. R. and Shultz G. V., (2021), The Role of Authentic Contexts and Social Elements in Supporting Organic Chemistry Students’ Interactions with Writing-to-Learn Assignments, Chem. Educ. Res. Pract., 23, 189–205.
  50. Rivard L. P., (1994), A Review of Writing to Learn in Science: Implications for Practice and Research, J. Res. Sci. Teach., 31, 969–983.
  51. Rodemer M., Eckhard J., Graulich N. and Bernholt S., (2020), Decoding Case Comparisons in Organic Chemistry: Eye-Tracking Students’ Visual Behavior, J. Chem. Educ., 97, 3530–3539.
  52. Russ R. S., Scherr R. E., Hammer D. and Mikeska J., (2008), Recognizing Mechanistic Reasoning in Student Scientific Inquiry: A Framework for Discourse Analysis Developed from Philosophy of Science, Sci. Educ., 92, 499–525.
  53. Schirmer M. L., Adomeit S. and Werner T., (2015), First Base-Free Catalytic Wittig Reaction, Org. Lett., 17, 3078–3081.
  54. Schmidt-Mccormack J. A., Judge J. A., Spahr K., Yang E., Pugh R., Karlin A., Sattar A., Thompson B. C., Gere A. R. and Shultz G. V., (2019), Analysis of the Role of a Writing-to-Learn Assignment in Student Understanding of Organic Acid-Base Concepts, Chem. Educ. Res. Pract., 20, 383–398.
  55. Sevian H. and Talanquer V., (2014), Rethinking Chemistry: A Learning Progression on Chemical Thinking, Chem. Educ. Res. Pract., 15, 10–23.
  56. Strickland A. M., Kraft A. and Bhattacharyya G., (2010), What Happens When Representations Fail to Represent? Graduate Students’ Mental Models of Organic Chemistry Diagrams, Chem. Educ. Res. Pract., 11, 293–301.
  57. Stuckey M., Hofstein A., Mamlok-Naaman R. and Eilks I., (2013), The Meaning of “Relevance” in Science Education and Its Implications for the Science Curriculum, Stud. Sci. Educ., 49, 1–34.
  58. Ültay N. and Çalık M., (2012), A Thematic Review of Studies into the Effectiveness of Context-Based Chemistry Curricula, J. Sci. Educ. Technol., 21, 686–701.
  59. Watts F. M. and Finkenstaedt-Quinn S. A., (2021), The Current State of Methods for Establishing Reliability in Qualitative Chemistry Education Research Articles, Chem. Educ. Res. Pract., 22, 565–578.
  60. Watts F. M., Schmidt-Mccormack J. A., Wilhelm C. A., Karlin A., Sattar A., Thompson B. C., Gere A. R. and Shultz G. V., (2020), What Students Write about When Students Write about Mechanisms: Analysis of Features Present in Students’ Written Descriptions of an Organic Reaction Mechanism, Chem. Educ. Res. Pract., 21, 1148–1172.
  61. Watts F. M., Zaimi I., Kranz D., Graulich N. and Shultz G. V., (2021), Investigating Students’ Reasoning over Time for Case Comparisons of Acyl Transfer Reaction Mechanisms, Chem. Educ. Res. Pract., 22, 364–381.
  62. Weinrich M. L. and Talanquer V., (2016), Mapping students’ modes of reasoning when thinking about chemical reactions used to make a desired product, Chem Educ Res Pr., 17, 394–406.
  63. Winkelmes M.-A., Copeland D. E., Jorgensen E., Sloat A., Smedley A., Pizor P., Johnson K. and Jalene S., (2015), Benefits (Some Unexpected) of Transparently Designed Assignments, Natl. Teach. Learn. Forum, 24, 4–7.
  64. Winkelmes M.-A., Bernacki M., Butler J., Zochowski M., Golanics J. and Weavil K. H., (2016), A Teaching Intervention That Increases Underserved College Students’ Success, Peer Rev., 18, 31–36.
  65. Yan F. and Talanquer V., (2015), Students’ Ideas about How and Why Chemical Reactions Happen: Mapping the Conceptual Landscape, Int. J. Sci. Educ., 37, 3066–3092.
  66. Yik B. J., Dood A. J., Cruz-Ramírez De Arellano D., Fields K. B. and Raker J. R., (2021), Development of a Machine Learning-Based Tool to Evaluate Correct Lewis Acid–Base Model Use in Written Responses to Open-Ended Formative Assessment Items, Chem. Educ. Res. Pract., 22, 866–885.

This journal is © The Royal Society of Chemistry 2024
Click here to see how this site uses Cookies. View our privacy policy here.