Patricia
Moreira
* and
Vicente
Talanquer
Department of Chemistry and Biochemistry, University of Arizona, Tucson, AZ 85721, USA. E-mail: pmoreira@arizona.edu
First published on 13th October 2023
Teaching is a complex activity that demands paying attention to diverse components and relationships that affect the learning process, and acting with intentionality to build and nurture those connections. In this qualitative research study, we proposed and used an intentional–relational framework to explore differences in the relationships that four general chemistry instructors sought and acted to build with intention in their classes. Our goal was not to evaluate the quality of instruction but rather to characterize instructors’ practices to gain insight into educational relationships that may affect student performance. All instructors in our sample manifested a strong interest in helping students succeed in their studies and relied on a variety of resources designed and integrated into their courses to support student learning. They mostly differed in the extent to which they attended and responded to contextual issues, intentionally seeking to make content relevant to students, helping them build connections between their interests and the discipline, and adapting resources to create more inclusive learning environments. These differences seem to affect student performance in common exams. Our study highlights the importance of analyzing the relationships that instructors build with intention to support professional development and teacher reflection, and better understand the impact of instructors’ decisions on student performance.
The significant benefits of active versus passive approaches to college STEM teaching have been made explicit through ambitious meta-analyses that aggregate data from multiple institutions and classrooms (Freeman et al., 2014; Harris et al., 2020; Theobald et al., 2020). Results from these types of analyses should be interpreted cautiously as learning environments grouped within the “active learning” category may have had different characteristics in terms of the curricula used in the compared courses, the specific teaching strategies that were applied and the fidelity of their implementation (Stains and Vickrey, 2017), and the assessment tools employed to evaluate student performance.
At our institution, for the past ten years all sections of the introductory general chemistry course for STEM majors have been taught by a set of instructors using a common reformed curriculum and active learning strategies (Talanquer and Pollard, 2010; 2017). All these instructors teach large-enrollment classes (>200 students) using common exams to evaluate student performance throughout the semester. This setup creates a unique opportunity to explore the differential effects of course implementation on student achievement controlling for many relevant variables. Analysis of student performance in common exams across several semesters for the four main instructors teaching the first and second semesters of the general chemistry course at our institution revealed significant differences for students with similar prior academic preparation. Thus, we were interested in characterizing differences in these instructors’ approaches to teaching that could relate to the observed differences in exam performance. Teaching is a complex activity taking place in complex environments, particularly when working with more than two hundred diverse students in a classroom (Biggs, 1993). Many factors can be expected to affect student outcomes. Consequently, rather than looking for specific teacher decisions and actions potentially responsible for differential student performance, we sought to build a more holistic characterization of each instructor's approach to teaching by analyzing the relationships they seek to build with intention in their classrooms. This analysis exposes the complex relations between instructors’ intentions and actions and student performance.
Teaching approaches at the college level that incorporate the practices described above are often grouped under the umbrellas of “active learning” (Lombardi et al., 2021), “evidence-based teaching” (National Research Council, 2015; Mintzes and Walter, 2021), and “pedagogies of engagement” (Smith et al., 2005). Successful instructional models in chemistry, such as Process-Oriented Guided Inquiry Learning (POGIL), Peer-Led Team Learning (PLTL), and Problem-Based Learning (PBL) (Eberlein et al., 2008; Hodges, 2018), as well as approaches categorized as “flipped learning” (Seery, 2015; DeLozier and Rhodes, 2017), purposefully integrate several of those practices to guide student learning inside and outside the classroom.
In interactive learning environments, student learning is affected by the nature of the instructional tasks and educational resources that guide and support the exploration and construction of central ideas while engaging in authentic disciplinary practices (Roberson and Franchini, 2014). Well-designed activities and resources offer students rich opportunities to develop meaningful understandings by applying the type of thinking that is characteristic of the discipline in the analysis of problems of individual, societal, or vocational relevance (Stuckey et al., 2013). From this perspective, meaningful learning takes place when students conscientiously and agentively integrate core disciplinary knowledge with prior knowledge (Ausubel, 2000) by leveraging their personal experiences and cultural and social capitals in the construction of understandings that are relevant to them and the communities in which they live (Moll et al., 1992). Effective instructional tasks engage students in constructive and interactive activities that lead to the creation of shared meanings (Chi and Wylie, 2014). These types of activities often involve students in analyzing data to infer patterns, applying or constructing models to make sense of data, drawing conclusions and building arguments to support them, and generating explanations of issues of interest (Lombardi et al., 2021).
Learning is enhanced when the construction of meanings involves productive interactions between students and between students and instructors. These interactions are fostered through collaborative activity in which students share information and insights, engage in co-constructive conversations in which knowledge is elaborated, and receive prompt, specific, and contextualized feedback that promotes reflection and advances student thinking toward the learning goals (Gillies, 2016; Hodges, 2018). Through these interactions, students adopt the language, practices, and norms of the discipline as they learn to participate in shared endeavors (Van den Bossche et al., 2011; Becker et al., 2013; Moon et al., 2017). Nevertheless, these processes are influenced by students’ prior knowledge and experiences, how they frame in-class tasks and collaborative activity, the feedback they receive, and how their performance is evaluated (Scherr and Hammer, 2009). It is thus critical to develop classroom cultures in which sensemaking and relevant problem-solving are valued, proper resources, structures, and guidance are provided, and intellectual activity is contextualized in meaningful ways for all students (Fitzgerald and Palincsar, 2019).
Learning environments should also be designed to create a classroom climate in which all students feel welcome, respected, and valued (Dewsbury and Brame, 2019; Wilson-Kennedy et al., 2020). Inclusive, equitable, and culturally responsive pedagogies rely on instructional strategies that promote personal agency in the learning process, positively affect students’ self-perception (self-concept, self-efficacy, science identity), create a sense of belonging, and foster metacognition through dialogue, modeling of strategies, and critical reflection (Artze-Vega et al., 2023).
![]() | ||
Fig. 1 The didaktik triangle model for teaching and learning highlighting main relationship pairs (pedagogical, didaktikal, learning) between students (S), teacher (T), and content (Ct). |
There are, however, other important elements and relationships not represented in the didaktik triangle in Fig. 1 that affect teaching and learning in diverse settings. For example, researchers in mathematics (Rezat and Sträßer, 2012) and digital learning (Tall, 1986; Anderson, 2004) have highlighted the central role that artifacts of different types play in mediating the interactions between student, teacher, and content. These artifacts include physical (e.g., textbooks, computers, videos) and non-physical (e.g., visual representations) tools that structure and support the learning process. From an activity theory perspective (Engeström, 1987), artifacts are instruments that mediate students’ learning activity but their use is orchestrated by the teacher. To capture these additional relationships the didaktik triangle has been transformed into the didaktik tetrahedron represented in Fig. 2 (Rezat and Sträßer, 2012). Each of the lateral faces in the tetrahedron encapsulates a different perspective on the role of artifacts in teaching and learning (e.g., the triangle student-artifact-content depicts the instrument-mediated activity of learning).
![]() | ||
Fig. 2 Didaktik tetrahedron representing interactions between students (S), teacher (T), content (Ct), and artifacts (Ar). |
From a sociocultural perspective, the teacher's and students’ actions are mediated by cultural tools that organize and amplify teaching/learning processes through their integration into practice (King, 2012; Geiger, 2014). In this activity system, a variety of contextual factors also influence the interactions between students, teacher, content, and artifacts. Participants’ prior knowledge, experiences, goals, and expectations will affect the social and knowledge dynamics at the class and individual group levels (Reid et al., 2022; Nennig et al., 2023). The placement of the course within a curricular sequence, the academic culture, and the institutional setting will influence the teacher's and students’ goals and decisions. Thus, “context” should also be considered as a major pillar anchoring critical relationships in classrooms.
Based on these ideas, the didaktik tetrahedron can be expanded into the didaktik pyramid depicted in Fig. 3 shaped by five central elements in teaching and learning: students (S), teacher (T), content (Ct), context (Cx), and resources (R). We choose the term “resources” rather than “artifacts” in this representation to make explicit the role of these tools in the learning process and expand the definition to include not only physical but also human resources that may be present in college classrooms (e.g., learning assistants). In this study, we use this expanded representation to propose an intentional–relational model that makes explicit the relationships that effective instructors should intentionally build in college classrooms. The model seeks to highlight that rigorous, inclusive, equitable, and culturally responsive teaching in interactive environments requires building strong relationships between students and the subject matter, between students and their peers, between students and the physical and human resources available to support their learning, and between students, teachers, and contextual issues of relevance to the learners, their communities, and their future professions (Paguyo et al., 2022; Artze-Vega et al., 2023). Quality teaching also demands helping students engage in self-regulation and building relations with their current and future selves, and for teachers to connect with themselves as they critically reflect on their practice.
Our intentional–relational model assumes that the different relationships represented in Fig. 3 cannot be expected to emerge on their own but rather should be built with intentionality. Intentional teaching requires teachers to be deliberate, thoughtful, and purposeful in making decisions and taking actions to achieve their learning objectives and effectively meet the learning needs of all students (Kilderry, 2015). In our model, this demands purposeful planning and intervention from the teacher to create and foster the following relationships:
• Teacher-Student (Pedagogical): Through direct and indirect interactions, teachers build caring connections with their students to help them progress toward the learning objectives, enrich their educational experience, and achieve their professional goals (Friesen, 2017).
• Teacher-Content (Didaktikal): Teachers build and use pedagogical content knowledge (Loewenberg Ball et al., 2008) to design and orchestrate instruction in ways that facilitate students’ construction of meaningful understandings in the discipline and the development of authentic practices in the field.
• Student-Content (Learning): Teachers foster student learning by establishing structures and processes that create multiple and diverse opportunities for learners to actively engage with course content and to receive prompt and specific formative feedback (Lombardi et al., 2021).
• Content-Resources (Design): Teachers purposefully design a variety of educational resources, both physical resources (PR) and human resources (HR), that structure and scaffold student learning of core ideas, practices, and ways of thinking in the discipline.
• Teacher-Resources (Integration): Teachers meaningfully build, gather and integrate physical and human resources into their teaching that support student learning.
• Student-Resources (Interaction): Teachers organize instruction to foster frequent and productive interactions between students and available physical and human resources inside and outside the classroom.
• Teacher-Context (Responsive): Teachers select and organize content, implement instruction, and use assessments in manners that are responsive to their students’ ideas, ways of thinking, and learning challenges (Gouvea and Appleby, 2022), and to their social and cultural capitals (Gay, 2002).
• Content-Context (Relevance): Teachers select content that is individually, socially, and vocationally relevant to students and promotes learners’ intellectual development, socio-scientific literacy, and professional competency (Stuckey et al., 2013).
• Student-Context (Connection): Teachers design and implement instruction that helps students build connections between the subject matter and issues of interest and relevance to them.
• Resources-Context (Inclusive): Teachers intentionally create structures and provide resources that facilitate equitable access to meaningful and relevant learning opportunities by all students and make them feel valued and supported in their learning (Lawrie et al., 2017).
• Student-Student (Regulation): Teachers create opportunities for students to develop and apply self-regulation strategies (cognitive, metacognitive, affective, behavioral) to control and monitor their learning (Zimmerman, 2008; Hartman et al., 2022).
• Students-Students (Collaboration): Teachers design and implement structures and processes that foster productive collaboration of students inside and outside the classroom (Hodges, 2018).
• Teacher-Teacher (Reflection): Teachers intentionally gather information about student learning and interpret it, engaging in reflection-in-action and reflection-on-action (Schon, 1983).
One should expect all these different relationships to be interconnected and interdependent as teaching and learning take place within the didaktik pyramid in Fig. 3. However, their separation facilitates their identification and analysis when characterizing teachers’ intentions, decisions, and actions as we did in this study.
For the past seven years, four full-time teaching faculty have been responsible for teaching most of the sections offered for both General Chemistry I (GC-I) and General Chemistry II (GC-II) (with more than 200 students on average per section). Each of these courses is four academic credits/units with a lecture component (150 min per week) taught by an instructor and a lab component (170 min per week) taught by several teaching assistants. The four main general chemistry instructors follow the same curriculum and course outline and collectively build and apply five common exams during a semester (four midterm exams and one final exam). Their instructional practices also include some shared components. All of them engage students in short collaborative activities during a class, interspersed with periods of lecturing and whole-class discussions. Some of the collaborative activities used by different instructors are similar as they were originally created by the curriculum developers, but over time instructors have also developed their own in-class tasks. Additionally, all instructors assign the same weekly homework and apply the same grading system in calculating final grades. Most general chemistry classes are taught in classrooms designed to facilitate collaborative work, but an instructor may be assigned to a traditional lecture hall from time to time. In the fall of 2020, all class sections were offered online due to the COVID-19 pandemic.
The four main general chemistry instructors get different teaching assignments every semester, so they do not always teach the same course. Since the fall of 2014, they have taught GC I four times (fall 2017, fall 2020, fall 2021, fall 2022) and GC II three times (spring 2021, spring 2022, spring 2023) in the same semester. We collected and analyzed students’ average performance on all common exams during those semesters as part of this investigation. Additionally, we collected demographic and prior performance data for all students enrolled in the targeted courses and semesters. These data included:
• Sex: The UA only reports data for two categories in this area, female (F) and male (M).
• Race/ethnicity: The UA reports only data in which students are designated as one of the listed races/ethnicities. In our analysis, we grouped students into two categories in this area: (1) students reported as White or Asian (WA) typically represented in STEM fields, and (2) students reported as Native Hawaiian or Pacific Islander, American Indian or Alaska Native, Latinx or Hispanic, and African American or Black (NALA), typically underrepresented in STEM careers.
• Academic Preparation: The UA reports students’ academic index (AI) as a proxy for incoming academic preparation. This index is calculated using high school GPA or class rank, and SAT or ACT scores (both math and reading/writing) and reported as a categorical range (e.g., 200–224). We used AI as a measure of academic preparation for students enrolled in GC-I. For students in GC-II, we used their grades in GC-I (reported in a categorical range from D (1) to A (4)) rather than their AI as a measure of incoming academic preparation; GC-I grades are more strongly correlated with second-semester course performance than AI. Given that AI ranges and GC-I grades were not reported for some students, our analysis only included students for whom all information was available.
All student data were collected with the approval of the Department of Chemistry and Biochemistry, the Registrar's Office, and the Institutional Review Board (IRB 2101358224) at the UA. A summary of demographic data for students included in the analyzed sample for each of the four instructors (labeled Inst-R, Inst-Y, Inst-G, and Inst-B) in the targeted semesters is presented in Table 1. Note that the percentage of males decreases considerably between the first and second semester. This is mostly due to degree requirements as many engineering students, who are predominantly male, are only required to take the first course in the general chemistry sequence.
Instructors | GC-I | GC-II | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
# Students | Sex (%) | Race/ethnicity (%) | 〈AI〉 | # Students | Sex (%) | Race/ethnicity (%) | 〈GC-I〉 | |||||
F | M | NALA | WA | F | M | NALA | WA | |||||
Inst-R | 1297 | 58.8 | 41.2 | 38.2 | 61.8 | 229.7 | 1465 | 70.4 | 29.6 | 37.0 | 63.0 | 3.08 |
Inst-Y | 1073 | 56.3 | 43.7 | 34.6 | 65.4 | 236.8 | 729 | 68.7 | 31.3 | 38.1 | 61.9 | 3.08 |
Inst-G | 1121 | 54.6 | 45.4 | 34.4 | 65.6 | 238.5 | 528 | 67.4 | 32.6 | 32.6 | 67.4 | 2.95 |
Inst-B | 635 | 57.6 | 42.4 | 35.6 | 64.4 | 235.0 | 527 | 56.9 | 43.1 | 36.4 | 63.6 | 2.72 |
Overall | 4126 | 56.8 | 43.2 | 35.8 | 64.2 | 234.8 | 3249 | 67.3 | 32.7 | 36.4 | 63.6 | 3.00 |
Given that our main interest in this section is to present trends in performance in common exams of students enrolled in course sections taught by different instructors, we depict in Fig. 4a and 5a linear regression estimates for average exam grades (average over the five common exams in a semester) as a function of incoming academic preparation in GC-I and GC-II, respectively. Average exam grades for GC-I students were grouped into five groups corresponding to the following AI ranges: E (0–174), D (175–199), C (200–224), B (225–249), A (>250), while grades for GC-II students were grouped based on letter grade in GC-I spanning from D to A (students with a failing grade in GC-I cannot enroll in GC-II). Linear regression analyses indicated that the average grade differences between students in the top and bottom performing sections in both courses were statistically significant (p < 0.001), with an average grade difference of 3.9% (0.65 SE) for exams in GC-I and 3.3% (0.67 SE) for exams in GC-II. Notice that, in general, grade differences between course sections become more pronounced for students with lower incoming academic preparation.
We also analyzed the difference in average exam grades between groups of students based on sex and race/ethnicity. The corresponding results are shown in Fig. 4b and c for GC-I and in Fig. 5b and c for GC-II students. In these figures, the Grade Difference based on sex was calculated by subtracting the estimated exam grades for females from the estimated exam grades for males with equivalent incoming academic preparation, while the Grade Difference based on race/ethnicity was calculated by subtracting the estimated exam grades for NALA students from the estimated exam grades for WA students with equivalent incoming preparation. Thus, positive values for these differences indicate a higher grade for males and WA students in each course section. This means, for example, that exam grades in GC-I (Fig. 4b) for male students in the “D” range of incoming preparation were on average 6.0 points higher than those of females in the same range in all course sections, while average exam grades for WA students in the “D” range were 6.5 higher than those of NALA students in Inst-Y's sections and 3.8 points higher in Inst-R's sections. Similarly to what was reported in a prior study (Tashiro and Talanquer, 2021), we found statistically significant differences in exam performance typically favoring males over females and WA students over NALA students in all course sections. The average grade difference was 3.2% (0.41 SE) based on sex and 4.2% (0.43 SE) based on race/ethnicity in GC-I, and 1.3% (0.41 SE) based on sex and 1.8% (0.41 SE) based on race/ethnicity in GC-II. Nevertheless, as shown in Fig. 3 and 4, these differences seem to depend on the students’ incoming academic preparation and the course instructor although the variability in the data limits the interpretation of these effects.
Overall, the cumulative effects of instructor, sex, and race/ethnicity can lead to estimated differences in average exam grades of up to eleven percentage points when comparing the performance of WA males in the highest performing course section and NALA females in the lowest performing course section for students with equivalent incoming academic preparation. The results of these analyses set the context in which the main investigation reported in this paper was conducted.
As illustrated in Table 2, each interview or field note segment was assigned a code or set of codes indicative of the type of components mentioned or acted on by the instructor (students, teacher, resources, content, context) and the relationships that the instructor intended to build, along with arrows showing the direction of the identified relation: unidirectional if only one of the two components seemed to drive or engage in the relationship or bidirectional if both components were involved. The initial segmentation and coding of each interview and classroom observation were carried out by the first author of this study, who then shared the analysis with the second author. This latter author reviewed corresponding codes, marked disagreements, and met with the first author to resolve all discrepancies via mutual agreement. Initially, discrepancies were related to differences in conceptualization of the relationships in the didaktik pyramid in Fig. 3 (e.g., what differentiates a pedagogical from a didaktikal intention, or an inclusive versus a responsive action). These discussions led to a refinement in the definitions of each of these relationships and the application of codes. Given that interview and observation episodes often reflected intentionality in building different relationships in the didaktik pyramid, discussions in subsequent cycles of analysis mostly centered on ensuring agreement in the number and types of codes assigned to a given segment. Additional examples of coded interview episodes and classroom events/actions representative of the different relationships that participating instructors emphasized are included in Appendix B.
Once all coding was completed, the frequencies of codes corresponding to each type of component and relationship were evaluated to determine their relative weight (percentage) in each instructor's verbalized intentions during the interviews and observed actions in the classroom. We used these relative weights to build the visual representations included in Table 3. Components mentioned with a frequency less than 20% were represented using circles with the same size as the “teacher” circle; components mentioned with a frequency between 20% and 30% were drawn using a circle of intermediate size, while components mentioned with a frequency larger than 30% were represented with a large circle. Similarly, arrows with different widths were drawn based on the relative frequency of the relationships inferred during the analysis: (1) 1 pt dotted lines were used to identify emergent intentional relations (0–5%); (2) 3 pt solid lines were indicative average intentional relations (5–10%); (3) 6 pt solid lines represented medium-high intentional relations (10–20%), and (4) 9 pt solid lines were used for high intentional relations (>20%). Finally, we used bidirectional arrows when 50% or more of the relationships identified during the analysis were coded as shaped or influenced by both components; we used unidirectional arrows to represent relationships mostly determined by one component. As can be seen in Table 3, we separated resources into physical resources (PR) and human resources (HR) to better characterize the types of relationships built by different instructors. Some relationships involving resources are frequently bidirectional, like the Interaction of students with resources typically affected by characteristics of both components. Other relationships are frequently unidirectional like the Design of resources mostly determined by the nature of the content. Collaborative relationships were always coded as bidirectional (shaped by people in interaction), while we did not assign directionality to relationships involving only one component (Regulation, Reflection).
All instructors expressed interest and manifested care in helping students succeed and develop as learners beyond acquiring content knowledge (pedagogical relationship), but while instructors Inst-R, Inst-Y, and Inst-G often talked about their interest in empowering students, connecting with them on a more personal level, or engaging in dialogue to address needs (bidirectional relationship), Inst-B frequently took a more authoritative stance describing suggestions or recommendations given to students (in a unidirectional manner) to foster their learning or improve their performance (Scott et al., 2006). The following interview excerpts illustrate these contrasting approaches:
“So, if there's a group so if there's a group that's struggling, you know, my most common response is to go and sit down with them and say ‘hey what's going on here?’ And give them an opportunity to say ‘I have no idea how to start this.’ I'll sit down with them and I never start with just ‘what questions do you have?’ I kind of tend to start with, ‘hi how are we doing today?’ And, and then kind of more organically, let them open up and say, like, I have no idea how to start this.”. (Inst-Y).
“And, again that's just something that I bring up in class as I don't want to address students individually, but I would say it, in a very polite way to the class to stress the importance of engagement. That it is through group interactions, and explaining to another person, that you learn. And I say that to the class all the time.” (Inst-B).
In these representative examples, Inst-Y describes how they seek to connect to students on a more personal level and engage in dialog while exploring the difficulties students may have with the course content. In contrast, Inst-B often described the comments and suggestions that they made to their students to improve their learning. This more authoritative approach to guiding and supporting students, strongly based on providing guidance and direction on what to do without active engagement and dialog with the learners, is reflected in the larger number of unidirectional relationships identified in the didaktik pyramid for Inst-B in Table 3.
All instructors also emphasized the importance of providing resources to students to support their learning (integration relationship in the figures in Table 3). Resources, mainly physical resources and to a lesser extent human resources, played a major role as mediators of learning between each instructor and their students. As illustrated by the following interview excerpt, all instructors highlighted the design (content-resources relationship) and integration (teacher-resources relationship) of a variety of physical resources (PR) such as videos, class notes, past exams, and prep quizzes to help students better prepare for class or exams:
“I mean I just make them [videos] as I think about the content. So for them, I have these videos, that give them an idea about what we'll be discussing, and then, yeah, for example, this is just before the exam. What I did was I put all the things together like we do 1, 2, 3 and six, and then I asked them to use them to review for the upcoming exam.” (Inst-G).
The relationships related to the design and integration of physical resources were mostly unidirectional as the creation of support materials and their integration into the course was mostly informed by the instructors’ beliefs and perceived needs of their students with little input from how students were engaging with those resources.
Inst-R was distinctive for the emphasis expressed and demonstrated in the classroom on integrating human resources (HR) to foster student learning inside and outside class. This instructor invests considerable time and effort in building and working with a large instructional team comprised of dozens of learning assistants (LAs). Although all instructors rely on LAs to support collaborative group work in the classroom, Instr-R has built a technological infrastructure that allows the instructor to quickly communicate with team members in the classroom, gather feedback on student performance during in-class activities, and adjust their teaching on the fly based on the input received:
“And so, this Mike project allows for really rapid communication, so I can help maybe clarify task instructions a little bit or give a few hints if the class is having a difficult time coming up with an answer. So that's the sort of thing that the instructional team will communicate with me” (Inst-R).
Inst-R's instructional team also provides support to students outside the classroom by offering office hours and managing a discussion platform where students pose questions and interact with each other and the LAs. This instructor was the only one who explicitly mentioned using formative feedback from LAs in the classroom to plan for instruction and adjust their teaching in real-time.
All instructors valued not only gathering and providing resources for students but also encouraging and structuring student interaction with these materials (student-resources relationship in the figures in Table 3). This was more evident in the interview and class observations for Inst-G, and somewhat less prevalent for Inst-B who seemed to more frequently point to the existence of physical and human resources without explicitly establishing structures or processes to drive and facilitate their use by the students.
“I slowly build up their knowledge, so that they can tackle similar problems at the intellectual so that's what I usually do” (Inst-G).
The presence of structure or processes that actively engaged students with course content (learning relationship) was more prevalent in the classroom observations, particularly in the case of Inst-R who, for example, always initiated class by engaging students in an activity that required students to apply their prior knowledge (bell work). Inst-R and Inst-Y more systematically used whiteboards to make student work visible to their instructional teams, facilitating formative assessment. Three of the four instructors (Inst-R, Inst-Y, and Inst-G) more explicitly manifested their pedagogical content knowledge by referring to or using strategies in the classroom that facilitated student understanding of targeted ideas (didaktikal relationship). For instance, Inst-Y frequently used analogies to help students understand specific concepts and Inst-R provided heuristics to facilitate problem-solving and enhance student confidence and metacognition. The following interview excerpt illustrates this latter approach when making predictions about shifts in chemical equilibrium:
“So, if I give them a quick trick, they can feel more confident when predicting the shift. And then they can start thinking about Q versus K. And if they get the wrong shift or Q goes in the wrong direction, they're aware that they're wrong and they're thinking, because they have this trick to get the shift. And so, then they can go back and think about where their misconception is or where they're wrong in their thinking in terms of the why. So, all those little tricks are just there to give them a little bit more confidence.” (Inst-R).
No evidence indicative of emphasis or intentionality in the didaktikal relationship was found in the data collected for Inst-B.
All instructors, both during the individual interviews and in the observations in classrooms, referred to and used structures and processes to foster student collaboration during group work (collaboration relationship). This relationship was particularly prevalent for Inst-Y, the only instructor who structured students’ arrangement in groups in the classroom as described in the following interview excerpt:
“So they get a total of three group assignments in my class, the second one, I take their first exam score, and I would take the lowest 50 students out of the bottom 20%. I put them at tables together, which might be controversial, but there is data and evidence out there that suggests that students that are paired with similar you know performance levels, it kind of helps to bring them out of their shells, and so what I would do and I didn't tell them, I always, yeah but those students I would put the closest to me and proximity. And I would make sure to have at least one preceptor split between their table and another so that they would get more specialized attention.” (Inst-Y).
Emphasis on student collaboration was least apparent for Inst-R who teaches in a 550-seat auditorium in which students mostly work in pairs or groups of three. Although the room is designed to facilitate interaction and collaboration compared to traditional lecture halls, group work is more diffuse in this environment.
During the interviews, all instructors also referred to opportunities they create for students to reflect on or evaluate their learning (regulation relationship). As illustrated by the following interview excerpt, these opportunities were often linked to physical resources designed to enhance study skills:
“So, I would have an exam review one week before the exam. And then they can take it an unlimited number of times and the goal is that they get to know what they're missing and need to study more. And now they have a week to fix the problems they have and adopt that for the future.” (Inst-B).
This type of relationship was not explicitly present in the observations conducted in any of the classrooms.
“So I use Socrative [personal response system] and I'll get a sense of where everybody is. With Socrative I can see like ‘Oh, you know 78% of the students got this question right or only 30% of the students got this question right’ so maybe this is something we should talk about.” (Inst-Y).
This relationship was also present in the classroom observations for Inst-R, Inst-Y, and Inst-B. For instance, Inst-B noticed that students had difficulty working on a task and responded in the following manner:
“After visiting several tables, the instructor presented the solution to the task, sharing and discussing the most common issues observed during the interactions” (Inst-B).
In general, all instructors expressed or manifested responsiveness to students’ ideas and learning difficulties (Gouvea and Appleby, 2022), but there were no clear indications of responsiveness in relation to the social and cultural capital that students bring into the classroom (Gay, 2002).
Inst-R and Inst-Y were the only ones who explicitly expressed or engaged in actions in their classrooms that indicated that they purposely adjusted their teaching and resources to facilitate learning and foster the success of all students (inclusive relationship). For example, Inst-R reflected constantly on course pace seeking to ensure that all students were progressing towards the learning goals:
“I would say, usually what I’m thinking about in between, as I know, I need to move on to this material, but I want to make sure that the class has caught up on these main concepts before we move on, otherwise I’m going to leave a huge group behind.” (Inst-R).
And made accommodations to facilitate student participation:
“I do the simultaneous running [in-person and Zoom] because the class is so big. I did have people reach out saying that they had immune problems and didn't feel comfortable coming to the large class and so that was why I decided to do the hybrid Zoom component. And I do have team members in the instructional team in the Zoom chat interacting with the students.” (Inst-R).
Inst-Y created a variety of structures and processes to ensure that all students were aware of the work that needed to be completed to be prepared and succeed in the course:
“After every class I email them. And at the top of the email are things that you need to be doing before the next class. I also provide them with very specific sections of the textbook that I want them to read before class.” (Inst-Y).
These two instructors also more frequently and explicitly referred to the importance of making course content relevant to the students in their classrooms (relevance relationships):
“I am super invested in empowering my students with the ability to think independently. And I try to relate this to what their future career plans are because they're here to build a life for themselves, but they get so caught up in the “ I have to get an A” and I don't want them to forget the big picture.” (Inst-R).
and meaningfully engaging students in thinking about issues of personal and professional interest (connection relationship):
“I spend more time getting them to think about what their experiences have been with something before rather than maybe looking forward. Because I think trying to connect the content to something that they've already witnessed or experienced in their life might have more relevance to them than what their future career might be because they don't know what that looks like always.” (Inst-Y).
While Inst-G and Inst-B manifested the least explicit intentionality in building relationships associated with the “context” component, both were more explicit than the other two instructors in their reflections about teaching (teacher-teacher relationship). Inst-B was particularly reflective on different aspects of teaching practice, including issues related to assessment, student engagement, teaching in-person versus online, and balancing classroom time between providing information and engaging students in activity:
“I noticed in the past that there's this balance… Like spending the whole day on activities and then the time just kind of goes away and you don’t even get to the thermodynamic argument just stay on kinetics, so it has to be a balance. And so, I struggle with wanting to do too much and say too much.” (Inst-B).
Pedagogy (S–T) | Didaktics (T–Ct) | Learning (S–Ct) | Design (Ct–R) | Integrate (T–R) | Interact (S–R) | Responsive (T–Cx) | Relevance (Ct_Cx) | Connect (S–Cx) | Inclusive (R–Cx) | Regulate (S–S) | Collaborate (S–S) | Reflect (T–T) | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Inst-R (I) | xxx | x | x | x | xxx | xx | xxx | x | x | xxx | x | x | x |
↔ | ↔ | ↔ | → | ↔ | ↔ | ↔ | → | ↔ | ↔ | ↔ | |||
Inst-R (O) | xxx | xxx | xxx | xx | xxx | xx | x | xxx | xx | ||||
↔ | ↔ | ↔ | ↔ | ↔ | ↔ | ↔ | ↔ | ↔ | |||||
Inst-Y (I) | xxxx | x | x | x | xxxx | xxx | xx | x | x | x | xx | xxx | x |
↔ | → | ↔ | → | → | ↔ | ↔ | → | → | → | ||||
Inst-Y (O) | xxx | x | xx | xxxx | xxx | x | x | x | x | xxx | |||
↔ | ↔ | ↔ | → | ↔ | ↔ | ↔ | ↔ | ↔ | ↔ | ||||
Inst-G (I) | xx | x | x | x | xxxx | xxx | xx | x | x | xx | |||
↔ | ↔ | ↔ | → | → | ↔ | → | ↔ | ||||||
Inst-G (O) | xxxx | x | x | xxxx | xxxx | xxx | |||||||
↔ | ↔ | → | → | ↔ | ↔ | ||||||||
Inst-B (I) | xxxx | x | x | xxxx | xx | xx | x | xx | x | xx | |||
→ | → | → | → | ↔ | → | → | ↔ | ||||||
Inst-B (O) | xxx | xx | xxxx | xxx | xxx | ||||||||
↔ | ↔ | → | ↔ | ↔ |
From the perspective of our instructional-relational model, Inst-R demonstrated more balanced intentionality in all areas, followed by Inst-Y. These two instructors seemed to consider a broader set of factors while planning and implementing instruction than Inst-G and Inst-B, engaging with students at more diverse levels. Inst-G and Inst-B expressed intentions and actions mostly focused on relationships associated with the triad teacher-resources-students, although they more explicitly engaged in reflection about their practice. Inst-B expressed a strong and genuine interest in supporting student learning and designed and provided multiple physical resources to do so. This instructor's approach was, however, often more teacher-centered. Inst-G expressed less intentionality in contextual matters but manifested very strong pedagogical relationships with students, fostered collaboration in groups, and actively engaged students with a variety of physical and human resources in the classroom.
Our analysis reveals the complexity of teaching activity, where a variety of decisions and actions may influence student engagement, performance, and achievement. In general, students enrolled in the classes of instructors that manifested intentionality in more areas and in more balanced ways exhibited stronger performance in common exams in both GC-I and GC-II. This suggests that intentionality in building a broader set of relationships linked to the “context” component in our model may benefit all students, particularly those with weaker incoming academic preparation for whom differences in performance tended to be larger between course sections. There are, however, marked differences in the didaktik pyramids of all instructors as represented in Table 3, suggesting that different balances in the relationships that instructors seek to build with intention, and diverse ways of enacting them, might be similarly impactful.
Analysis of the differential performance of students based on sex and race/ethnicity as shown in Fig. 4b, c, 5b and c indicate that, in general, performance gaps seem to be smaller in GC-II in the classes taught by instructors with broader and more balanced intentionality, although there is great variability in the data. This may suggest that broader teacher intentionality that attends to contextual issues may also help reduce these differences and attenuate the strong impact that incoming academic preparation has on the magnitude of these gaps. This effect, however, is not consistent across courses, which indicates that other factors are at play and highlights the complexity of this issue. Our data suggests that acting with intention in different areas is not enough to systematically reduce or eliminate the observed gaps in exam performance which are present in all course sections. These results may be indicative of intrinsic biases in the design and use of high-stakes exams as assessment tools that are independent of the type of instruction.
As is the case for all qualitative studies, our analysis and interpretation of the data collected are affected by our knowledge, past experiences, and expectations; thus, our presentation and discussion of results may reflect our personal biases. Analyzing and comparing individual instructional practices using interpretive rather than evaluative lenses is challenging. We sought to objectively recognize and highlight the strengths and limitations in our participants’ approaches to teaching as uncovered by our analytical model, but our personal beliefs about teaching and learning likely influenced what we noticed and the interpretations that we built.
We did not seek to identify causal links between instructors’ decisions and actions and student performance in exams. Thus, our results do not provide insights into how and why specific instructional practices affect the observed academic results. We also recognize the limitations and lack of inclusivity of available performance data that conflates sex and gender, and race and ethnicity, as well as from grouping students from minoritized populations into one category. Disaggregated data in these binary categories shows great variability that limits the interpretation of differential teaching effects. This variability will likely increase with further disaggregation of the data into other subgroups.
In our study, we did not intend either to link observed differences in instructional approaches to instructors’ prior preparation, experiences, or personal characteristics. We have purposely limited the amount of identifying information provided in the paper out of concern for potential misinterpretations of our data using evaluative lenses. We recognize that this decision may limit the insights that can be gained from our results about factors that affect instructional practices.
Our analysis revealed, for example, that all participating instructors were intentionally responsive to the ideas and learning challenges of their students (Gouvea and Appleby, 2022). Nevertheless, none of them manifested significant intentions in responding to the social and cultural capital that students bring into the classroom and in using these resources to engage students and foster understanding (Gay, 2002). These instructors would thus benefit from feedback and access to professional development resources that support the creation of more culturally responsive learning environments. Although all instructors sought to actively engage students in the learning process and manifested strong pedagogical and integration intentions, there was variation in the extent to which they adopted more authoritative versus more dialogical stances (Scott et al., 2006). Recognition of these differences can support the design of interventions that help instructors reflect on their approaches and modify their practices.
Evaluation of college teaching has traditionally relied on student ratings and feedback and judgments by peers based on the characterization of observable instructional actions in the classroom (National Academies of Sciences, 2020). The limitations of these approaches have been the subject of reflection and discussion in recent years, resulting in various initiatives to transform teaching evaluations in disciplines (Andrews et al., 2020). These initiatives provide general criteria and guidelines focused on the analysis of teaching goals, practices, student outcomes, classroom climate, and teacher reflection and growth. Teaching observation protocols, such as COPUS (Smith et al., 2013), RTOP (Sawada et al., 2002), and others (Asgari et al., 2021) provide a detailed characterization of teachers’ and students’ actions in classrooms. These different instruments tend to make explicit the behaviors in which the instructors engage, but not their intentions in terms of building relationships between core educational components. Enriching these measures from an intentional–relational perspective could help better identify strengths and areas in need of improvement to enrich students’ learning experiences.
The results of our investigation also point to the need for research that explores how and why college instructors’ intentions, decisions, and actions affect students’ performance in diverse aspects of a course. Existing research indicates that the opportunities that instructors create for students to meaningfully engage with the course content have a significant impact on their performance (Daubenmire et al., 2015). In our study, all instructors created active and interactive learning environments and genuinely sought to provide their students with resources to succeed. Despite their efforts, performance gaps in exams were present between course sections and significant differences related to sex and race/ethnicity persisted in all cases. If we are to create inclusive learning environments that create equitable learning opportunities for all students, we need to better understand how specific classroom structures and processes affect student outcomes. We also need to reflect on how to support instructors to foster meaningful learning by not only considering and responding to cognitive challenges but also by paying attention to sociocultural aspects and tapping into students' social and cultural capitals.
Due to the interconnected and interdependent nature of the different relationships highlighted in the didaktik pyramid in Fig. 3, their identification and characterization in independent ways, as approached in this study, is sometimes challenging. That may impose limitations in the application of our intentional–relational model as a tool in the analysis of teacher thinking and practice. Nevertheless, we believe our model helps make explicit the complexity of student-centered teaching and its connection to student performance.
2. How long have you been teaching at the college level?
3. How long have you been teaching _____ class?
5. What do you see as critical structural components of your lessons that help students to develop understanding of the concepts or ideas that you want to target?
7. What structures or resources or strategies do you use in the classroom to engage, support, facilitate, foster student understanding (explore use of classroom layout, learning assistants, physical resources, technology, etc.)
• What do you do to encourage work on homework?
• What do you do to encourage reading the textbook or reviewing course content or prepare for class?
• What do you do to encourage work on lab?
• What do you do to encourage and facilitate exam preparation/success?
• What other areas do you purposely target and why?
Relationship | Interview episode | Observation event/action |
---|---|---|
(S–T) Pedagogical | “I try to be more of a butterfly because I don't want to get trapped into a table. Obviously, that makes the time go away, so I try to be a butterfly and I answer questions from students, but then I need to go around and hear what others are doing.” (Inst-B) | The instructor uses positive reinforcement when listening to student responses. (Inst-Y) |
(T–Ct) Didaktikal | “Based on what I listen in the classroom I try to do video notes. I mean, for example…I see that students struggle using line structures. So, I make a separate video where I show step by step how to build them.” (Inst-G) | The instructor makes sure to present the reasoning behind the answer to the question posed (justifying a shift in chemical equilibrium). (Inst-R) |
(S–Ct) Learning | “When I am in the classroom, I tell them what I want them to know by the end of that lesson… And then, sometimes I present an example that is representative of what they should be able to do after the lecture so that they know the objective of the lesson.” (Inst-G) | The instructor does not only present her explanations to the specific topic. The instructor presents a generalization to show that students can use the strategy or reasoning in other situations or tasks. (Inst-Y) |
(Ct–R) Design | “I started making short videos. Just to maybe it started with like this activity in class was an absolute disaster and so I'm going to make a five-minute video where I walk through this activity and hopefully the students can watch this and get clarification.” (Inst-R) | — |
(T–R) Integration | “And sometimes I take the approach of I’m not the tutor in the classroom, I’m the manager of the classroom and so sometimes I will grab a preceptor and say, hey would you mind coming over here and helping them?” (Inst-Y) | During the lesson, the instructor and team members walked around the classroom while students complete tasks (Inst-B) |
(S–R) Interaction | “So we have office hours, and then I would take the questions that were asked in office hours, and then I would work on them on a video and post it…so students who want to work out problems can come to office hours and students who want to talk about chemistry at 3 AM they can look at the video.” (Inst-B) | The lesson started with a quiz/task where students worked in groups while team members approached some tables and used the whiteboard to help students complete the task. (Inst-G) |
(T–Cx) Responsive | “I also have a subset of my learning team that's the polling team, so they do student driven polls and I get a lot of information from the student responses in there as well… My team puts them together and then my team organizes the results, and then I use a “Discord” channel and they'll give me the results in that discord channel. And so I can utilize those in conjunction with everything to kind of figure out the main confusions the best way that I can” (Inst-R) | After visiting the tables, the instructor explained the solution to the task, sharing what was the most common problem detected within the groups (Inst-B) |
(Ct-Cx) Relevance | “I think about it, like we talked about medicines. You know, like we talk a lot when you're dealing on a consistent basis with painkillers. And you know where they exist on the spectrum of acids versus bases, so kind of that context, or that it matters you know whether it's likely to be absorbed or not in different parts of the body.” (Inst-Y) | The instructor tells students the utility of the chemical compound mentioned in the task. (Inst-Y) |
(S–Cx) Connection | “And all of that is the power of this chemistry class because also so many of them are saying I’m never going to use chemistry again, why do I care about this. Well, you should care about this, because I'll give real life examples, this is how straightening your hair works or this is how a Perm works if it intersects with the information. I’m just trying to teach you how to think so that whatever discipline you're going into” (Inst-R) | Students worked collaboratively in an activity comparing the pH of two different solutions of well-known pharmaceutical drugs (Tylenol and Aspirin). (Inst-R) |
(R–Cx) Inclusive | “I feel like there's two main groups of students. There's those who have no idea where to start. That group just try to jump to this complex answer, and then they put themselves into a black hole where they just don't think they know anything anymore, because they just don't know how to organize the material. So, I help them to take a step back and organize what they have in a way that allows them to answer the questions.” (Inst-R) | The environment created by the instructor using a more informal language, jokes or telling personal stories to the students creates a relaxed environment, where students laugh and work. They seem to feel free to ask any question. (Inst-Y) |
(S–S) Regulation | “I ask my students to think about the questions they missed. And then, how to not to make the same mistakes again. I call this an exemplary reflection.” (Inst-G) | — |
(S–S) Collaboration | “I tried to instil a sense of grace and compassion with my students. I expect students to work in groups. I assign those groups and as a function of that I set up their group work with an attitude of nobody's perfect, we are all imperfect humans, nobody knows anything. And we have to understand that when we're walking in here perfection is not the expectation, but also that we don't know what anybody's been through in any given week month year lifetime.” (Inst-Y) | Students are engaged and discussing the tasks in small groups. (Inst-G) |
(T–T) Reflection | “If I had to self-evaluate the reason why students are being successful and engaged is because of the “Let's Think” activities. Students working on them and us providing that space and time.” (Inst-B) | — |
This journal is © The Royal Society of Chemistry 2024 |