Erin M.
Duffy
*a and
Melanie M.
Cooper
b
aDepartment of Chemistry, Western Washington University, 516 High St – MS 9150, Bellingham, WA 98225, USA. E-mail: duffye@wwu.edu
bDepartment of Chemistry, Michigan State University, 578 South Shaw Lane, East Lansing, MI 48824, USA
First published on 2nd September 2019
Inquiry-style laboratory courses, in which students engage in open-ended projects rather than a prescribed set of experimental steps (“cookbooks”), are becoming increasingly popular at the undergraduate level. Reformed curricula require reforms in training teachers; in the case of large universities, laboratory instructors are typically graduate teaching assistants (TAs). The General Chemistry Laboratory courses at a large, public, research-intensive university in the Midwestern region of the United States recently underwent a transformation from a “cookbook” to a project-based lab, and despite efforts to improve training, TAs continue to express difficulty teaching the course. To determine the source of these difficulties, we conducted multiple video observations and semi-structured interviews with seven TAs throughout one semester. We report TAs’ beliefs about what is expected of them, their philosophical alignment to perceived expectations, and a comparison of the Lab Coordinator's expectations to TAs’ actual teaching practices. We found that the TAs generally agreed with behaviors they were expected to perform, but responses to actions they were not supposed to do indicated that they were unsure of what the Lab Coordinator expected and personally believed that an ideal TA would perform those actions. This work highlights a need to clearly communicate the aims and expectations in a course and the rationale for those choices.
1. Asking questions and defining problems
2. Developing and using models
3. Planning and carrying out investigations
4. Analyzing and interpreting data
5. Using mathematics and computational thinking
6. Constructing explanations and designing solutions
7. Engaging in argument from evidence
8. Obtaining, evaluating, and communicating information
The General Chemistry Laboratory (GCL) course sequence discussed in this work uses an adaptation of the Cooperative Chemistry curriculum (Cooper, 1994; Sandi-Urena et al., 2011a, 2011b), which extensively incorporates scientific practices (Carmel et al., 2017, 2019a). This curriculum was originally developed by the second author in the early 1990s but was adopted by the institution's Department of Chemistry in 2015 concurrent with a transformation of the General Chemistry lecture curriculum (Cooper et al., 2012; Cooper and Klymkowsky, 2013; Williams et al., 2015; Underwood et al., 2016). Adoption and adaptation of Cooperative Chemistry at this institution were led by a new General Chemistry Laboratory Coordinator and a former postdoctoral research associate in the second author's research group. The second author provided the curricular materials as used at the originating institution, and the adoption leaders independently adapted the materials for use at this institution.
In Cooperative Chemistry, students work in small groups of 3 to 4 members on multi-week projects to investigate questions or to solve problems posed by scenarios that are designed to show the application of the kinds of problems to which the students are responding. Students are required to determine what needs to be done to solve the problem, design experimental procedures, perform experiments, analyze and interpret experimental data, make arguments about what the data means, and report findings for each project. These projects and the extent to which students engage in various scientific practices for each project has been described previously (Carmel et al., 2019b); for clarity, brief project descriptions for the experiments observed in this work are shown in Table 1 with more details provided in Appendix 1.
Course | Title of project | General goals for each week |
---|---|---|
GCL1 | Identification and synthesis of an unknown ionic compound | • Week 1: Conduct qualitative tests to determine the identity of an unknown ionic compound |
• Week 2: Confirm identity by conducting additional tests and comparing to known sample | ||
GCL1 | Food dye spectroscopy | • Week 1: Experimentally determine the following relationships: wavelengths of absorbance vs. apparent color, intensity of absorbance and concentration. |
• Week 2: Identify the dyes present in a sports drink and create a solution that mimics the color profile of the drink | ||
GCL2 | Soaps and detergents | • Week 1: Synthesize soaps and detergents from various starting materials |
• Week 2: Standardize acids/bases for use in analyses of wastewaters (filtrate after isolating soap/detergent) | ||
• Week 3: Analyze wastewaters from synthesis and determine “best” soap/detergent out of those synthesized | ||
GCL2 | Artificial kidney stones | • Week 1: Synthesize various water-insoluble salts that are typical of kidney stone composition |
• Week 2: Compare various methods of dissolving the salts and determine the “best” method to combat kidney stones |
However, while students have the opportunity to use scientific practices in the laboratory, doing so in the context of chemistry is nontrivial. As is common in large universities (Luft et al., 2004), graduate teaching assistants are responsible for teaching undergraduate students in the GCL courses at this institution. Since the transformation of the laboratories, the department has increased time for TA training, and efforts have been made to better prepare TAs so that they can facilitate learning in our reformed courses. While some of these efforts have been led by the authors of this work, not all of these training opportunities were specific to GCL TAs. These general and lab-specific trainings are described in more detail in Appendix 2.
Despite this added preparation, TAs continued to express having difficulty with teaching the laboratory. Some of these difficulties may be because the prior laboratory course was much more traditional in nature, in which the TA instructed, rather than guided, students who worked on one-week exercises by following a given procedure to produce a known outcome. The shift to a different type of teaching and learning experience posed a challenge for experienced TAs who had become accustomed to teaching “cookbook”-style labs; however, new TAs also expressed difficulties with teaching the laboratories. TAs’ continued struggle suggests a need to provide increased and/or improved support.
Because TAs’ instructional practices are influenced by their beliefs about teaching and learning (Volkmann and Zgagacz, 2004; Rodriques and Bond-Robinson, 2006), we first need to understand what our TAs think if we want to better support them (Wheeler et al., 2015). For TAs specifically, others (Luft et al., 2004; Boman, 2013; Flaherty et al., 2017; Wheeler et al., 2017c; Mutambuki and Schwartz, 2018) have extensively studied the impact of training activities on TA beliefs, which suggest that the messages received from training are important. More broadly, instructors in higher education (tenure-track faculty and nontenure-track instructors) form their beliefs from a variety of experiences: prior experiences as teachers, as students, as researchers, and from non-academic roles (Oleson and Hora, 2014). Although TAs may have fewer prior experiences as instructors than faculty, TAs’ views are also shaped by their teaching experiences (Wheeler et al., 2017c). Particularly relevant to this study, TAs tend to hold different views about teaching if they lead inquiry-based labs than traditional labs (Sandi-Urena et al., 2011a). However, even if TAs agree with the ideas behind reformed courses, studies in biology (Addy and Blanchard, 2010) and physics (Goertzen et al., 2009; Wilcox et al., 2016) education have shown that beliefs do not necessarily translate into practice.
An additional complicating factor for graduate TAs is that they play hybrid role of students and employees of an institution. Although the legal status of graduate assistants in the U.S. varies by institution type (public vs. private) and across states (Flora, 2007), the TAs in this study are recognized as university employees with union representation. To our knowledge, the impact of the supervising instructor on TAs’ instructional practices in the teaching laboratory has not been studied. However, it is an important aspect to consider because TAs are obligated to carry out their teaching assignments according to the wishes of their supervisor. This is true regardless of TAs’ personal beliefs or whether or not the supervisor's directions are informed by research on teaching and learning. Indeed, it may be more broadly relevant to investigate the impact of a teaching supervisor who is not an expert in teaching and learning because it is a likely scenario; as the American Chemical Society Commission on Graduate Education reported, graduate student teaching “experiences generally are not drawn from carefully crafted programs designed to teach students how to teach” (American Chemical Society (ACS), 2012). With this in mind, we sought to determine the relationships between TA behavior, TAs’ personal beliefs, and TAs’ perceptions of their supervisor's expectations by conducting in-lab observations and interviews with chemistry laboratory TAs. Our work was guided by the following research questions (RQs):
1. What do TAs believe their teaching supervisor expects of them?
2. How do TAs’ beliefs about teaching and learning compare to expectations?
3. How do TAs’ actual teaching behaviors align with their supervisor's expectations?
The General Chemistry Lab Coordinator (henceforth referred to as the Lab Coordinator), a PhD-level chemist, had been hired specifically to lead the GCL course transformation from “cookbook” labs to Cooperative Chemistry labs. This study took place during the third year of the Lab Coordinator's tenure as leader of the GCL courses.
The timeline of data collection is shown in Table 2. TAs were recorded during two laboratory sessions. The first recording (Observation 1) took place during week 7, when lab students were finishing the project on which they would present their findings in a formal lab report. The second recording (Observation 2) took place during the project on which students would report their findings in a poster presentation, weeks 11 and 13 for GCL1 and GCL2, respectively.
Pseudonym | Course taught | Prior GCL TA experience | Year in PhD program | International student? |
---|---|---|---|---|
Giovanni | GCL1 | 0 semesters | 4 | No |
Koga | GCL1 | 1 semester | 1 | Yes |
Surge | GCL1 | 2 semesters | 2 | No |
Brock | GCL2 | 3 semesters | 2 | No |
Erika | GCL2 | 3 semesters | 2 | Yes |
Misty | GCL2 | 1 semester | 1 | No |
Sabrina | GCL2 | 2 semesters | 3 | No |
The first round of interviews (Interview 1) took place 7–10 days before the second recording; thus, GCL1 TAs were interviewed earlier than GCL2 TAs and in closer proximity to the first classroom observation. The second round of interviews took place after the second video recording but before the end of the semester, at the convenience of the TAs.
Thus, the RIOT was suitable for the present study because it distinguishes between types of student-TA interactions by intellectual contribution to the conversation (i.e., Open vs. Closed Dialogue and Listening to Student Question—see Table 3 for further description of all codes in the RIOT). This tool probes objectively observable behaviors, rather than behaviors interpreted as inherently valuable. It also allows for characterization in real-time rather than within the constraints of 2-minute intervals in which an instructor could perform multiple different actions. Finally, the RIOT was developed in the context of a transformed course (West et al., 2013), and was adapted in a similarly structured study about TAs for a physics course (Wilcox et al., 2016), providing precedent for its use for the purposes of this study.
Week # | GCL1 | GCL2 |
---|---|---|
1 | TA training | TA training |
3 | Labs begin | Labs begin |
6 | Spring break | Spring break |
7 | Observation 1 | Observation 1 |
9 | Interview 1 | No data collected |
11 | Observation 2 | No data collected |
12 | No data collected | Interview 1 |
13 | Interview 2 | Observation 2 |
14 | No data collected | Interview 2 |
15 | Labs end | Labs end |
The RIOT may be applied using an open-source web application (Paul and Reid, n.d.). Via a graphical interface, the user selects the applicable code at the start of each action, and the application records the time in seconds between clicks. For example, if “Student Question” is clicked, followed by “Explaining Content” two minutes, the application would record that this instance of “Student Question” lasted for 120 seconds. One limitation of the web application is that it allows for only a single action to be selected at any one time. That is, if a TA was engaging in Closed Dialogue in which they were Clarifying Instructions to a student, only one of those codes could be selected for that timestamp. Priority was given to the type of conversation over the content of conversations; therefore, in the aforementioned example, Closed Dialogue would have been coded, not Clarifying Instructions.
The actions coded with descriptions and examples of when each code applied are provided in Table 3. This list includes all but two actions that are present in the RIOT. “Students Talking Serially” was omitted because it involves whole class discussions, which do not occur in this laboratory setting, and “Student Presentation” was omitted because presentations were not scheduled during the laboratory sessions recorded.
The first author coded all 14 videos, and another researcher coded two of them to confirm that the RIOT protocol was applied in an understandable and replicable manner. As a measure of inter-rater reliability, the intraclass correlation coefficient (ICC) (Koo and Li, 2016) was used to compare the coders’ percentage distribution of each RIOT code per video. Using SPSS 25, the calculated ICCs (two-way mixed, single measures, absolute agreement, 95% confidence interval) for the initial coding attempts were 0.562 and 0.680, indicating moderate reliability. After discussion and recoding, the calculated ICCs for the two videos were 0.931 and 0.951, indicating excellent reliability.
The second interview focused more specifically on the types of interactions coded in the RIOT, where we discussed TAs’ responses to the RIOT worksheet. In particular, we were interested in the comparison of TAs’ “Ideal TA” responses and “Course Instructor” responses, “Ideal TA” and “Student” responses, “Ideal TA” and “Actual TA” responses, and “Actual TA” responses and the coded videos. The interview protocols associated with each round of interviews are included in (Appendices 5 and 6); however, as these were semi-structured interviews, the questions may not have been asked verbatim or in the order in which they appear in the protocol.
All interviews, except one, were transcribed by an external freelance transcription service (Rev, n.d.) and proofread by the first author for accuracy. The remaining interview was transcribed by the first author. When analyzing the transcripts, all excerpts related to any of the RIOT codes were first selected for closer analysis. While most of these excerpts came from the Interview 2, when TAs were explicitly asked to discuss their beliefs about the RIOT codes, any spontaneous discussion of behaviors that fit the definition of a RIOT code was included for analysis. Next, we sorted these excerpts by which RIOT code was the subject of the excerpt. For each RIOT code, the excerpts were sub-grouped into two categories: those that represented TAs’ interpretation of the Lab Coordinator's expectations, and those that represented their own personal ideals. These two groups of excerpts were further divided based on if the quotes suggested support for spending a Substantial amount of time or Minimal amount of time on the corresponding action. A third researcher, who had prior experience studying laboratory TAs but was not directly involved with this study, read the interview transcripts to confirm appropriate selection and interpretation of quotes. These groupings of excerpts allowed us to find reasons why TAs agreed or disagreed with certain actions, or with what they perceived to be the Lab Coordinator's expectations regarding an action. Commonalities among responses allowed us to identify any emergent themes. For example, TAs’ discussions about wanting to spend a Substantial amount of time Explaining Content while simultaneously considering the Lab Coordinator's expectation that they spend a minimal amount of time Explaining Content, led us to see TAs feelings of tension between wanting to meet the Lab Coordinator's expectations and wanting to help students succeed as a pervasive theme.
RIOT code | Definition |
---|---|
Lecture-like actions | |
Clarifying Instructions (CI) | TA talks at class about goals for the day, safety instructions, assignments that are due, etc. |
Explaining Content (EC) | TA writes and/or talks about chemistry concepts or algorithms for calculations without student input (e.g., performing calculations on chalkboard) |
Individual/small group conversation | |
Student Question (SQ) | Student-dominated conversation: TA listens to student's question(s) and may provide short verbal or nonverbal responses (e.g., nodding) |
Closed Dialogue (CD) | TA-dominated conversation: TA tells students what to do or talks at length with little-to-no student response |
Open Dialogue (OD) | Balanced conversation: TA and student both contribute full sentences to dialogue. |
Observation behaviors | |
Passive Observing (PO) | General observation: TA scans or paces classroom without focusing on any particular group. Ranges from occasionally looking up from phone to slowly walking the aisles while glancing at students. Coded as default interaction when camera did not adequately follow TA (i.e., if there was no conversation recorded but one could not see what the TA was physically doing). |
Active Observing (AO) | Targeted observation: TA stops at one group's bench and observes the students’ interactions and/or individual member's actions. Interaction is limited to “check in” behavior, e.g., “How's it going?” with a short response (“We’re fine”) from student(s) before the TA moves along. |
Other actions | |
Administrative/Class Prep (CP) | Includes logistical noninteractive TA responsibilities, e.g., locking/unlocking drawers, cleaning up acid/base spills or broken glass, using the computer to request reagents, etc. A subcode under “Not interacting” in the RIOT. |
Working on Apparatus (WA) | TA physically manipulates experimental or computational equipment, e.g., adjusting a vacuum filtration setup, setting parameters for data acquisition, acquiring solvents for students. A subcode under “Not interacting” in the RIOT. |
Not Interacting (NI) | TA is not doing any of the above. Typically includes when TA was out of room (e.g., left for the restroom or was in the lab when all students were working up data or planning documents in the hallway) or talking to non-students (e.g., the lab technician). |
RIOT code | Perceived expectations (# out of 7 TAs) | Ideal TA actions (# out of 7 TAs) | ||||||
---|---|---|---|---|---|---|---|---|
Minimal | Substantial | Minimal | Substantial | |||||
None | Low | Med | High | None | Low | Med | High | |
Clarifying Instructions (CI) | 0 | 2* | 3 | 2 | 0 | 3* | 2 | 2 |
Explaining Content (EC) | 0* | 3 | 4 | 0 | 0* | 0 | 6 | 1 |
Student Question (SQ) | 0 | 0 | 2* | 5 | 0 | 0 | 1* | 6 |
Closed Dialogue (CD) | 0 | 5* | 2 | 0 | 0 | 6* | 1 | 0 |
Open Dialogue (OD) | 0 | 0 | 0* | 7 | 0 | 0 | 1* | 6 |
Passive Observing (PO) | 0 | 0 | 6* | 1 | 0 | 1 | 3* | 3 |
Active Observing (AO) | 0 | 1 | 3* | 3 | 0 | 1 | 4* | 2 |
Classroom prep (CP) | 0 | 3* | 1 | 3 | 0 | 4* | 1 | 2 |
Working on Apparatus (WA) | 0 | 4* | 2 | 1 | 0 | 1* | 3 | 3 |
Not Interacting (NI) | 2* | 5 | 0 | 0 | 1* | 5 | 1 | 0 |
In addition to safety reasons, some of the TAs suggested that it was their responsibility to make students feel comfortable asking questions. For example, Erika said, “You should be able to let them approach you with questions”—that is, TAs should make themselves approachable so that students will be unafraid to ask for help. Brock made this point clear and said, “You want to be able to interact with them when they have questions or make them feel like they can come up and ask questions,” because if students feel like they can’t initiate conversations with the TA, then they might not ask for help when they need it. Koga believed that this happened during his first time teaching the course and referenced a student evaluation from the previous semester, where the comments suggested that a group of students didn’t feel comfortable asking him questions:
KOGA: [Listening to student questions is] actually a respect to them, [and] it could be due to my last semester's student evaluation. One student … said that I didn't help their team at all, and they figured out the case mostly by themselves… I cannot remember if I don't really help any teams. It's let me feel a little bit down, so in this semester I make sure I at least listen to their question.
GIOVANNI: They need to have something to go off of. They need to have some sort of starting point … I used to think, at the beginning of this course, that you give everyone the same starting point. But I've grown to think that's not true, because you just simply have some groups that just are at a different level than others, whether that's because they have one person that's like really knowledgeable, because whatever reason, right? … Now I just sort of ask them, “Where are you guys at? What are you guys doing?” Then from there, I try to give them a little bit of something to guide them the right way.
Giovanni's comment is particularly astute. His words demonstrate that he has reflected upon his teaching, considered whether or not giving the same instruction was equally helpful to all groups, and modified his approach appropriately. While most of the TAs said that Open Dialogue involves giving students a launching point for productive thinking, Giovanni explicitly mentioned his strategy to figure out where a suitable launching point might be. Given that Giovanni had not previously taught this course—indeed, his previous lab TA experience was in a “cookbook”-style lab—it is especially impressive that he came to this realization and adjusted his teaching accordingly while still learning how each of the projects and the course overall worked.
In contrast to Surge's opinion, those who thought Active Observing was an ideal behavior indicated that paying closer attention to a particular group enabled them to better gauge student progress, understanding, and group dynamics. For example, Erika said that through active observing, she can “make sure they aren't frustrated” and determine whether “they [are] all working, [or] is it one person working?” Despite this, she acknowledged Surge's concern about making the students nervous by observing them too closely: “They say I'm intimidating, staring at them … I wouldn’t want my PI [Principal Investigator] watching me all the time [so] I don't think they want me there all the time,” which is why she said Active Observing should be done at “a medium level.” Indeed, many of the TAs mentioned this concern and that they needed to find a good balance, instead of exclusively choosing a passive or active approach to observing.
In contrast, Erika thought the students “love” closed dialogue “because they would rather have me do all the hard work and then come up with a nice answer for them to type.” Despite the perceived desire of her students, she argued against closed dialogue “because then they don’t think at all … I don't think that's helpful for them, intellectually. They are not learning to think.”
However, 6 of 7 TAs believed that it would be most helpful to spend a significant amount of time with hands-on assistance with experimental setups and techniques. Many of them stated that this was for safety reasons; if students do some techniques incorrectly, they might hurt themselves or others. While students are provided with videos that demonstrate various lab techniques, and the instructional team tries to minimize hazards in our labs by using common water-soluble salts, dilute acids and bases, or typical cooking ingredients (e.g., commercial food dyes), TAs still worried about students’ misuse of materials. For example, Sabrina mentioned this with respect to titrations:
SABRINA: I think it's always important to do it the first time they're using something, especially with titrations, setting the burettes up, showing them how the stopcock works. Make sure this is perpendicular; otherwise you're gonna have NaOH all over the floor… How to actually fill the burette properly—that keeps you safe so you're not pouring NaOH over your head, those things.
In addition to safety, Misty, Erika, and Sabrina also cited a need to conserve resources, that is, to avoid breaking equipment. However, they had different opinions on how involved a TA should be in the setup for more complicated techniques. Misty preferred a more hands-on approach and suggested that equipment, such as for vacuum filtration or titrations, should be set up for students by TAs:
MISTY: It's just easier if it is already set up, and then I just have to show them how to do it … I feel like the more time I spend working on it, the less time things are gonna end up broke [sic] … These [students] are looking for an in-and-out, and they don’t care if stuff gets broken. They don’t care if stuff is all over the place, and that's why I think it’d just be easier in a class like this to kind of do it [for them].
It appears that Misty had less faith in her students than did fellow GCL2 TAs Sabrina and Erika, who seemed more confident in allowing students to set up these techniques after being shown a first time:
SABRINA: I don't think it's the responsibility of the TA to set things up like that every single time. I do think that because you're taking responsibility for the class while you're teaching it, you need to check and make sure they're set up properly … You're walking around anyways; just look and make sure.
ERIKA: The next step they're taking might be orgo, so they should be able to know how to filter stuff properly. I want to give them that training … I only do it once and then I just, “You remember how I did it last time; why don't you do it now?”
As Erika noted, it may be important to help students learn these techniques so that they are prepared for future courses they might take. Although most of the students who take this course are not chemistry majors, a large fraction are life sciences majors or pre-health students (Appendix 7), who may need to take organic chemistry lab, as Erika suggested, where the ability to perform common lab techniques could be helpful.
Interestingly, none of the TAs mentioned that video tutorials of various lab techniques are provided to students in the electronic lab notebooks, and the background information for each project lists potentially useful techniques that students may want to review. Given the common concern that students could not safely perform complicated techniques, this suggests that these TAs and students were not fully embracing all of the resources available to them. Was their availability not communicated to TAs, or did TAs not encourage their students to use them? Were the resources hard to find or difficult to understand? Without the TAs’ discussion of the resources, we can only speculate about why they may not have been used.
However, the misalignment was more often a disagreement, rather than a miscommunication, between TAs and the Lab Coordinator about how to best support students. A recurring theme in the TA interviews was a tension between wanting to meet perceived expectations and wanting to help students move forward even after preferred teaching strategies seem insufficient. Some of the TAs, like Giovanni, agree with the Lab Coordinator's expectations only in an ideal situation or with the strongest students. In a typical case, however, these TAs believe that most students need more help understanding the task at hand than TAs believe they are expected to give. As Erika says, sometimes the students truly put in the effort, but “sometimes they understand what they have to do, but they really don't know how to put it together, so you should spend more time on content.” As Giovanni says, “It's a nice idea that these kids should be able to produce these thoughts on their own, but, from my experience, it's really rarely the case that you have a student that's just ready to go who gets it.”
The Lab Coordinator suggested that “proper planning” should eliminate the need for TAs to explain content, but Brock disagreed. As he said, the students “can plan it right, but if they're not understanding why they're doing it, this lab style is no better than, ‘Here's a list of directions.’” In his opinion, one can put together a viable plan to answer the questions posed by the project, but if they don’t understand the rationale behind the procedures, then they won’t gain anything from the planning phase of the experiments, making it no different than a traditional “cookbook” lab. For example, one GCL2 project involves standardizing a solution of NaOH, which they then use for titrations the next week. While the students could successfully execute these procedures in lab, three of the GCL2 TAs mentioned that their students often did not understand why the standardization was needed. Brock said that he realized after the lab period, while helping students with formal lab reports, that they did not know the purpose of these experiments: “When they're writing their papers, they don't quite get the connection between the standardization and then their [analyte] titrations… [They] come in my office hours to … [ask], ‘Why did we need to do this? I don't understand how week two [standardization] connects to week three [analyte titrations].’” This indicates that students could look up how to do a standardization, write down those steps in a planning document, and follow those instructions, but it did not help students understand how the task fit in with the overall project.
The above example shows that explaining content may be needed outside of the experimentation phase, e.g., when students are planning procedures or analyzing data. As a general rule, Sabrina said that explaining something to students instead of trying to get them to figure it out is acceptable when they ask about something “that's more context and not just procedure.” Still, she emphasized that it is important that students first try on their own: “After they’ve looked something up, if they still have a question or they’re interested in it, then you should definitely engage. But I think that it's their responsibility to actually look these things up and use the resources they have so that they get that skill for the future.”
Erika and Giovanni mentioned that mathematical tasks are often a stumbling block, such as determining amounts of reagents to use in preparation for an experiment or performing calculations on data to analyze results. In these situations, Giovanni thought lecturing at the board to show the math would be more helpful; however, he only wanted to do this if students already figured out what type of manipulation they wanted to do but struggled with doing the arithmetic:
GIOVANNI: [If] it's something that we've already arrived at due to a conversation, then I do go to the board because I feel like there's some things I can wave my hands around, and it just doesn't make any sense. So even if I were like, “You do this, and you carry, and you move this over” … I might as well be speaking gibberish to them.
Sabrina and Giovanni both indicated it was only after the students used available resources to try to make progress independently and after they tried to guide students in the right direction through discussion that they would turn to providing an explanation or worked example on the chalkboard. However, they both mentioned that they believed the Lab Coordinator did not want them to do this. This tension between wanting to meet the Lab Coordinator's expectations and wanting to help students succeed was summarized by Erika:
ERIKA: It's [hard] because I do know what is expected of me, and I know what I shouldn't do, but the requirement of the student is so different … It's entirely up to [the students] to figure out, but … [it's] so hard for them. So then it's a very difficult situation for the TA, because you know you're not supposed to do this [help too much]. You know that if you don't do it, they're completely clueless, so there's this side push you always have to give. In the meantime, you know it's not right, so you have to restrain yourself from doing more … You don't want to get them to feel frustrated, so you always have to struggle with the … situation.
TAs indicated that Working on Apparatus would also vary from week to week based on specific experiments. Most said they tended to provide more hands-on assistance to students if they were performing a new technique. Because the observed labs did not involve new techniques, this may account for the relatively low frequency at which this was observed.
ERIKA: You ask the questions to prompt them, but they're clueless. Then you have to give them a little bit more, still clueless. Then you go a little bit more, and ultimately, it's like you're the only one talking. I have to tell them, “Guys, this is not working,” but I have to give them something … You know this is not ideal, but you are just trying to make them talk.
Despite this, Erika, like most of the others, actually spent little time in Closed Dialogue. Koga was the only TA who spent a relatively high amount of time in Closed Dialogue, but this may be a limitation of the coding scheme. Because Closed Dialogue was coded when the TA dominated the conversation, Koga pointed out the amount of time he spent speaking depended upon his ability to efficiently express his thoughts in English:
KOGA: I think I am still training how to make all the things clear at one time, so later I’m going to be like the native TAs and just use one sentence that explains all the things, but now so far [I] need to use two or three or four sentences to explain the same comments.
As a first-year non-native English speaker, Koga had relatively little experience with communicating in English. He suggested that with practice his comments to students will be more concise, but until then he might need to use more words until he finds a suitable way to say what he means. Thus, we believe that coding may be biased toward Closed Dialogue instead of Open Dialogue when a TA has weaker English-speaking skills.
When asked, several TAs indicated a reluctance to observe the groups individually (Active Observing) because they thought it would make the students feel nervous to have the TA “over their shoulder”. Alternatively, the difference may simply be an attempt to exert less effort. As Erika notes, teaching lab is “physically exhausting” because it involves hours of walking and talking. For some TAs, Passive Observing allows them to remain in one location while still paying attention to students’ progress and safety.
However, Sabrina was concerned by what she saw in her RIOT profiles:
SABRINA: When you see these, it looks really bad.… The student questions is a little different but the passive observing, not interacting, it seems really bad that it trumps all the other stuff … It just seems like I should be doing more things, but at the same time you do run into the situation where if I actually go over there … I'm going to distract them … A lot of it is it feels weird. Some groups are finishing much earlier than others and so it's kind of like, “Now there's nothing to do with them.” And the other ones are just sitting at their bench writing … I don't think I'm doing a poor job as a TA, but I don't think I'm the best TA. I'm not sure how to take it. I guess I need to pay more attention to what I'm doing and seeing if it's the right thing at that time.
These examples suggest that TAs can become more self-aware if they see the findings from an outside observer, which may be useful for professional development. Giovanni learned that his teaching practices were actually helpful and aligned with the course philosophy much better than he expected, but Sabrina realized she spent a disproportionate amount of time merely observing her students, when perhaps she could have been more productively interacting with her students.
RIOT code | Giovanni | Koga | Surge | Brock | Erika | Misty | Sabrina |
---|---|---|---|---|---|---|---|
SQ | Low | Low | Low | Med | Med | High | Med |
CD | Med | High | Low | Med | Med | Low | Med |
OD | High | Med | Low | Med | Med | Low | Low |
PO | Low | Low | High | Med | Med | High | High |
AO | Med | High | Med | Med | High | Low | Low |
All conv. | High | High | Low | Med | Med | Low | Low |
All obs. | Low | Low | High | Med | Med | High | High |
Since there were essentially two types of actions, “Conversations” and “Observations”, we combined Student Question, Closed Dialogue, and Open Dialogue into the “All Conversation” bin. Similarly, we combined Passive Observing and Active Observing into the “All Observation bin. From these categories (bottom two rows of Table 6), we can see that the TAs’ teaching styles fall into three categories: Conversation-Heavy (a relatively high amount of time in conversation with students but a low amount of time quietly observing), Observation-Heavy (a relatively high amount of time quietly observing students but a low amount of time in conversations), and Balanced Conversation-Observation (medium for both). Because most of the TAs’ behavior skewed toward observation or conversation, this suggests that finding a suitable balance between talking with students and stepping back to observe is a challenge.
What causes a TA to be Observation-Heavy or Conversation-Heavy in their teaching? All of the TAs believed that they should spend a substantial amount of time in conversation with students, which suggests that beliefs about talking with students did not drive their behavior. However, TAs’ views on observation actions differed, and these views, summarized in Table 7, seemed to be related to the observed patterns in behavior.
TA | Passive observing | Active observing | Observed behavior profile | ||
---|---|---|---|---|---|
Instructor | Ideal TA | Instructor | Ideal TA | ||
Giovanni | Med | Low | Low | Low | Conversation-heavy |
Koga | Med | High | High | Med | Conversation-heavy |
Surge | High | High | Med | Med | Observation-heavy |
Brock | Med | Med | Med | Med | Balanced |
Erika | Med | Med | Med | Med | Balanced |
Misty | Med | Med | High | High | Observation-heavy |
Sabrina | Med | High | High | High | Observation-heavy |
For all TAs but Koga, beliefs about observing aligned with their actual time spent observing. TAs in the Observation-Heavy category (Surge, Misty, and Sabrina) all responded “High” to Passive Observing, Active Observing, or both. In contrast, the TAs in the Balanced Conversation-Observation category (Erika and Brock), wrote “Medium” for all questions about observation, and the observed behavior of Erika and Brock did indeed correspond with their beliefs. However, for TAs in the Conversation-Heavy category (Giovanni and Koga), the correlation between their worksheet responses and observed behavior is less clear. While Giovanni's belief that an ideal TA should spend a relatively low amount of time observing matched his actions, there was no clear relationship between Koga's beliefs and actions.
Relative to the other TAs, Koga spent the highest amount of time Active Observing but the least amount of time Passive Observing, even though he responded that he should spend a medium or high amount of time doing both levels of observation. This suggests that there is another factor besides beliefs about ideal TA behaviors that influence actual teaching behavior. Here it may simply be that the ability to strike this balance comes with experience: the two TAs in the Balanced Conversation-Observation category (Erika and Brock) were also the most experienced of this group.
Some of the disagreement stemmed from TAs’ lack of confidence in students, in which they believed students required more help than the lab coordinator expected to complete the lab projects. Disagreement also came from misunderstandings about how much help TAs were allowed to offer students. For example, Giovanni mentioned that when they were told not to do a specific teaching move, he saw that other TAs thought that meant not to help students at all:
GIOVANNI: This one TA … [was] like, “Well, because of [an email stating what not to do], I'm not going to write anything on the board, and I'm just going to sit here.” … That's what they did … but the people who suffered were the kids, because they had no idea what to do … She [the TA] was too scared to say anything because she didn't want to get an email … saying that she was doing something wrong.
This suggests that a case of miscommunication between TAs and the Lab Coordinator can have a serious impact on class instruction. It does not necessarily mean that TAs do not buy in to the course philosophy.
In fact, classroom observations indicated that TAs spent most of class time performing in at least some of the ways the Lab Coordinator would prefer, that is, in conversation with or observing students. Of the seven participating TAs, Erika and Brock spent a substantial amount of time on both conversing and observing (Balanced Conversation-Observation); Giovanni and Koga spent much more time in conversations than observing (Conversation-Heavy); and Surge, Misty, and Sabrina spent much more time observing rather than talking with students (Observation-Heavy). While the Conversation-Heavy and Observation-Heavy TAs generally perceived and agreed with the idea that they were expected to converse, the two groups’ ideas about observation differed. By comparing the video data to the RIOT worksheet responses, it appears that the balance of conversation to observation was determined by TAs’ beliefs about Passive and Active Observing, i.e., the more that a TA thought that time spent observing was expected by the Lab Coordinator and/or was an ideal teaching behavior, the more time they actually spent quietly observing students.
Coding TA behavior based on video data requires making some assumptions. First, because video was captured using a single camera, sometimes the TA was far away from the camera or had their back turned, making it difficult to see what they were doing or who they were talking to. This challenge was magnified in sections where students chose to work in the hallway just outside the laboratory to develop project plans for the next class meeting, and TAs would follow once all groups finished experimentation. In these situations where the TA was not visible, coding relied on audio data.
Finally, the types of dialogue between TAs and students were coded, without coding for the content of those conversations. This study focused on the behaviors of TAs and their reasoning for their actions, but it may be relevant to know what was most commonly discussed (e.g., procedural details, chemistry concepts, data analysis, etc.) to understand the needs of TAs and students. Knowledge of frequently asked questions or types of problems could help training developers better tailor activities to align with the realities of the classroom.
Expectations influence actions—or inaction, as Giovanni noted about a fellow TA who did nothing to support her students for one project because she only knew what she was not supposed to do. Not only do TAs need to know what expectations are, they need to understand the reasoning behind them. For example, we saw that Misty did not know why the Lab Coordinator suggested that they have students “struggle a little” with the projects. Consequently, she relied on her past experiences as an undergraduate to decide that lab lectures are more helpful than letting students build their knowledge as they grapple with the experiments.
We saw that TAs found it difficult to help introductory students figure out how to approach the presented scenarios without resorting to telling them what to do or wanting to do certain techniques for them. To address TAs’ struggles with guiding novices in the lab, modeling helpful interactions, as has been done for TAs at the University of Virginia (Wheeler et al., 2015), is one practical approach to empower TAs to facilitate student learning. Such interactions may include scaffolding (van de Pol et al., 2010; Reiser and Tabak, 2014; Yuriev et al., 2017) or questioning (Tofade et al., 2013) techniques that TAs can use with students. While this sort of professional development may be offered in one-time TA training sessions, evidence suggests that short-term training is often ineffective (Feldon et al., 2017), and thus the ideal is to provide ongoing support. Wheeler et al. have discussed at length their approach to TA professional development for guided-inquiry laboratories, which focuses on three components: theory (on how people learn and expectancy-value theory), pedagogy, and practical issues (logistics, consistency, and TA expectations). This approach involves 25 hours of training at the start of the semester, followed by weekly meetings (20–30 contact hours) throughout the remainder of the term (Wheeler et al., 2017a; Wheeler et al., 2017c). While the TAs in this study had ∼5 hours of TA training at the start of the semester and participated in weekly meetings (∼1 hour per week) with the Lab Coordinator and fellow GCL TAs throughout the semester, our findings indicate that we need to use that time more effectively or allocate more time in order to better train and support TAs.
Beyond training sessions or courses in pedagogy, mentoring between senior and junior TAs can be an effective approach to provide ongoing support. Previously reported training programs for chemistry TAs (Richards-Babb et al., 2014; Lekhi and Nussbaum, 2015) have included mentoring components, and every participant in our study shared a specific way that more experienced TAs helped them in or outside the classroom. As Erika said, it is much more challenging if at first “you don’t have a good friend, a TA to talk to.” Thus, it may be important to facilitate the formation of mentoring relationships by explicitly identifying experienced TAs that new TAs can shadow and ask for advice or formally assigning mentor-mentee pairs.
Finally, to reduce TAs' desire to perform new lab techniques for students, one promising solution may be to incorporate digital badging to foster independence with common laboratory skills (Hensiek et al., 2016; Hennah and Seery, 2017; Seery et al., 2017). Badging allows students to demonstrate technical competence by recording a video where they narrate their actions as they perform a specific laboratory skill (e.g., pipetting). If the student's video is adequate, the “badge” for that particular skill is awarded. These videos could assuage TAs’ fears that students will be unable to perform the experiments that they propose safely or efficiently.
Your group is working as analytical chemistry interns with the [Institution] Office of Environmental Health and Safety (EHS). EHS is responsible for the collection and disposal of all chemical waste on campus.
Today, an unidentified white compound was discovered in one of the teaching labs, and your team has been called in to assist with the identification of the compound. Since your team is responsible for safe disposal of the compound, you will also need to determine as many of its physical and chemical properties as possible. EHS does not want to mix it with other waste that could create a potentially dangerous reaction.
As you are a team of interns, your supervisors have done some preliminary work and determined that the compound is likely one of the following:
NaCl | KCl | Na2SO4 | CaCl2 | MgSO4 |
Na2CO3 | K2SO4 | KNO3 | Ca(NO3)2 | (NH4)2CO3 |
NH4Cl | (NH4)2SO4 | CaCO3 | MgCO3 | CH3CO2Na |
You will be given five grams (no more) of the compound; you will not know the identity of the compound, nor will you be given any other information about it.
Standard samples of the possible compounds along with the normal lab reagents will be available in the lab for you to test your hypotheses and compare with your unknown. Use the standards carefully, cross contamination or allowing the compounds to be exposed to air for long periods of time may cause erroneous results.
The required tasks for successful completion of this project are shown below:
1. Identify the unknown compound.
2. Discover as many chemical and physical properties of the compound as you can.
3. Devise two syntheses of the compound, and compare them for cost effectiveness, safety and potential yield of compound. Your group will then select the best for inclusion in the future work section of your formal report.
For this project you will be provided a commercial, artificially colored beverage to analyze. Your beverage will contain more than one FD&C food dye.
The required tasks for successful completion of this project are shown below:
1. Experimentally determine the relationship between the color of a compound and the wavelength of light absorbed.
2. Experimentally determine the relationship between the amount of light absorbed and the concentration of the colored species in solution.
3. Experimentally determine both the identity and concentration of the food dyes present in the beverage.
4. Create 100 mL of a sample solution with the correct color profile to compare side-by side with the name brand beverage.
There has been another oil pipeline accident and the local wildlife has been covered with oil, so the local environmental group has decided to help. This group, to save money, has decided to make their own soap. The problem is the only recipe they have uses lard, animal fat, to make the soap. They, being the animal lovers that they are, would like an alternative.
It is your job to develop other types of soaps and detergents for this environmental group to use on the birds. The environmental group, being all for the environment, has requested that you test the soaps, detergents, and wastes from the processes of making the soaps and detergents for environmental impact. We have included their recipe for making the soap, and a well-known recipe for making detergents.
This is the second oil spill to hit the region in the past 50 years. There are horrific tales passed down about a scummy slime that was left on everything after the first oil spill was cleaned. Many suspect water contaminants were the cause of the scum. Since this is not always the case, the group thinks something in the well water used may be a problem. They have asked your team to research to see if you can determine the cause and find a way to prevent scum buildup.
The required tasks for successful completion of this project are shown below:
To make and test soaps and detergents in order to decide which one would be best for the environmental group to use in the future.
Your specific goals:
1. Test the solubility of fats, oils, soaps, and detergents.
2. Determine and Compare the desirable properties of each soap and detergent.
3. Examine environmental impact of the synthesis of soaps and detergents (particularly the pH of respective waste waters)
4. Determine what is causing the scum
5. Determine the best soap/detergent and protocol for cleaning up the oil.
A kidney stone is a urologic disorder that is caused by the formation of a precipitate when some soluble ions present in blood and urine react. It is estimated that there were 2.7 million hospitals visits and more than 600000 emergency room visits in 2000 due to this disease. Scientists have found evidence of kidney stones in a 7000-year-old Egyptian mummy, and it is still a problem in our times being one of the most common disorders of the urinary tract.
In order to improve the quality of life for their patients, your team has been assigned by The Kidney Stone Center of the Rocky Mountains to investigate the formation of kidney stones and to suggest ways to dissolve and prevent them.
http://www.niddk.nih.gov/health-information/health-topics/urologic-disease/kidney-stones-in-adults/Pages/facts.aspx (Accessed October 2015)
The required tasks for successful completion of this project are shown below:
1. Research the chemical composition of kidney stones. Numerous sites on the Internet and some chemistry textbooks are valuable sources of information.
2. Identify the major inorganic compounds present in kidney stones.
3. Prepare artificial kidney stones in a mini-scale laboratory. (each group member should make a different type of artificial kidney stone)
4. Research and Experimentally test different methods of dissolving the artificial kidney stones your group synthesized.
5. Based on the results of the experiment propose a strategy to prevent kidney stone formation.
1. Personal introductions, general information about teaching in the department (e.g., course numbers of corresponding course names, general responsibilities of TAs), addressing concerns about being a new TA
2. How people learn: introduction to constructivist ideas of teaching and learning, scientific practices and core ideas (from 3-dimensional learning), type I vs. type II thinking, metacognition, information processing and short-term memory
3. First day guide: professionalism, introducing oneself and contact information (email and office hours). Discussion of how to approach common problematic situations (e.g., improper lab attire, cheating on exams, not participating in class).
The TA training sessions for new 2017–2018 TAs were led by General Chemistry Teaching Staff (Director of General Chemistry, Lecturer of General Chemistry, and General Chemistry Lab Coordinator), the first author (a postdoctoral scholar focused on chemistry education research [CER]), and the second author (professor of chemistry with a focus on CER). The first session was led by the Director of General Chemistry. The second session was led by the second author. The third session was led by the first author.
Of the TAs who participated in this study, two (2 – Koga and Misty) attended these training sessions. The remaining five (5) TAs would have participated in New Graduate Student Orientation in previous years. The second author was involved in previous years’ new TA training, but the first author was at a different institution and therefore not involved.
In Spring 2018 (the semester of this study), the first author arranged three (3) additional meetings during the first week of classes. (Lab meetings did not begin until the second week of the semester.) These sessions were 90 minutes long and scheduled in the early afternoon when no graduate courses were held in the Department, in an attempt to minimize scheduling conflicts for the TAs. Lunch was provided to encourage attendance. Of the TAs who participated in the study, four (4 – Giovanni, Koga, Surge, and Erika) participated in full, two (2 – Brock and Misty) attended some of the sessions, and one (1 – Sabrina) was unable to attend all sessions.
The three sessions consisted of the following topics and activities:
1. Large group discussion of course philosophy (goals of general chemistry lab for a largely non-major population), unpacking of big goals like “critical thinking” and “problem solving” to the Framework's scientific practices, and relationship between the activities of the lab (i.e., the project scenarios and graded assignments) and meeting the goals of the course.
2. Large group discussion of scaffolding and questioning techniques that may help guide student thinking in productive directions. Small group activity in which TAs focused on one specific project in GCL1 or GCL2. Groups consisted of a mixture between new and experienced TAs for the course. Each group was asked to consider the student goals for each project, problems students typically encountered, and possible questions to guide students to meet project goals or overcome obstacles along the way.
3. Role-playing activity where each small group would play the role of a “student team” trying to plan the experiments to do for each project. Using the same groups as the previous session, the group that focused on a particular project would play the role of “TAs” to help the “student teams” with their plans. Due to time constraints, each group play the “TA” role for about 15 minutes before resuming the role of “students” for a different project.
Action | Description |
---|---|
aSlack is the web-chat interface used to communicate with the Lab Coordinator and stockroom staff. | |
Clarifying Instructions | Clarifying instructions, reading from lab documents |
Explaining Content | Explaining a concept without student input |
Working on Apparatus | Helping students with experimental apparatus or computers |
Student Question | Listening to a question from a student |
Closed Dialogue | TA controls conversation with student; student provides short answers |
Open Dialogue | No individual person controls the conversation; student responds with complete sentences and/or ideas |
Passive Observing | Listening briefly to group conversations |
Active Observing | Listening to one group but does not participate |
Admin/Class Prep | Cleaning, (un)locking drawers, Slacka, writing on chalkboard |
Not Interacting | In a different room, non-course related chatting |
2. What courses have you taught before?
a. How many times have you taught those courses?
a. What do you think went well in lab this week?
b. Can you give an example of an interchange you had with students that you felt went particularly well? Why did it work well?
c. What did you feel did not go well in lab this week?
d. Why do you think these problems happened? How would you modify your teaching next time to deal with or prevent this problem?
2. What's hard about teaching this way, and what's easy?
a. Are there any materials or instructions you felt would have better prepared you to teach this lab?
3. What do you see as the advantages and disadvantages of a project-based lab course:
a. For you?
b. For the students?
4. How would you recommend tweaking the current format?
5. Do you think that this course helps teach what students should be learning in a chemistry lab?
• Do you think you did anything different during this lab compared to the last lab that was recorded?
• (If yes) What did you do differently? Why?
a. Can you give an example of this type of interaction?
b. Why do you think this type of interaction is important?
2. Low (or no time)/high
a. Can you give an example of this type of interaction?
b. Why do you think this type of interaction is important?
c. Why do you think the course instructor thinks this interaction is unimportant?
3. High/low (or no time)
a. Can you give an example of this type of interaction?
b. Why do you think the course instructor thinks this type of interaction is important?
c. Why do you think this interaction is unimportant?
a. Can you give an example of this type of interaction?
b. Why do you think this type of interaction is important?
c. Why do you think students think this interaction is unimportant?
5. High/low (or no time)
a. Can you give an example of this type of interaction?
b. Why do you think students think this type of interaction is important?
c. Why do you think this interaction is unimportant?
GCL1 | GCL2 | |
---|---|---|
Engineering & Computer Sciences | 26 | 11 |
Life & Environmental Sciences | 42 | 65 |
Physical Sciences | 2 | 4 |
Pre-Health & Pre-Veterinary | 10 | 2 |
Mathematics & Statistics | 6 | 10 |
Other & Undeclared | 14 | 8 |
%SQ | %CD | %OD | %PO | %AO | %Conv | %Obs | %AT | |
---|---|---|---|---|---|---|---|---|
Mean | 13.0 | 9.8 | 22.5 | 32.8 | 4.0 | 45.3 | 36.8 | 82.1 |
SD | 5.2 | 8.2 | 13.7 | 16.1 | 3.8 | 15.4 | 13.8 | 7.8 |
%SQ | %CD | %OD | %PO | %AO | %Conv | %Obs | %AT | |
---|---|---|---|---|---|---|---|---|
High | 15.6 | 13.9 | 29.4 | 40.8 | 5.9 | 53.0 | 43.7 | 86.0 |
Low | 10.3 | 5.7 | 15.7 | 24.7 | 2.1 | 37.6 | 29.9 | 78.2 |
This journal is © The Royal Society of Chemistry 2020 |