Daniel C. Southam*a,
Bradley Shanda,
Mark A. Buntineab,
Scott H. Kablec,
Justin R. Readbc and
Jonathan C. Morrisbd
aDepartment of Chemistry, Curtin University, GPO Box U1987, Perth WA 6845, Australia. E-mail: d.southam@curtin.edu.au; Fax: +61 8 9266 2300; Tel: +61 8 9266 2380
bSchool of Chemistry and Physics, The University of Adelaide, Adelaide SA 5005, Australia
cSchool of Chemistry, University of Sydney, Sydney NSW 2006, Australia
dSchool of Chemistry, The University of New South Wales, Sydney NSW 2052, Australia
First published on 7th June 2013
An assessment of the acylation of ferrocene laboratory exercise across three successive years resulted in a significant fluctuation in student perception of the experiment. This perception was measured by collecting student responses to an instrument immediately after the experiment, which includes Likert and open-ended responses from the student. Students in all three years identified technical benefits from the experiment. In Years 1 and 3, students also recognised the benefits of improving their conceptual understanding of organic chemistry. However, in Year 2, where background knowledge became a critical and limiting factor, all perception of conceptual understanding as an experiment objective was lost, and only recognition of technical development remained. Analysis of these data also indicated that students who have enough time to complete the experiment also perceive a measure of responsibility for their own learning, whereas time-poor students have an over-reliance on the laboratory notes and demonstrators. Addressing concepts such as these may be the triggers required for time-poor experiments to garner a positive student experience and maximise both the conceptual and technical benefits of the experiment.
This work represents a case study, in accordance with the definition published by Cohen et al. (2007), exploring how the timing of an experiment in the laboratory program affects the student perception of the experiment. The case study uses a variety of tools to explore student perception of a widely utilised experiment that typically forms part of an undergraduate organic (Mosbo et al., 1996) or mixed organic–inorganic (Wollins, 2002) synthesis laboratory program. Our analysis explores educational issues arising from this commonplace undergraduate student experiment within the context of the home institution implementation. Using the ACELL (Advancing Chemistry by Enhancing Learning in the Laboratory) approach, classical statistical techniques and some simple content analysis, we explore why the student perception of this experience varies from marginally positive to dominantly negative across the course of 3 years in which its position in the program was varied. This exploration triangulates both quantitative and qualitative data from the workshop experience, and student feedback provided after its implementation at the home institution. From this exploration we present some suggestions that can be utilised to ensure that scientifically important, but often poorly perceived, laboratory experiences are of maximum educational benefit to the student.
This experiment illustrates theoretical concepts in electrophilic aromatic substitution and that aromaticity is retained in the organometallic complex and can be exploited in much the same way as in benzene, in this case by Friedel–Craft acylation. This experiment also aims to develop competency in separation and purification by requiring students to develop a technique to separate the desired product from the reaction mixture. Ideally, students should also have an understanding of chromatography and separation of compounds. However, this is not essential, as students will learn these skills as part of the experiment. If they have not had much exposure to the principles of chromatography this may mean that they will require more demonstrator assistance in developing their method for purifying acetylferrocene. This experiment illustrates that techniques, such as column chromatography, can be applied to organometallic compounds, further reinforcing the overlap between organic and inorganic chemistry.
The students undertaking this experiment have studied aromatic chemistry at first year, as well as aromatic chemistry and spectroscopy in the previous semester at the second year level. The series of lectures concurrent with this experiment included theory of electrophilic aromatic substitution with examples of mono-substituted aromatics and metallocenes. This experiment was studied over three academic years, where changes in the experiment and its timing were made. In Year 1, the experiment was offered towards the middle of the laboratory program. For reasons beyond the control of this work, it was moved to be the first experiment of the semester in Year 2. Partly on the basis of this work, it was shifted back to the middle of the program in Year 3.
For items 1 to 12 the Likert scale is coded a +2 (‘strongly agree’) to −2 (‘strongly disagree’). For item 13 the scale is assigned to +2 (‘way too much time’) to −2 (‘nowhere near enough time’). For item 14 a +2 (‘outstanding’) to −2 (‘worthless’) scale has been applied. The same parameterisation for all items is used, but it is noted that the different Likert scales for items 1 to 12, item 13, and item 14 alters the respondent interpretation and leads to a different pattern of responses. Thus, items 1 to 12 are presented separately from items 13 and 14 to avoid misinterpretation by the reader.
The qualitative statements ask students to comment on the following aspects of the experiment; whether they enjoyed it (15), what were the main lessons to be learnt (16), what aspects of the experiment are enjoyable (17), what aspects need improvement and suggested changes (18) and any additional comments (19).
The qualitative responses to items 15–19 were analysed using a modification to the method outlined in Buntine and Read (2007). The comments were classified according to identified broad themes and whether the intent of the comment was positive or negative in relation to its theme. The categories were subsequently verified by ensuring that any single comment did not fall simultaneously into multiple categories. Once this process was completed the underlying intention of each comment was reassessed and tabulated to determine whether there were any dominant trends differing between the years and cohorts in the nature of the comments.
![]() | ||
Fig. 1 Survey responses from the workshop survey for this experiment versus all tested experiments for four items.‡ |
“Experimental design – TLC analysis and subsequent column chromatography (which was not carried out during this workshop) seems like a good way to get students to think about the principles of chromatographic separation as it relates to the properties of the compounds in question, i.e. starting materials and product”
This comment strongly articulates the intended learning outcomes as outlined in the ACELL education analysis of this experiment.† Most importantly, while the reinforcement of theoretical knowledge from the lecture sequence is explicitly stated, for example:
“The experiment allows students to apply knowledge about electrophilic aromatic substitution to a case they may not have seen before”.
This experiment is heavily dependent on demonstrator support in the laboratory:
“The ferrocene undergoes reactions during which it looks like it is wrong – Demonstrator input goes a long way to helping students in this prac”
This feedback from the workshop was incorporated into the educational analysis and changes were made to the experiment prior to implementation at the originating institution. The assessment criteria and mechanisms of assessment, once amended from the workshop feedback, were retained during data collection at the originating institution across the course of this study, and can be found in the ESI.†
![]() | ||
Fig. 2 A graphical representation of the parameterisation of students’ responses to the quantitative statements on the ASLE instrument over the three years of surveying at the home institution illustrating the fluctuating perception of this experiment.§ |
Fig. 2 also indicates that here are noticeable fluctuations in student perception for many items. In general, the responses to most items in Year 2 are not as strong as in Years 1 and 3. Two items, however, stand out. The responses to “Sufficient Background Information” (item 7) and “Increased Understanding of Chemistry” (item 6), are significantly lower in Year 2 than the other two years (P < 0.05, Kruskal–Wallis rank-sum test, see Table 1).
Item | Year 1 (N = 22) | Year 2 (N = 19) | Year 3 (N = 29) | Kruskal–Wallis | |||||
---|---|---|---|---|---|---|---|---|---|
Mean | SD | Mean | SD | Mean | SD | H(2) | P | ||
1 | This experiment has helped me to develop my data interpretation skills | 0.64 | 1.00 | 0.32 | 0.95 | 0.62 | 0.78 | 1.645 | 0.439 |
2 | This experiment has helped me to develop my laboratory skills | 1.23 | 0.75 | 0.84 | 0.90 | 1.28 | 0.65 | 3.616 | 0.164 |
3 | I found this to be an interesting experiment | 0.45 | 0.91 | 0.11 | 0.94 | 0.38 | 1.08 | 1.099 | 0.577 |
4 | It was clear to me how this laboratory exercise would be assessed | 0.36 | 1.09 | 0.89 | 0.88 | 0.55 | 0.99 | 3.144 | 0.208 |
5 | It was clear to me what I was expected to learn from completing this experiment | 0.64 | 1.00 | 0.26 | 1.33 | 0.21 | 1.15 | 1.753 | 0.416 |
6 | Completing this experiment has increased my understanding of chemistry | 0.82 | 0.85 | 0.00 | 0.94 | 0.62 | 0.73 | 8.615 | 0.013 |
7 | Sufficient background information, of an appropriate standard, is provided in the introduction | 0.18 | 1.01 | −0.21 | 1.03 | 0.72 | 1.00 | 9.625 | 0.008 |
8 | The demonstrators offered effective support and guidance | 1.00 | 0.93 | 1.00 | 1.25 | 1.17 | 0.97 | 0.639 | 0.727 |
9 | The experimental procedure was clearly explained in the lab manual or notes | 0.50 | 0.91 | 0.47 | 1.17 | 0.38 | 1.05 | 0.166 | 0.920 |
10 | I can see the relevance of this experiment to my chemistry studies | 1.00 | 0.93 | 0.68 | 1.20 | 0.83 | 0.76 | 0.789 | 0.674 |
11 | Working in a team to complete this experiment was beneficial | 0.55 | 1.06 | 0.79 | 1.03 | 1.17 | 1.00 | 5.552 | 0.062 |
12 | The experiment provided me with the opportunity to take responsibility for my own learning | 0.95 | 0.84 | 0.68 | 0.75 | 1.17 | 0.71 | 5.394 | 0.067 |
13 | I found that the time available to complete this experiment was | −1.05 | 0.79 | −1.11 | 0.88 | −0.76 | 0.79 | 2.888 | 0.236 |
14 | Overall, as a learning experience, I would rate this experiment as | 0.18 | 0.59 | 0.00 | 0.88 | 0.34 | 0.55 | 3.066 | 0.216 |
The final two Likert items on ASLE are measured on a separate scale to address two important influences on student perception, whether there is sufficient time to complete the experiment and whether the experiment itself was a worthwhile experience. The different scale and separation from items 1 to 12 on the instrument typically require that the interpretation of these items is handled separately. In this case study, the dominating feature from these data was that students’ felt there was insufficient time to complete this experiment (item 13 mean: Year 1 = −1.05, Year 2 = −1.11, Year 3 = −0.76) regardless of where it was placed in the curriculum. There also appears to be a relationship between the student perception of adequacy of time available for the experiment, the year it was presented, and aspects of the overall learning experience. So the question arises, as to what aspects, in the context of this experience, influence the perception of time and place, and how might the teacher respond to ensure the objectives of the experiment are met?
The responses to item 16, asking for identification of the important lessons in this experiment, are telling (Fig. 3). In all years, students recognise technical skills as being an important lesson, which, indeed the experiment is designed to develop. However, almost 40% of students in Years 1 and 3 also recognised the importance of developing the concept of electrophilic aromatic substitution via the experiment. In Year 2, however, no student commented on theoretical understanding as being important, whilst 75% commented on technical skills. As we discuss below, we attribute this to cognitive overload for the students in Year 2, who have not had the benefit of development of core skills in earlier experiments, nor introduced to the theory in lectures. As the development of concepts in organic chemistry was one of the intended outcomes of this experiment, clearly the placement in the program needs to be considered carefully to achieve this intent.
![]() | ||
Fig. 3 Percentage of the number of qualitative responses to item 16 from the ASLE surveying illustrating the pattern across three distinct themes identified across three years of surveying. |
(1) Time: adequacy of time within the lab session and or the quantity of work required to complete in the set time.
(2) Information: quality and quantity of information in the introduction and/or laboratory notes.
(3) Resources and demonstrators: quality and accessibility of apparatus, chemicals, resources and the laboratory environment in general.
(4) General skills: skills that are not scientific in nature and/or related to generic graduate attributes.
(5) Technical skills: skills of scientific relevance, either practical or theoretical.
(6) General interest: interest in the experiment and/or theory related to the lecture course.
(7) Other: comments that cannot be ascribed into any of the above categories.
The qualitative statements from students responding to items 15–19 indicate that the students found the experiment to be too long. Four time-related sub-categories of “time” were identified from the comments: tasks, resources, information or non-specific. The majority of the responses are of a technical or procedural nature and relate to the experimental procedure, as opposed to the conceptual capacity to successfully complete the experiment.
Examples of statements relating to time indicate the numbers of tasks the students were required to perform within the set time period. For example, when asked whether they enjoyed the experiment:
“No, too little time to do so many things”, (item 15, Year 2).
The next influence on time is the availability of resources. Several students commented on the fact that time was wasted while waiting for equipment to be available, for example when asked to comment on improvements to the experiment:
“Since time was lost waiting for equipment to become available equipment such as TLC jars should be made more available.” (item 19, Year 1)
While not a sentiment expressed by a significant number of students, it may relate to an underlying demotivating factor that could be easily rectified. In general, the students describe how multiple facets make up their demands on time and improvements to any of them may improve that perception. To achieve a meaningful comparison, the responses to items 1–12 and 14 were categorised into two groups; students who responded that there was enough or too much time (N = 23) were separated from those who responded that there was not enough or nowhere near enough time (N = 47). A comparison of the distributions (Table 2) indicates that significant differences (P < 0.05) are observed about the perception of the quality of the laboratory notes (item 9) and taking responsibility for their own learning (item 12). This indicates that students who found there was sufficient time available for the experiment were more likely to perceive that the laboratory notes were clear and they felt they could operate as independent learners.
Item | Insufficient (N = 47) | Sufficient (N = 23) | Wilcoxon | ||||
---|---|---|---|---|---|---|---|
Mean | SD | Mean | SD | W(70) | P | ||
1 | This experiment has helped me to develop my data interpretation skills | 0.45 | 0.97 | 0.74 | 0.69 | 1584 | 0.145 |
2 | This experiment has helped me to develop my laboratory skills | 1.15 | 0.72 | 1.13 | 0.87 | 1655 | 0.435 |
3 | I found this to be an interesting experiment | 0.19 | 1.01 | 0.61 | 0.89 | 1550 | 0.068 |
4 | It was clear to me how this laboratory exercise would be assessed | 0.53 | 1.04 | 0.70 | 0.93 | 1626 | 0.300 |
5 | It was clear to me what I was expected to learn from completing this experiment | 0.45 | 1.12 | 0.17 | 1.23 | 737 | 0.841 |
6 | Completing this experiment has increased my understanding of chemistry | 0.49 | 0.93 | 0.57 | 0.79 | 810 | 0.532 |
7 | Sufficient background information, of an appropriate standard, is provided in the intro | 0.28 | 1.08 | 0.35 | 1.07 | 1651 | 0.413 |
8 | The demonstrators offered effective support and guidance | 1.00 | 1.00 | 1.22 | 1.09 | 1586 | 0.150 |
9 | The experimental procedure was clearly explained in the lab manual or notes | 0.28 | 0.97 | 0.78 | 1.09 | 1517 | 0.029 |
10 | I can see the relevance of this experiment to my chemistry studies | 0.74 | 1.01 | 1.04 | 0.77 | 1586 | 0.151 |
11 | Working in a team to complete this experiment was beneficial | 0.85 | 1.04 | 0.91 | 1.08 | 1650 | 0.409 |
12 | Experiment provided me with the opportunity to take responsibility for my own learning | 0.85 | 0.81 | 1.22 | 0.67 | 1536 | 0.048 |
13 | I found that the time available to complete this experiment was | −1.43 | 0.50 | 0.04 | 0.21 | NA | NA |
14 | Overall, as a learning experience, I would rate this experiment as | 0.11 | 0.70 | 0.39 | 0.58 | 1571 | 0.111 |
One major outcome of the workshop review was an improvement to the laboratory notes to ensure that the theory of the experimental procedure was explicitly outlined. Regardless, there was a dominant sentiment in qualitative statements relating to the quality of information and description of techniques in the laboratory notes and pre-laboratory introduction by demonstrators, with a large number of students expressing comments such as:
“Better/Clearer instruction to make the whole experiment more achievable” (item 18, Year 3).
It is interesting to note that the student perception of the amount of time coincides with that of the quantity and quality of procedural information and whether students taking responsibility for the own learning. This indicates a relationship between these factors, most probably a frustration with the lack of information provided making them more dependent on demonstrators, a limited resource, and therefore less independent as learners in this environment. Students frequently intimate this relationship in their statements, for example:
“Make demonstrators present during the experiment, so students have chances to ask questions” (item 18, Year 1)
“Sometimes it is hard to find the demonstrator” (item 15, Year 1)
The triangulation of data indicates that the laboratory notes play an important role in the perception of time available for this experiment, which in turn may impact on general utility in the laboratory learning environment. This coincides with the identification of primarily technical learning outcomes as a main outcome of this experiment, which must largely be communicated by the laboratory notes or the demonstrators who supervise this experience. It was found from the comments that students did not express a dissatisfaction with the experiment itself, but rather with the lack of resources available to complete it within the time allocated.
The fluctuating student perception of the acetylation of ferrocene experiment provides some interesting insights into what drives student perception of a synthesis experiment, especially in time-poor scenarios. There are two aspects to this analysis – the placement of the experiment in the program and the perception of amount of time. Although linked, analysis of these issues provides a complementary view of the experience.
The main impact of moving the experiment to the first week of the program is that the students’ perception of the learning objectives shifted from split between technical and theoretical to 100% technical. There is nothing fundamentally wrong with a skills-based experiment that is pitched at the confirmatory end of the inquiry spectrum (Buck et al., 2008) if the learning outcomes are purely skill-focused. However, the intended learning outcomes of this experiment included conceptual knowledge and so, for the experiment in Week 1, this objective is not met.
There are two considerations to the failure to meet the theoretical objectives: firstly, in Week 1, the students have not yet met the concepts in lectures. Clearly, the background information in the laboratory notes is insufficient to support this learning in the laboratory (items 6 and 7 in Table 1). In mid-term, after introduction in lectures, the background information becomes sufficient and the students perceive the theoretical objectives. Secondly, the experiment could have been given a more inquiry focus, requiring the students to learn the theory independently. However, there is insufficient time in the experiment in its current guise for this to happen in Week 1 where there are so many new skills to learn.
The second aspect to this analysis concerns the students’ perception of the time allotted to complete the experiment. Interestingly, there is no statistically significant difference in this perception between Year 2 and Years 1 and 3. As discussed above, the students simply lost the perception that they were supposed to be learning organic chemistry concepts in Year 2, and only considered technical aspects of their learning.
In the analysis where responses are separated by perception of time, a different story emerges. Where time is precious, the student perception of the laboratory notes, and their responsibility for their own learning have the greatest impact (Table 2). It is interesting that these are different items to the ones that are changed when the experiment placement is altered, which points to a different origin. Whether these themes are causal or symptomatic of the fluctuating perception is not immediately clear. For example, do students who understand the notes have more time, or does a feeling of insufficient time cause an over-reliance on the notes? We do not collect data on student demographics, such as not being native English speakers, so this remains an open question.
The connection between having sufficient time and the students’ responsibility for own learning is clearer. Responsibility for own learning is a catchall item in ASLE to probe the level of independent learning, or level of inquiry. It is well-recognised that experiments that aim at authentic inquiry (Buck et al., 2008) have time as a mediating influence on the student perception (Baseya and Francis, 2011). Indeed, it is a frequently heard complaint by school and college teachers that there is simply not enough time to do inquiry (Brown et al., 2006). This experiment was never intended to be anything but confirmatory as far as technical skills are concerned and structured inquiry for conceptual knowledge. Even within the same cohort, and independent of the place in the laboratory program, students who, for whatever reason, understood the notes and believed they had enough time, had a much more positive response to taking “responsibility for their own learning”.
Student laboratory activities are traditionally very explicit in the details necessary for completion of all aspects of the experiment (Fisher et al., 1998; Hofstein and Lunetta, 2004), often to the detriment of the intended outcome (Johnstone and Wham, 1982). In this case study, the lack of responsibility for own learning may well be caused by the student perception of the inadequate time, which may arise from perceived inadequacy of the procedural notes (Jordan et al., 2011). These implications and the underlying observations from this case study are entirely congruent with Cognitive Load Theory (Paas and Merriënboer, 1994), where a lack of experience with experimental techniques leads the novice to focus entirely on the skills necessary to complete the tasks (Anderson, 1987) and to turn away from independent learning.
In an environment where the instructor has the opportunity to make significant changes to the experiment, or even change the pedagogy of the laboratory program, then there are alternate pedagogical approaches that can be considered that lessen the need to have closely integrated or sequenced learning experiences. Inquiry-oriented strategies apply a hierarchy of levels to practical tasks (Hegarty, 1978), from structured and guided inquiry (Lamba and Creegan, 2008; Schroeder and Greenbowe, 2008) to fully open-ended tasks (Roth, 1994) that can provide opportunities for students to gain higher-order process skills (Roth and Roychoudhury, 1993) and a greater ability to adopt scientific ways of doing (Spronken-Smith and Walker, 2010). These strategies present mechanisms for the empowered instructor to create a self-contained laboratory learning experience that garners the desired student learning outcomes and a positive perception, as well as more elusive higher order skills, such as self-regulation in the laboratory learning environment.
In situations where the instructor is more constrained in the ability to make significant change, an analysis such as presented in this case study can still be used to optimise the student experience. Obviously, choosing the correct sequencing of the experiments should be done. By considering the requisite skills, ensuring that the students have had an opportunity to develop these skills, and sequencing this experiment appropriately, the instructor can then afford the students the opportunity to explore the intended outcomes relating to the mechanism of addition to this organometallic complex without wholesale changes to the pedagogical approach. Even if the experiment was constrained to Week 1, then we would suggest that aligning the assessment with achievable learning objectives (in this case technical), and using only formative assessment for the theory would improve the student experience.
Footnotes |
† Electronic supplementary information (ESI) available: Assessment criteria for this experiment from the originating institution at the time of this study and the ACELL educational analysis. See DOI: 10.1039/c3rp00011g |
‡ Likert response text for items 1–12: SA = strongly agree, A = agree, N = neutral, D = disagree, SD = strongly disagree. Item 13: WTM = way too much, TM = too much, AR = about right, NE = not enough, NNE = nowhere near enough. Item 14: O = outstanding, VV = very valuable, WW = worthwhile, OLV = of little value, WL = worthless. |
§ For items 1 to 12 the Likert scale has been assigned a +2 (strongly agree) to −2 (strongly disagree). For item 13 the scale has been assigned to +2 (way too much time) to −2 (nowhere near enough time). For item 14 a +2 (outstanding) to −2 (worthless) scale has been applied. |
This journal is © The Royal Society of Chemistry 2013 |