Mafor
Penn
*a and
Umesh
Ramnarain
*b
aDepartment of Science and Technology Education, Faculty of Education, University of Johannesburg, South Africa. E-mail: mpenn@uj.ac.za
bScience Education, Science and Technology Education Faculty of Education, University of Johannesburg, South Africa. E-mail: uramnarain@uj.ac.za; Web: https://www.uj.ac.za/contact/Pages/Prof-Umesh-Ramnarain.aspx
First published on 17th May 2019
This mixed method study investigated changes in 3rd year Bachelor of Education students’ attitudes towards chemistry after learning interventions with virtual chemistry simulations. After participant students identified certain concepts from their 3rd year chemistry module as being abstract and not easily comprehensible, these concepts were facilitated during a 5 week learning intervention using PhET simulations as an alternative to traditional laboratory experimentation. In the first quantitative phase of the study, a 30-item pre-attitude test was administered to assess students’ attitudes towards chemistry, followed by PhET chemistry simulation learning interventions. Thereafter, students wrote a post-attitude test. Findings of this phase revealed a significantly higher mean post-attitude test score, with students showing a positive attitude towards chemistry learning, post-intervention. The quantitative phase was followed by a qualitative phase which examined students’ experiences on the use of simulations through semi-structured interviews. Findings from the qualitative phase revealed that students experienced autonomy and enjoyment during engagement with the simulations. They also perceived that their experiences in the virtually simulated environment improved their visualisation of chemistry concepts, thereby improving conceptual understanding. However, the students acknowledged that simulations cannot replicate the realism and authenticity associated with practical work in an actual laboratory. The implications of these findings are that virtual simulations provide a complementary learning tool capable of improving students’ attitudes towards chemistry, and perceived by students to support their visualisation of abstract chemistry concepts. The findings of this study are particularly significant for chemistry learning at schools and universities in economically challenged countries such as South Africa where there is a shortage of well-equipped laboratories.
The importance of attitude as an affective construct in chemistry learning and the role of a learning environment as an influencing factor stimulated the inquiry reported in this article. Taylor, Ramsey and Howe in (Hassan, 1985) pointed out that although attitude is regarded as a significant outcome of science teaching and a relevant variable in science learning, “little has been made toward specifying and determining the conditions that affect their dynamics and influence their development” (p. 4). This study investigated 3rd year Bachelor of Education students’ attitudes towards chemistry before and after a learning intervention with virtual simulations. In South Africa, there is a dearth of research on assessing the factors that affect university students’ attitudes towards chemistry (Ramnarain and Ramaila, 2018) especially amongst students who are aspiring to become chemistry teachers. Hence, the study was designed with the aim of exploring an alternative learning environment, namely, a virtually simulated environment, and how this may possibly impact students’ attitudes towards the subject.
In chemistry learning, experimentation in traditional school chemistry laboratories has been regarded as a means by which student visualisation of the abstract chemistry phenomena can be enhanced (Estapa and Nadolny, 2015; Hsu et al., 2017). Some of the advantages of experimental chemistry include, students’ active engagement in learning tasks, visualisation of learned chemical processes/concepts and exposure to processes that scientists follow to provide authentic real world solutions. Visualisation supports students to create their own mental representations of chemical processes and enables long-term retention of learned concepts (Mosotho and Mamontsi, 2014).
In an effort to address this deficit in school science, the emphasis has largely been on the provision of new technologies in educational environments, which had thus far been resource-poor (Wallet, 2015). According to Isaacs (2012), “The dominant view seemed to be that Information and Communication Technology (ICT) itself would catalyse the much-needed changes in the education system” (p. 11). As a result, today at historically disadvantaged South African schools there is availability of smartboards, computers, tablets and free-wifi connectivity. In order to adequately prepare teachers to exploit ICTs in their teaching, South African teacher education institutions such as universities have prioritised the development technological pedagogical and content knowledge (TPACK) as a key learning area in the teacher education curricula. TPACK is defined by Koehler et al. (2013), as “the basis of effective teaching with technology requiring an understanding of the representation of concepts using technology” (p. 16). It is important for teachers to have the necessary TPACK to ensure that ICT integration in the classroom is effective. Further to this, Jen et al. (2016), explain that, the TPACK of teachers will allow the teaching of topics to be more understandable to the learners. It is against this background that this research investigated the use of virtual learning simulations in chemistry at a South African university.
Simulations are interactive digital learning environments that imitate a real-life process or situation (Makransky et al., 2017). Virtual simulation laboratories employ the use of software to reproduce and imitate real physical and chemical processes that are investigated in a traditional laboratory. These simulations for chemistry concepts are embedded with 2D and 3D representations of micro-worlds like atoms, electrons, bonds, ions and molecules as is the case with particle chemistry. In low immersion virtual reality, also referred to as desktop simulations such as the PhET simulations, the interactions are not too complex as may be the case in high immersion virtual technologies (Makransky et al., 2017). The PhET Interactive simulations project at the University of Colorado Boulder, include several chemistry simulations, available freely at http://phet.colorado.edu. PhET simulations are supplemented with guidelines that direct students’ inquiry activities towards specific learning outcomes (Creating PhET Activities, 2013; Chamberlain et al., 2014).
Some of the key features of virtual learning environments which promote learning are underpinned by learning theories such as the cognitive and social constructivist theories. Cognitive constructivists postulate that, the stimulation of the mind enhances critical thinking while social constructivists emphasis on social interactions and mediation tools for enhancing learning (Bruner, 1990). All of these paradigms are exploited through learner-centred interactions, collaborative and individual learning activities, multiple-media, simulations and demonstrations that are embedded within the simulation labs (Cai et al., 2014). Students are therefore, able to see, manipulate, interrogate and discuss science concepts during simulation laboratory sessions. These diverse visual representations have been seen to better enhance students’ engagement and interest in learning more complex science concepts than traditional laboratories (Wu et al., 2013; Makransky et al., 2017). In education, virtual learning environments are also fuelled by a rapid increase in the technological advancements which have a low cost effect on global access to teaching and learning resources (Swallow and Olofson, 2017).
Despite the affordances of virtual learning, several factors need to be considered in its implementation for experimental work in chemistry. These include the loss of realism, poor development of science process skills, increased cognitive load and possible misconceptions that may arise from the 2D and 3D virtual representations when compared to the real chemical processes (Makransky et al., 2017). A secondary objective of this research was therefore to explore students’ perceptions of their experiences of learning in a virtual environment.
The study was hence guided by the following research questions:
(1) Is there a significant difference in 3rd year Bachelor of Education students’ attitudes towards chemistry pre and post learning intervention with virtual learning experiences?
(2) How do 3rd year Bachelor of Education students perceive the use of virtual simulations for chemistry learning and teaching?
Construct | Questionnaire items | Example of items |
---|---|---|
The importance of chemistry module | 5, 12, 13, 15 and 20 | Item 12: The progress of chemistry improves the quality of our lives. |
The difficulty of chemistry module | 2, 7, 17, 18, 24 and 26 | Item 18: I find the use of chemical symbols easy like walk-over. |
Interest in the chemistry module | 1, 3, 9, 10, 16, 19, 21, 23 and 25 | Item 25: I find the chemistry module very interesting. |
Usefulness of chemistry for future careers | 14, 22 and 30 | Item 14: My future career is independent from chemistry knowledge. |
As shown on the table above, the attitude test/questionnaire assessed students’ attitudes towards the chemistry module by degree of importance, the difficulty of the module, interest in the chemistry module and the usefulness of chemistry in their future careers. The questionnaire was piloted with a different group of 40 3rd year BSc, to ascertain the readability of items. The Cronbach's alpha for the 4 constructs within the ATC during the pilot study was quite acceptable at 0.7 as the sample size was relatively smaller. Minor modifications to the ATC questionnaire were made, for example, the word “course” was changed to “module” to suit the context of participant students. The adapted ATC was then adopted for the main study, and administered before and after the virtual simulation intervention. The internal reliability between the 4 constructs within the adapted ATC questionnaire for the main study was calculated using SPSS 25 with α = 0.88, which was considered to be acceptable (Pallant, 2010; Taber, 2016).
The learning intervention was covered during tutorial sessions that followed formal lectures on the chemistry concepts. These tutorials were 1 hour sessions that took place twice a week. Though the participant students were in the third year of their teacher education they are a unique sample in that unlike the students from the pure and applied chemistry their priority modules are the methodology of teaching modules, which are aimed at preparing them for science teaching. All the participant students consented to the study and the university's ethical clearance was obtained. Firstly, all participants were guided in downloading free open online learning PhET simulations to their laptops and had internet access for simulations that were not available off-line. During the learning intervention, a corporative learning approach between the instructor and the students was employed. Structured activities for simulations promoted student to student interactions and student to instructor interactions in order to accomplish self and peer learning goals (Johnson and Johnson, 2009). Students firstly engaged in instructor-directed learning, then self and peer-learning (2 or 3 students per group) of chemical reactions and spectrophotometry concepts which they had identified as abstract and confusing. We directed them on the use and manipulation of the PhET virtual simulations in investigating certain chemical reactions, writing and balancing chemical equations, and measuring absorbance and transmittance through various molar concentrations of solutions. In the first set of learning interventions, the 3rd year students engaged with different aspects of chemical reactions taught to them at the school grade level (9–12) for which they are being trained to teach after the BEd qualification. For example, within the grade 9 South African curriculum for Natural Sciences students are expected to learn and understand chemical equations, reactions of metals and non-metals with oxygen, acid–base reactions, pH values and the applications of chemical reactions (Department of Basic Education [DBE], 2011). At the grade 12 level, students are expected to measure the rate of chemical reactions and the mechanism of reactions and catalyst. In addressing to these curricular expectations, the researchers planned and scaffolded learning activities (some borrowed from the PhETs and some constructed from the module content) during the virtual simulation tutorials. The diagram in Fig. 1 below shows a sample screenshot of one of the PhET simulation laboratories engaged in.
The activities in Fig. 1 required students to manipulate the PhET simulation to establish reactant and resultant products in acid–base reactions, and measure the degree of acidity or alkalinity of the resultants in relation to the electricity generated by free ions. Samples of learning activities could be accessed on https://phet.colorado.edu/en/contributions/view/3660 and also attached in Appendix S4 (ESI†).
Fig. 2 below also shows a sample of the PhET virtual simulation lab for the investigation of Beer's law.
In learning spectrophotometry and Beer's law which is a topic embedded in the chemistry 3rd year module, students were expected to use the PhET simulations in navigating through simple as well as complex problems during the intervention. For example a simple problem given was as follows;
A solution containing 40 ppm of X had an absorbance of 0.43 in a 1 cm cell at 690 nm. If 5 mL of this solution was diluted with water to 100 mL, what will be the absorbance of the new solution at 690 nm?
In solving this problem, students individually manipulated the cells and the associated concentration of solution X to establish the absorbance of the new solution. In addition to this question, more demanding questions were included, and these required students to solve authentic real life problems associated with the medical applications of the related concepts, for example measuring the concentration of haemoglobin in blood, the bone marrow density of a patient and many others. The students worked on these authentic problem in groups (other questions used during this intervention are included in Appendix S5, ESI†). Also important to be mentioned is the fact that tutorial sessions did not involve the use of direct guidance but rather the students were given the opportunity to explore concepts through the simulations.
Mean | N | Std deviation | Std error mean | |
---|---|---|---|---|
Pretest | 58.92 | 50 | 11.65 | 1.65 |
Posttest | 82.58 | 50 | 6.17 | 0.87 |
Table 2 above shows that the mean post-test attitude score (M = 82.58, S.D. = 6.17) was higher than the pre-test score (M = 58.92, S.D. = 11.65). A further breakdown of the questionnaire items into specific constructs revealed that, post-mean differences for individual constructs as featured in the ATC questionnaire were different. Table 3 shows that, even though the mean attitude scores for the post-test was higher for all four constructs in the ATC questionnaire, the highest post-test mean differences were recorded for the constructs “difficulty of chemistry module” and “interest in the chemistry module”.
Mean | N | Std deviation | Std error mean | ||
---|---|---|---|---|---|
Pair 1 | Difficulty-post | 22.60 | 50 | 2.277 | 0.322 |
Difficulty-pre | 15.38 | 50 | 3.386 | 0.479 | |
Pair 2 | Interest-post | 31.66 | 50 | 2.946 | 0.417 |
Interest-pre | 21.96 | 50 | 4.944 | 0.699 | |
Pair 3 | Usefulness-post | 11.50 | 50 | 1.705 | 0.241 |
Usefulness-pre | 8.06 | 50 | 1.900 | 0.269 | |
Pair 4 | Importance-post | 16.82 | 50 | 2.647 | 0.374 |
Importance-pre | 13.52 | 50 | 3.466 | 0.490 |
Table 3 above shows that, the large variation in the post attitude test scores was largely accounted for by 2 constructs, namely “difficulty of the subject” (M = 22.60) and “interest in the subject” (M = 31.66). This indicates that, prior to the virtual learning interventions, participants perceived the chemistry module to be difficult and did not show much interest in it.
After establishing that the data had a normal distribution, a paired sample t-test for pre and post-test scores was conducted. The results are captured on Table 4 below.
Paired differences | t | df | Sig. (2-tailed) | ||||||
---|---|---|---|---|---|---|---|---|---|
Mean | Std deviation | Std error mean | Lower | Upper | |||||
Pair | Post-test–pre-test | 23.660 | 8.385 | 1.186 | 21.277 | 26.043 | 19.952 | 49 | 0.000 |
As seen on Table 4, the post-test means were significantly higher than the pre-test means, with students showing a significantly more positive attitudes towards chemistry, t(50) = 19.95, p < 0.01 at 95% confidence interval. These results suggest that BEd 3rd year chemistry students showed an improvement in their attitudes towards chemistry post intervention with virtual learning using PhET simulations.
Despite the results obtained with the attitude test scores, more had to be done in establishing the rationale for the observed changes in attitude scores. We then proceeded to the next phase of the study and conducted semi-structured interviews with 10 of the surveyed students to gain further insights into their learning experiences in the virtual learning environment.
Semi-structured interview questions | Some quotations | Categories |
---|---|---|
How did you find the PhET simulation laboratories and the activities? Provide a brief explanation. | ∘ The simulations were very engaging and fun just to try | There is a game element with the simulations |
∘ Felt like I was playing a game | ||
∘ I enjoy the simulations as I could do them on my laptop at home | ||
After the intervention classes, did you need help with the activities associated with the PhET simulation laboratories? Explain your reasoning. | ∘ I did not need anyone to explain the tasks to me | Improved ability to self-teach |
∘ I found that I could self-direct my learning of the chemistry concepts and that was the best thing for me | ||
∘ There is a sense of accomplishment in knowing that I can understand certain concepts without asking for the lecturer's help | ||
∘ I could read and understand the instructions which boosted my ability to single-handedly solve chemistry problems | ||
What were some of the gains you observed with using PhET simulations? | ∘ I could do tasks without fear of spilling acid solutions or other reactants | Danger factor eliminated |
∘ You know with chemistry experiments there is always a danger factor. The simulations eliminated this fear | ||
∘ I could repeat task over and over without worrying about finishing the reagents | Trial and error is possible | |
∘ I kept practicing | ||
∘ With the PhETs the good thing is that if you don’t get it then you do it over and over again | ||
∘ I have no fear of making errors with the PhETs. I manipulated the effects of different variables in several of the chemical reactions | Increased confidence in problem solving | |
∘ You try different things in the virtual laboratories without fear of spoiling anything | ||
∘ The ability to do several different activities increased my confidence to deal with the problems from chemistry class | ||
∘ I found that I had more learning material than before, but more interesting from the comfort of my own space | Anytime and anywhere (convenience) | |
∘ All you needed was data, I did not have to be on campus to engage with my chemistry experiments | ||
∘ There were no time constraints for the laboratory session, since everything is online | ||
∘ The simulation laboratories are always available and do not close at the end of the school day like our laboratories at Varsity | ||
What were some of the disadvantages of using the PhET simulation laboratories? | ∘ The simulations create some misconceptions | Misconceptions |
∘ Misconceptions can be promoted and one needs to be careful when using simulations | Loss of realism | |
∘ I find the PhETs can be addictive | All curriculum learning outcomes are not covered | |
∘ I could stay on the computer and forget the time | Lack authenticity | |
∘ I am not sure if the PhETs cover our specific South African curriculum (CAPS) needs | ||
∘ I don’t think learners can learn science process skills by using these PhETS | ||
∘ The PhETs are not real, they are just so fake and you can’t touch anything or smell the fumes of any chemicals | ||
∘ They are all in a machine which is just…not tangible when I think of it | ||
Did the PhET simulations improve your conceptual understandings of the learned chemistry concepts in any way? | ∘ Yes very much, because I could try different experiments that enabled me to critically analyse some of the concepts in spectrophotometry | Improvement of conceptual understandings |
∘ For me yes because it was easy to do different difficulty level activities over and over until they I understood | ||
In your practice as an aspiring chemistry teacher will you consider incorporating PhET simulations when teaching certain abstract concepts? | ∘ Definitely yes | Open to try PhETs in teaching chemistry concepts |
∘ It is a yes for me since I find that these will capture my learners’ attention | ||
∘ I will most certainly incorporate them in all lessons were they can be beneficial | ||
∘ I may not use them for certain concepts as the learning outcomes may be missed | ||
∘ It is an excellent tool for complementing chemistry learning. So I will actually blend the PhET sims in my teaching | ||
∘ They are the perfect tool for a blended learning approach | ||
Do you have any advice on how simulations can be improved to meet learning needs for South African classrooms? | ∘ Yes, I believe that if we can make these simulations context-specific our students will really benefit more | Teachers and students should be equipped to design curriculum specific simulations |
∘ I think the simulations should target specific learning outcomes for the module or subject | ||
∘ Opportunity should be given to teachers and learners to formulate their own simulations to cater for diverse learning needs |
Based on content analysis of interview data, the following assertions were made by the researchers.
Assertion 1: Students perceive virtual reality simulations as fun and enjoyable
During follow-up interviews, the first question asked required that the students elaborate on their overall experience of virtual learning using simulations. All ten students indicated that learning using simulations was fun and it had a ‘game’ feel to it. For instance, student S1 stated “I really enjoyed investigating my chemistry concepts with the simulations. It felt like I was playing a game with multiple levels of difficulty”. Student S2 added “the simulations were very engaging and fun just to try”. For this assertion, 8 out of the 10 participant students indicated that simulations were fun while the remaining 2 interviewees indicated that, the simulations had a ‘game’ feel to them. These and other responses revealed that the 3rd year student associated a feeling of enjoyment and fun in using the simulations for their learning.
Assertion 2: Students assumed more autonomy for their learning when using the virtual reality simulations
When asked to explain if they needed help with running the simulations, one student S3 indicated, “I found the instructions for engaging with the simulations so simple that I could carry out the tasks without asking for help”. S4 maintained that “I could read and understand the instructions which boosted my ability to single-handedly solve chemistry problems.” While S6 also said that, “I did not need anyone to explain the tasks to me as I always did in the chem lab at Varsity”. In total, 7 out of the 10 participants indicated that their autonomy in solving chemistry problems had improved, while the remaining 3 indicated that they had always needed little or no assistance when solving problems in chemistry prior to this intervention. We then concluded that a strong sense of autonomy was seen to be one of the benefits yielded from using the virtual environment for learning chemistry concepts.
Assertion 3: Students showed increased confidence in chemistry investigations
When asked about the possible gains that came out of the virtual learning experiences, student S9 indicated that “I have no fear of making errors with the simulations as I usually do when I go to the lab”. S8 also added that “I could do a task without fear of spilling acid solutions or other reactants. You know with chemistry experiments there is always a danger factor.” A related sub-assertion is the convenience students associated with using these simulations. All the 10 participants indicated that using the simulations were more convenient for supporting their learning because they could access the experiments and activities anytime from anywhere. This convenience enable them to practice tasks, leading to increased confidence in their ability to solve chemistry problems and carry out chemistry investigations in a real chemistry laboratory. In other words words, students used virtual experimentation as a platform for trial and error, in preparing for traditional lab sessions.
Assertion 4: Student perceive virtual simulations to significantly improve conceptual understanding of abstract chemistry concepts
When asked if virtual learning activities improved conceptual understandings, all participants indicated that there was a significant improvement in their conceptual understanding of all aspects of chemical reaction and spectrophotometry. This assertion could explain the high attitude score for the construct “difficulty of the chemistry module” in the ATC post-test. Students indicated that concepts they previously found very difficult were now comprehensible. When probed on the qualities of virtual learning which enhanced their understandings, S2 indicated that, “I could visualise some of the abstract phenomena, especially with absorbance and transmittance.” S10 also said, “For me I find that it was the learning activities that enhanced my understandings coupled with the 2D representations of reactants and products in chemical reactions. Also, Activities had different levels of difficulty which kept me motivated to get to the next level.” In total 8 students indicated that their conceptual understandings were significantly improved, while the remaining two showed indifference
Assertion 5: Students perceived that simulations misrepresented chemistry bonding structures
When asked of the possible disadvantages experienced in this learning environment, student S7 indicated that “The PhET simulation 2D bonding structures could create misconceptions in the way they are represented.” when asked to elaborate on this, he stated that “the rigidity of the represented bonds in compounds and molecules within the stimulations hindered one‘s ability to visualise inter and intra-molecular bond interactions in a chemical reaction between two reactant. I feel generally representation of chemical interactions is problematic”. This elaboration was noted as many of the misconceptions that arise in chemistry stem from inadequate molecular level models used either in real or virtual laboratories. Student S10 indicated that “when balancing the chemical equations the number “1” is also placed in front of a single molar entity which is not the conventional way of representation when balancing chemical equations. But I think it is our place as educators to discuss these misconceptions when using the PhET simulations as an instructional tool”. Despite the fact that for this assertion, only 4 out of the 10 participants in this phase, referred to some misconceptions that could arise when using simulations, we considered it important to report their perceptions. This is because misconceptions can be very difficult to correct once created. Based on this assertion we concluded that, when using simulations as a teaching and learning tool, one has to be aware of possible misconceptions that can arise as a result of molecular level representations within the simulations and make these explicit to the learners upfront, before they engage in tasks.
Assertion 6: Students found that virtual experimentation lacked authenticity
With one of the goals of science learning being the ability to develop science process skills, all 10 students indicated that, virtual learning environments did not support the enhancement of skills such as measuring precise molar quantities of reactants and products, accurately titrating a base against an acid, or applying the use of one's senses (touch and smell). Student S3 said “I don’t think learners can learn science process skills by using these PhETs.” S6 also said “The PhETs are not real, they are just so fake and you can’t touch anything or smell the fumes of any chemicals.” S5 added that “they are all in a machine which is just…not tangible when I think of it”. The students further indicated there is an inherent loss of realism associated with virtual learning, and that this may misrepresent the nature of science to learners.
The integration of findings from the quantitative and qualitative phases of this study suggest that students had a favourable experience of learning chemistry in a virtual environment, and this resulted in a positive shift in their attitude towards chemistry. However, the students relayed that some caution needs to be exercised with simulations as they can lead to misconceptions and may not promote authentic learning. These findings are now discussed.
From the semi-structured interview phase, pre-service teachers indicated that they derived several benefits from using the virtual simulation laboratories for chemistry learning. Gains included, access to simulation from anywhere anytime, increased confidence in handling chemistry problems, a feeling of enjoyment and gaming while learning, more autonomy in doing learning tasks and the elimination of the fear factor associated with the dangers of chemistry experiments. These perceptions validate the theoretical underpinnings of this study in that learning can be fostered where there is a multiplicity of content representation (Mayer, 2011). Furthermore, the chemistry students indicated that, improved conceptual understandings was among some of the gains from using the simulations provided by PhET. These gains in conceptual understandings were associated with the opportunity to visualize concepts or phenomena, several opportunities for trial and error, and embedded learning activities with different levels of difficulty, which enhanced self-assessment. On the other hand, the students raised concerns that the simulations lacked authenticity and did not depict the realism associated with doing experiments in the laboratory. Similar to the findings in this phase, Hsu et al. (2017) reported that, students did not connect with the authenticity of virtual laboratory spaces.
The current study reports the findings of a study with a relatively small sample size and a low predictive power of factors that could possibly affected attitude scores. Based on these short comings, we cannot make any generalisations from the findings. Added to this is the fact that only a few chemistry concepts were exploited for the study and therefore we cannot assume that the experiences will be the same for all science subjects and concepts. We therefore, recommend that larger scale research be conducted to assess student attitudes towards virtual learning spaces in science teaching and learning. Pedagogical approaches with virtual simulations also merit further attention. Scientific inquiry has been advocated as a common curriculum goal in school science education in South Africa. Future research could investigate the affordances of virtual simulations in supporting inquiry-based learning.
Footnote |
† Electronic supplementary information (ESI) available. See DOI: 10.1039/c9rp00014c |
This journal is © The Royal Society of Chemistry 2019 |