Michael K.
Seery
School of Chemical and Pharmaceutical Sciences, Dublin Institute of Technology, Kevin St., Dublin 8, Ireland. E-mail: michael.seery@dit.ie; Fax: (3531) 4024789; Tel: (3531) 4024758
First published on 21st December 2011
This article summarises the author's experiences in running a module “Computers for Chemistry” entirely online for the past four years. The module, previously taught in a face-to-face environment, was reconfigured for teaching in an online environment. The rationale for moving online along with the design, implementation and evaluation of the online module are presented. The design and implementation were structured to align with Salmon's five stage model for e-moderating. The issues that arose on implementation are discussed along with an outline of supporting learners in an online environment. Lessons learned from running the module online are presented to provide interested practitioners some guidelines for adopting a similar approach.
A valid question to consider is whether an online environment will ultimately result in better learning—a question that can only be addressed in each practitioner's own circumstances. Salmon proposes that educators should ask themselves before considering a move online what the pedagogic rationale is for considering such a move (Salmon, 2002). This is an important starting point as moving online simply due to institutional pressures (e.g. purportedly to save money) or technological factors (e.g. demands from students for high-tech experiences that may be experienced elsewhere) are unlikely to motivate a practitioner to develop a sound learning environment. Pedagogic reasons for change may include attempts to enhance student-centred activity, harness technology to provide rapid feedback, facilitate student group work, provide student support to large groups and/or develop intimacy in the student-teacher relationship with large groups (Salmon, 2002).
This paper presents a report of the move from an in-class teaching approach to the use of virtual learning environments with content delivered through online resources and students supported primarily by discussion boards. A lot of material in the literature promotes the use of discussion boards to encourage reflection, but this is probably not the main learning outcome in technology disciplines, where outcomes such as the ability of students to be able to work in groups, solve problems and demonstrate critical thinking are considered important employability skills (Hanson and Overton, 2010). There are some useful reports which provides a critical appraisal of the use of discussion boards in online learning. Kanuka surveys the literature examining the use of internet based technology in facilitating a higher level of learning, against the backdrop that the technology has been in place for greater than a decade at the time of writing and that “sine non quo of higher education… is to improve critical thinking” (Kanuka, 2005). She reports some disappointing data in the use of technology in supporting this goal. A survey completed by over 2000 North American academics revealed that 57% of these academics believed web-based technology “had a positive impact on learning”, although this number should be considered in light of another comment, from the same survey which states that over one third of academics are extremely/very satisfied with student interest and participation because “their students are satisfied”. Participants in this report stated that they needed significant support in encouraging critical thinking (Saundercook and Cooper, cited in Kanuka 2005). Laurillard puts it very succinctly when she says that achieving higher levels of learning “remains an elusive goal” (Laurillard, 2002). It is in this context that the role of discussion boards in this online module are examined.
A difficulty for a lecturer used to teaching in class moving some or all of their teaching online is the question of how to actually teach online. A very useful model in this regard is that proposed by Salmon, commonly known as the five-stage model for e-moderating (Salmon, 2000). While this model, or rather the uncritical adoption of it as a model for e-learning, is open to debate (Moule, 2007) it suited this situation as the delivery and support of the module was primarily based in the discussion board. Salmon's five stages encompasses (1) access and motivation; (2) online socialisation; (3) information exchange; (4) knowledge construction; and (5) development. The implementation of the module described in this report is presented along these lines.
This paper aims to address the issues in developing a module for an online environment from a practitioner's perspective. The rationale for such a move is presented along with the support mechanisms used. In doing so it is hoped to provide an example for others considering moving some of their teaching online.
In order to address the deficiencies identified in the in-class environment, an online module was developed. The rationale for deciding to deliver online were that (1) students could review content in their own time, at their own pace—an important consideration for the broad range of capabilities within the group in using computer software; (2) students, upon coming across a problem would have to work through it independently, with some support from tutor and peers at a remove; and (3) the online environment would offer a flexibility in assessment so that learners of all abilities would be able to challenge themselves in applying the content.
The module was broken into five components, to run over five weeks. The components were: (1) drawing graphs in MS Excel, professional formatting; (2) handling experimental data in Excel, Excel functions; (3) statistics in Excel; (4) chemical drawing software and equations and (5) producing professional documents in MS Word. In this way, the delivery of material was iterative, so that each week progressively developed on the previous one, with the aim of producing a professional document (journal article or thesis) in MS Word by Week 5. This module immediately preceded (or ran alongside in one year) the students' final year project.
The learning materials were purposefully developed for the module to align with this content. Different styles of content were developed. Lecture notes were available with audio in screencasts produced in Camtasia Studio.‡ These essentially were a replica of the introductory talk that would accompany the in-class delivery of the module, although the design of the slides had a progress indicator and the various sections of the presentation were accessible through a table of contents embedded in the screencast. The material was also presented as screen-capture demonstration videos, again with audio and table of contents, produced in Camtasia Studio. These were by far a much more popular resource for students, so much so that the lecture notes were phased out when MS Office was updated from version 2003 to version 2007. The Excel files used in the demonstration videos were also available to students so they could practice what they had seen in the video for themselves. Other formats such as those suitable for iPod/iPhone were also developed, although there was little to no take up of these, and they were discontinued after one year.
Learning outcome | Teaching method | Assessment |
---|---|---|
a Rated on a progressive scale of 1–10% from no contribution (0), acknowledgement/little contribution (1–3%), requesting assistance (4–6%), responding to assistance (6–8%), showcasing work (9–10%). | ||
Use spreadsheets to produce graphs to the standard of a professional publication, for experimental data analysis and statistical analysis | Demonstration of how to complete these tasks with examples to practice on | Context-based activities relating to chemistry to showcase skills developed. (3 × 13%) |
Demonstrate competence in using chemistry drawing software of your choice to produce chemical structures of quality for professional publication. | Demonstration of how to complete these tasks with examples to practice on | Drawing a selection of chemical structures and reactions from a provided list and those relevant to final year project. (1 × 13%) |
Use Microsoft Word or equivalent to prepare a document of a professional standard suitable for publication or thesis, including the incorporation of figures, tables and equations. | Demonstration of how to complete these tasks with examples to practice on | Prepare a report of professional quality incorporating required elements based on a previously completed laboratory practical or an aspect of the final year project. (1 × 13%) |
Apply knowledge of chemistry and software in unfamiliar contexts for problem-solving and source relevant information for this purpose. | Supplement structured activities with open-ended exercises | Open-ended context-based assessment. (5 × 5%) |
Support a community of practitioners by sharing knowledge and information | Moderated discussion board | Assessment rubrica for discussion board contributions. (10%) |
The discussion board was also used to provide general class feedback on each weekly assignment. It was typical to have several issues that were common to many students, and this weekly general feedback aimed to highlight the most important of these, as well as provide a gauge to students how they were performing in the context of the general class feedback.
For two years of the four, a guest expert was invited onto the discussion board for one week to address any queries. This was done in week 3, to coincide with the statistics component of the module. A mathematics colleague whose expertise was in statistics joined the board for the week, so that students could ask questions related to statistics and have them answered by an expert in the field.
A weekly chat-room clinic was also tried for two of the four years. This was specifically to address any difficulties that were holding students back (e.g. technical, misunderstanding of assignment). While it was popular, it was difficult to find a time in the students' timetable when they were free, and as the use of discussion board became the norm (see below), the need for this clinic diminished.
This area was addressed by scheduling a face-to-face induction class. Students were given an overview of the module detailing the aims and expectations. The rationale for using an online learning environment was presented. Students were then asked to log on to the module in this class, and were encouraged to look around and try out some of the materials available—audio files, videos, notes etc. to ensure they could access them. Students were also encouraged to use the discussion board, and put up a post in a designated area. There was an informal (show of hands) discussion with students where they were surveyed on their prior experiences, computer access, internet access and type. In earlier years, some students did not have internet access at home, but more recently all students indicated they have had internet access. An important aspect from an organisational point of view was to have the room with computers timetabled for a certain time during the week, so that students knew they would definitely have access to the materials at a particular time, if required. The students were presented with the outline of the module and told to use the discussion board to raise any queries. The first of five assignments was then made available.
A key issue here on the role of induction is the initial engagement of students with the module, from an emotional perspective (interested to complete tasks, feelings about ability to do module) and a motivational perspective (hinting at the added value of online delivery, encouraging students to return). In the first year of implementation, the primary goal at induction was to ensure physical access, but emotional issues were not considered. After the first year, it became apparent that for genuine engagement to take place, it was important to address student concerns about their capacity to do this module “alone” (the most common and significant concern) and the unfamiliar territory of an online learning environment. To do this, examples of previous students' issues and their feedback were presented in class to provide a sense that the concerns students were having had been concerns of previous students that had been overcome.
In order to do this, students were initially provided with some links to external information—YouTube videos or other websites. As the weeks went by, less initial guidance was provided and students were required to source this information themselves. The rationale here was two-fold. In a subject were the interface is always changing, it is important to be able to source information that will be able to help in learning how to use new software or new interfaces. This addresses a larger issue around sourcing suitable information to learn how to learn. Secondly, it was important from the perspective of the sense of community in the module that the material very much addressed the students as chemists—and so the material in the additional assignments offered great scope to relate the algorithmic approaches to completing tasks in software to tackling problems in chemistry. As such, according to the ideas of Lave and Wengers' community of practice (1998), chemistry students are not learning how to use Excel, but they are learning how professional chemists would use Excel in their role, as well as the means of how to actually perform the tasks. Hence, if it is possible to harness this sense of contextualised role, it may be useful in providing authentic learning tasks.
Students were encouraged to assist each other in completing these tasks. With the exception of the first supplementary task, described above, all of the other supplementary tasks were quite open, in that students could draw whatever on content they wished to complete the assignment. This minimised any potential for plagiarism, as each submission was individual to student, albeit within a framework of whatever general approach was required. Assistance was shared on the discussion board and in turn by compiling a series of weblinks, which students submitted with an annotation describing their use. Therefore, the entire process at this stage very much mimicked a professional environment, as students were working on independent problems with the help of their peers. It can be argued that to truly incorporate the core value of the knowledge construction process in Salmon's model, the efforts of the group should be collaborative rather than cooperative, and a future iteration of the module may try to build in some more group-oriented tasks in this section of the assessment. Students are asked to showcase their work on the discussion board so that they could get ideas from each other about how particular approaches can be useful.
While the module induction formally ended after the initial in-class session, there were several recurring difficulties each year—some addressed in induction and others not—which needed to be clarified online. These included technical aspects, such as how to submit assignments or where to find some resources, which could be easily addressed through including a video on submitting assignments and having multiple signposts to information depending on where students were accessing it from. A very common issue that arose every year was the expectations of the quality of the assessment. Initially students may have thought the module to be easier than it was, as they had usually some experience in using the software. Therefore, in their first assessment, it was common, in about half of the cases in the earlier years, for students to submit their assignment having completed the tasks required but not considered the professional production required in the module. In these cases, it was likely that the students had not looked at the learning resources for the first assignment (which made the production standard clear), and just worked from prior knowledge. This resulted in a second online induction after the first assessment about the quality required, usually incorporated in general class feedback at the end of the first week and became less of a problem after that. In the last two years, this point has been made more forcibly in the initial induction, and this issue became less common.
Students were asked about the extent of learning they felt they had achieved, on a Likert scale (1–5). The majority of students over the four years of implementation agreed or strongly agreed with the with the statements that they “learned a lot” (80%), that the module was “intellectually challenging” (82%) and that their overall impression of the module was positive (90%). The remainder neither agreed nor disagreed, with some disagreeing. Those in the former category self-reported that they already had a high knowledge of Excel and Word. However, they also reported that the open-ended assignments gave them scope to try out new things and get feedback on these.
Aside from the quality of the materials, an interesting point was made by some students (in different years) about the nature and tone of delivery. One student commented that he “wanted more of funny Michael” and another that the materials were “sometimes too formal”. This can be interpreted as a plea for more personalised learning materials, and probably relates to the earlier points about emotional engagement with the module. This is clearly a difficult balance to strike, but perhaps a suitable middle ground is to keep audio narration casual. The tone of discussion boards mimicked the (relatively informal) tone in classes that students would be used to.
Another aspect of independence was reflected in the open-ended assessments. These allowed students to really challenge themselves in what they could do with the software. Some very good students, who were perhaps not served well in the old in-class module, were afforded an opportunity to try out some advanced features of software, such as writing macros or database-type features in Excel. In fact some students spent a huge amount of time working on these extra assignments, as they decided on what problem they were going to work on. In the initial design of the module, no marks were given for these assignments, but the topics covered would be asked in an in-class end of module exam. However, it was felt that since most students were spending a lot of time on this work, the end of module exam was superfluous, and the marks went directly to these assignments instead. This also prompted more students to do these assignments on schedule, rather than waiting just before the end of module exam, when it was in place.
The average class grade was monitored yearly (Table 2). In the last iteration of the in-class module, the average was 55%. In the first year online, with little discussion board support and an end of module exam, the average was 66%. The following year with much more extensive induction and discussion board support incorporated, the average was 72%. In the last two years, replacing the end of module exam mark with the supplemental assignment mark, the averages were 71% and 73%. Of course, a comparison between years is not possible as each year had different students and different circumstances and the assessment strategies differed, but the averages did help to reassure me as a lecturer that students were in general coping with the online environment while the same core content, and a lot of additional supplemental content was being covered.
Year 0 | In class | 55% |
Year 1 | Online, no discussion board | 66% |
Year 2 | Online, discussion board | 72% |
Year 3 | Online, discussion board and open ended course work | 71% |
Year 4 | Online, discussion board and open ended course work | 73% |
In terms of organising module content, it is necessary to have everything available from the start of the module. Resources, links and discussion boards should be clearly arranged and if possible, have multiple entry points. Assignments were released weekly.
Because it is unlikely that students will have taken an online module before, a clear set of guidelines needs to be explained at induction. This included things the kind of tutor support that would be available, discussion board etiquette, and time to allow for response to queries. For the latter point, I would try to check the discussion board twice daily, at lunch and in the evening, except in the first week when I would check 3–4 times per day. However, once the module got going and students got used to the routine, 1–2 times per day was more than sufficient. The agreement with students was that any query would be addressed within 24 h by me if it hadn't been answered by one of their peers, which in most cases, it was. It was important though to be seen to be visible, so if another student answered a query, I would acknowledge that, and perhaps prompt a further aspect to the discussion. If a student posted a query that no-one answered, I would reply to say that I saw the post and would get back to it within a given time if no-one replied first. There were typically about 500–600 posts per implementation for a class of 20 students. About half of these were instructor posts, and about 10–15% were social posts or acknowledgements by students. The remainder were queries or responses to queries by students.
A problem with “practice” literature is that it sometimes suffers from the Lake Wobegon effect, where all the students' interactions and learning are reported as being above average. Of course, in any real classroom, there is diversity in engagement and diversity in efforts on the part of students. In considering the students who have completed this course, it's possible to group them into four categories, shown in Fig. 1. Firstly there were the Wobegon students, those who engaged enthusiastically with the discussion board and worked very hard on their course work. Typically in each class, about 10% of these students were in this category, and occasionally they would be students who might not have been so vocal in lectures. These were very important to have on board, as they drove the module online—the engagement ultimately has to come from students. In one year, there were no students who fitted into this category, and the module did not run as well, and it took a lot more work as an instructor to prompt and encourage engagement. The only thing to caution about this group is that their interactions should be tempered so as they don't dominate the discussions. Replies like “That's a good point, what do other people think?” were an approach to deal with this.
![]() | ||
Fig. 1 Categories of students in terms of work effort and engagement on the module. |
The second group of students were those who worked hard but did not engage in the social dimension of the boards. This could have been due to shyness, or sense of the fact that there was nothing to be gained from engagement. Usually though, they were drawn toward the first group as the module progressed, especially if their first assignment did not go well for reasons discussed above. However, effective methods encouraging ‘lurkers’ into engaging include summarising by name or theme the contributions made so far and asking what other people had to say about whether they agreed or disagreed. This usually pulled in those who were enthusiastic about the module content, but were initially reticent or lazy about engaging. Those who were too shy to post were more difficult, but it was important that no-one was ever identified as not being a contributor. Ultimately, the choice was theirs. This second group made up the vast majority of students on the module—typically about 80%—perhaps because it was their final year and they were motivated to do well.
Some students did not engage or work hard on the module (∼10%). Interestingly, some of these were active on the boards, offering suggestions or engaging in the social aspects. They just didn't get their work in on time! These students were dealt with by occasional email prompts, offering suggestions of time-management and clarifying the components of each week's assignment. This often helped. Finally there were those who did not engage or work on the content. For these students, the goal was to get through the module with minimum effort. Again, email prompts here had some effect, usually in getting the students to at least complete the core component of each week's work.
Footnotes |
† Higher education degree awards in Ireland are made at Level 7 (three year General degree), Level 8 (four year Honours degree), Level 9 (Masters degree) and Level 10 (Doctoral degree) in accordance with the Irish National Framework of Qualifications. |
‡ Camtasia Studio is commercial screen-casting software from Techsmith—www.techsmith.com. |
This journal is © The Royal Society of Chemistry 2012 |