Biogeochemical cycles for combining chemical knowledge and ESD issues in Greek secondary schools part II: assessing the impact of the intervention

Sophia Koutalidi a, Vassilis Psallidas b and Michael Scoullos *ab
aEnvironmental Chemistry Laboratory and UNESCO Chair & Network on Sustainable Development Management and Education in the Mediterranean, National and Kapodistrian University of Athens, Department of Chemistry, Panepistimiopolis 15771, Athens, Greece. E-mail: scoullos@chem.uoa.gr; Fax: +30 210 7274432
bMIO – ECSDE Mediterranean Information Office for Environment Cultural and Sustainable Development/MEdIES: Mediterranean Education Initiative for Environment and Sustainability, 12, Kyrristou Street, 10556, Athens, Greece

Received 19th May 2015 , Accepted 22nd September 2015

First published on 22nd September 2015


Abstract

In searching for effective ways to combine science/chemical education with EE/ESD, new didactic materials were designed and produced focussing on biogeochemical cycles and their connection to sustainable development. The materials were experimentally applied in 16 Greek schools under the newly introduced compulsory “school project” which offers an excellent opportunity for the development of EE/ESD projects. The effectiveness of the intervention was assessed on the basis of questionnaires including knowledge and attitude questions and considering several factors (students' performance/grades, sex, previous participation in EE/ESD programmes, parents' educational level, etc.). The results demonstrated a positive impact on students' knowledge not only on biogeochemical cycles, but also on aspects related to sustainable development. Similarly, several components of students' attitudes vis a vis the environment and sustainable development (e.g. “Action commitment”, “Efficacy perception of personal action” and “Sustainable orientation of the positive attitude towards the environment”) were influenced positively.


Introduction

The present research examines the potential of chemistry/science education and, in particular, the study of biogeochemical cycles as appropriate and effective vehicles for introducing learners, not only to the environmental but to all facets of sustainable development (Scoullos, 2010). The introduction of Environmental Education (EE) and Education for Sustainable Development (ESD) concepts, methods and competences into formal education was one of the key goals of the UN Decade of ESD (UNDESD) and is commented as priority in the post Nagoya Global Action Programme (GAP) (UNESCO, 2014). In the Greek schooling system ESD introduction is considered as a strategic goal of the multi-annual work programme of the Ministry of Education and it is supposed to be obtained through alternative approaches that have been reviewed as the background of the present work by Koutalidi (2015). Based on this mapping and analysis, appropriate interventions were designed, including the production of didactic materials (Koutalidi and Scoullos, 2015a), which were applied experimentally in 569 students of 16 secondary schools. The present article focuses on the implementation and assessment of the impact part of the research programme, on the knowledge and attitudes of students while the design and production of the didactic materials have been presented in Article/Part I (Koutalidi and Scoullos, 2015c).

The guiding idea of this work is that a good understanding of these cycles is essential from a scientific point of view, because it could enhance learners' knowledge and environmentally friendly attitudes in linking these cycles with their everyday life.

One of the major problems in introducing sustainable development issues in school curricula is the identification of suitable “frameworks” for developing the concepts as well as knowledge, critical thinking and action opportunities for learners. The “framing” issue is closely linked to whether, when, where and how the issues will be presented, taking also into account the overloaded “standard” curriculum which, in the case of Greece, is applied uniformly throughout the country. The limited available time and the “crowded” students' programmes are interlinked. In many schooling systems, “new” knowledge is simply “added” to existing programmes in a rather superficial way, or “replaces” knowledge which in some cases is done at the expense of those more “general” elements and conditions necessary for the gradual development of knowledge and values by the learners through critical and systemic thinking.

If ESD has something important to offer is not so much “new” information but higher “quality in the interpretation” which could lead to balanced knowledge of higher value. In this respect, through the present research, we wanted to associate our intervention to “value added” to knowledge already provided to students through the standard curriculum, without overloading their programme.

The options examined for Greece were either to introduce ESD as an individual “integrated” and “interpretive” lesson, or to modify and enrich existing well established subjects using them as “carriers” of ESD and SD messages. Both options have “pros” and “cons”.

Greece has a long tradition in E.E. Every year many hundreds of EE/ESD projects are carried out throughout the country where 50 Centres for EE/ESD operate in nearly all Prefectures (UNESCO, 2014). The UNECE Strategy for ESD (UNECE, 2005) was endorsed and formally introduced in the Greek educational system since 2006. Despite the above, there are no specific provisions and time allocation in secondary school curricula for a dedicated and structured ESD approach. Teachers are encouraged to act independently by introducing SD themes to their regular teaching. Since the academic year 2011–2012, a new “opportunity” is offered through the introduction of a new “compulsory” subject, the so called, “school project” (GG, 2011), which has as main aim the enhancement of “interdisciplinary”. The Teacher Council of each school decides on a number of potential themes for “school projects” covering four thematic directions or a combination of them which apparently is preferred by many educators. The four themes are: (a) Humanities and Social Sciences, (b) Art and Culture, (c) Mathematics, Science and Technology, (d) Environment and Sustainable Development. The thematic proposals are presented to the students who, through guided discussion, choose the specific theme for the project and in many cases propose their own amendments to it. According to their choices they are grouped and “follow” the specific project for either the first or the second semester for each school year at the first year of junior secondary school/high school (ages 15–16 years old), (Greek Ministry of Education, 2011). This approach offers flexibility for ESD initiatives and combinations with other subjects, though many teachers feel that they are left on their own, largely “unguided” to identify the most appropriate themes to be used, as well as, tools and methods for the design and implementation of ESD interventions.

In view of the above, after a careful review of the content of the formal curriculum lessons and textbooks and the methods employed and through consultations with a group of active educators of different disciplines we concluded that the inherent multi- and intra-disciplinary character of the biogeochemical cycles may offer an attractive and potentially efficient way to combine chemistry and science in general with ESD thus responding to themes (c) and (d), mentioned already, of the compulsory “school programme”. Biogeochemical cycles were identified as of “particularly high importance” by many educators and, also, as an area where many of them felt that additional guidance and support were needed. The theme offers also an opportunity for directly sharing experiences on ESD among educators (including in-service training and informal) of different scientific origin and background.

Research methodology

The research questions

The questions that guided the present research are:

• What is the students' knowledge, understanding and possible misconceptions related to the hydrological cycle and biogeochemical cycles of carbon, nitrogen, phosphorus and sulphur?

• What are the prevailing students' attitudes about the environment and sustainable development and what are the main factors shaping them?

Designing of the intervention

The educational intervention required the construction and implementation of suitable didactic materials assessed directly by educators and students and through assessment of their impact on the basis of the pre- and post-control method by employing a questionnaire, on experimental and control groups (Bieger and Gerlach, 1996; Cohen and Manion, 1997; Wiersma, 2000). The experimental group was subjected to the intervention while the control group was not.

The construction of the questionnaire

A two part prototype questionnaire was designed. The first part included the demographic characteristics of the student while the second, knowledge and attitude questions (see Appendices 1 & 2a and b). Knowledge was assessed through sixteen four option “Multiple choice” and nine “True–false” questions. The attitudes were assessed through twenty nine self-responding behaviour questions in four expressions of commitment; “Action commitment”, “Verbal commitment”, “Efficacy perception of personal action” and “Sustainable orientation of the positive attitude towards the environment”. The latter was introduced to identify/clarify the nature of commitment and distinguish the “motives” behind it (e.g. those responding to economic incentives from those based purely on ethical principles). For assessment of attitudes the five point Likert scale was employed in two formats: (1 never, 2 seldom, 3 sometimes, 4 often, 5 always & 1 I disagree totally, 2 I rather disagree, 3 I am not certain, 4 I tend to agree, 5 I fully agree) (Likert, 1974).

The questions were formulated considering the principles of ESD, the provisions of the national curriculum and the content of the standard textbooks, which are common in all schools throughout the country. Some of the questions were invented for the needs of this research, while others derive from previous surveys of our research team (Papadopoulos, 2005; Dikaiakos, 2009; Roussos, 2010).

The construction of the questionnaire followed a number of steps: (a) it was presented to a team of peer reviewers for face and content validity (approval with a >70% agreement); (b) it was slightly amended through a consultation with the supervisor and a small team of experts and (c) it was presented to students to assess the comprehensibility and suitability of its format and (d) it was applied to 205 secondary school students and the results were used for evaluating the reliability of the instrument and its finalisation. The results were statistically treated by using SPSS 13. The questions finally selected and included in the questionnaire had values of the Cronbach's Alpha reliability coefficient 0.737 for the multiple choice questions and 0.607 for the “true–false” ones while for the attitudes the coefficient value was 0.829. These values fulfil the criteria according to the relevant literature, indicating reliability and internal consistency of a test/scale/questionnaire (Cronbach, 1984; Anastasi, 1988; Litwin, 1995; Cohen et al., 1996; Tavakol and Dennick, 2011). In addition, the Cronbach's Alpha values with one question removed from the test at a time, in order to assess the acceptability of the individual questions and to omit from the questionnaire any problematic questions, are given in Appendices 3 & 4a and b. It is clear that, if each question is omitted, the remaining questions have Cronbach's alpha values less than the above mentioned values for each category of questions, respectively, and, therefore, the set of questions helps the internal consistency of the scale. The same goes for the scale mean and variance of the questions.

The design of the didactic materials

The didactic materials were designed and produced by using current, state-of-the-art methodology including the identified through the questionnaire knowledge gaps and misconceptions of students, examination of the relevant literature, consideration of the needs of educators involved in the teaching of science, EE and ESD, and the specificities of the Greek schooling system, as described in Part I (Koutalidi and Scoullos, 2015c).

The intervention

The intervention was carried out during the school year 2011–2012 and lasted for one semester and more specifically for three hours per week for thirteen weeks. At the beginning of the intervention the questionnaire was filled by the students subject to the intervention as well as the control group to allow the evaluation of the programme at the end of it.

One of the features of this research was the effort to capture “real conditions”. The intervention was made in sixteen (16) schools selected from urban and suburban areas of south east and central Greece. Apart from obtaining a fair, statistically sound geographical distribution, the specific schools were chosen randomly. The participating educators were of different age, gender and level of teaching experience and they were involved in the project because they were available at the given time and willing to participate. Their scientific background varied considerably from chemistry, physics and agricultural science, to mathematics, informatics, engineering and, even, law. Obviously their overall and specific expertise, experience and competences on ESD as well as their teaching style and performance differed considerably, despite the guidance, mentoring and assistance by the research team. This is why the intercomparisons among the participating schools were not attempted, considering all the 22 educators involved as one group and the sum of all 569 students also as another single group, both samples reasonably representative of the entire Greek schooling system. In this respect the assessment of the impact of the didactic material and intervention on learners could be considered as independent of the specific educational environment and conditions of each school and it does not reflect specific skills and competences of individual educators. The schools' participation in the research was voluntary and based on an agreement reached between on the one hand, the University of Athens, and on the other the Teacher's Council and the Headmaster of each participating school, who have thoroughly examined the scientific, educational and ethical aspects of the project based on strict criteria, similar to those included in the CERP ethical considerations (Taber, 2014). Furthermore the students were fully informed in advance for the research character of the project, taking into account all relevant principles, allowing them to make their own choice for participation in this particular programme.

The teaching methods employed for the intervention, included activities in the classroom such as brainstorming, conceptual mapping, experiments, use of simulations and models, various constructions, dramatisation, etc. and also field activities in urban environments and specially designated areas (Scoullos et al., 2008). Apart from the “core” activities, several “peripheral” ones were organized to encourage students to come together, create engagement, enhance ownership and undertake individual responsibilities, according to the principles and practices of ESD (Scoullos and Malotidi, 2004; Eilam and Trop, 2010).

Following the intervention the students were invited to fill in the questionnaire which was also completed for a second time by the control group.

Statistical analysis for the assessment of the impact

The answers of the students were treated statistically in order to evaluate the impact of the intervention. Descriptive statistics for the characteristics of the study population, by group and overall, are given, for categorical variables, as absolute (N) and relative (%) frequencies within two-way tables. For continuous variables, including scores, the respective distributions are summarized through their median and interquartile range (IQR). For easier comparisons, scores are presented in a transformed 0–100% scale (i.e. the highest theoretically possible score corresponds to 100 and the lowest to 0). P-values in the tables with the descriptive statistics are based on the chi-square and Mann–Whitney U-tests.

Formal inference and derivation of various estimates (e.g. average pre- to post-test change in scores within a group, difference in changes between groups) are based on appropriate models for repeated measurements data. More specifically the fractional logistic model for proportions (Papke and Wooldridge, 1996) was used in order to take into account the restricted range of theoretically possible values in each specific score. Potential correlations between initial and final scores of the same student were taken into account by assuming a marginal model for longitudinal data with an unstructured variance–covariance matrix for the residuals. Estimation of model parameters was based on the generalized estimating equation–GEE methodology (Zeger et al., 1988). Models were initially unadjusted and included only the group and time effects along with their interaction but additional covariates were included in multivariable models (when statistically significant or marginally significant), in order to adjust for potential confounding effects.

All analyses and data treatment have been performed using Stata 10 (Stata Corp. TX USA) and SPSS 13 (SPSS Inc. Chicago); p-values < 0.05 have been considered as indicating statistical significance.

Results

Demographic and other relevant characteristics of the study population, according to group assignment (i.e. experimental or control), are summarized in Table 1. Differences in the distribution of these characteristics, between groups, were not significant and rather small. The only noteworthy exception concerned students who had participated in an EE/ESD program before the present study. Their proportion in the control group was higher (p = 0.001) (∼54%), compared to the experimental one (∼40%).
Table 1 Characteristics of the study population by group and overall
  Group p-Value
Control Experimental Overall
N = 285 N = 284 N = 569
N (%) N (%) N (%)
a Interquartile range.
Gender 0.737
Male 153 (53.7) 148 (52.1) 301 (52.9)
Female 132 (46.3) 136 (47.9) 268 (47.1)
Father's educational level 0.060
Not finishing primary school 1 (0.4) 2 (0.7) 3 (0.5)
Primary graduate 16 (5.6) 9 (3.2) 25 (4.4)
Junior High school graduate 24 (8.5) 15 (5.3) 39 (6.9)
Senior High school graduate 83 (29.2) 76 (26.8) 159 (28.0)
Technical school graduate 41 (14.4) 65 (22.9) 106 (18.7)
University graduate 119 (41.9) 117 (41.2) 236 (41.5)
Mother's educational level 0.879
Not finishing primary school 2 (0.7) 1 (0.4) 3 (0.5)
Primary graduate 11 (3.9) 8 (2.8) 19 (3.3)
Junior High school graduate 16 (5.6) 15 (5.3) 31 (5.4)
Senior High school graduate 94 (33.0) 86 (30.3) 180 (31.6)
Technical school graduate 47 (16.5) 54 (19.0) 101 (17.8)
University graduate 115 (40.4) 120 (42.3) 235 (41.3)
Previous participation in EE/ESD program(s) 0.001
Yes 155 (54.4) 115 (40.5) 270 (47.5)
No 130 (45.6) 169 (59.5) 299 (52.5)

  Median (IQRa) Median (IQRa) Median (IQRa) p-Value
Average grade in school lessons (0–20) 17.2 (15.4, 18.7) 17.0 (15.2, 18.5) 17.1 (15.3, 18.6) 0.286


The distribution of the various scores (i.e. “True–false”, “Multiple choices”, “Action commitment”, “Verbal commitment”, “Efficacy perception of personal action”, “Sustainable orientation of the positive attitude towards the environment”) by group and occasion (i.e. at baseline and at the end of the study period) is summarized in Table 2. All scores have been transformed into a common 0–100% scale. As shown in this table, the evolution of the scores, from the baseline to the final test, in the control group, suggests, as expected, stability or a rather small decrease. On the other hand, scores from students belonging to the experimental group were, in most cases, higher at the end of the study compared to the respective initial levels.

Table 2 Distribution of scores by group and occasion. All figures are median (interquartile range). Scores are given as percent (%) of the maximum theoretically achievable score
  Group
Control occasion Experimental occasion Overall occasion
Baseline Final Baseline Final Baseline Final
Type of score
“True–false” 88.9 (77.8, 100.0) 88.9 (77.8, 100.0) 88.9 (77.8, 100.0) 100.0 (88.9, 100.0) 88.9 (77.8, 100.0) 100.0 (77.8, 100.0)
“Multiple choices” 50.0 (33.3, 75.0) 50.0 (33.3, 75.0) 58.3 (41.7, 66.7) 83.3 (66.7, 100.0) 50.0 (33.3, 66.7) 66.7 (41.7, 91.7)
“Action commitment” 76.0 (64.0, 88.0) 72.0 (64.0, 88.0) 80.0 (64.0, 88.0) 84.0 (72.0, 94.0) 80.0 (64.0, 88.0) 80.0 (68.0, 92.0)
“Verbal commitment” 73.3 (63.3, 80.0) 70.0 (60.0, 80.0) 76.7 (66.7, 86.7) 76.7 (66.7, 86.7) 73.3 (66.7, 83.3) 73.3 (63.3, 83.3)
“Efficacy perception of personal action” 76.7 (63.3, 86.7) 73.3 (60.0, 83.3) 76.7 (70.0, 86.7) 80.0 (70.0, 90.0) 76.7 (66.7, 86.7) 76.7 (63.3, 86.7)
“Sustainable orientation of the positive attitude towards the environment” 82.2 (73.3, 88.9) 80.0 (68.9, 88.9) 84.4 (75.6, 91.1) 86.7 (74.4, 93.3) 82.2 (73.3, 91.1) 82.2 (71.1, 91.1)


Table 3 summarizes results from a multivariable model for the evolution of scores related to the knowledge of students. The results of the scores of “true–false” type knowledge questions, adjusted for gender and grade, indicate that students in the experimental group scored slightly higher (p = 0.002) at baseline compared to students in the control group. After the intervention, scores in the experimental group increased significantly (p < 0.001) whereas the respective scores in the control group remained practically stable (p = 0.113). The estimated changes between the final and the baseline tests correspond to an average (95% Confidence Interval-CI) increase of 4.13 (2.15, 6.11) units, in the 0–100 scale, in the experimental group and simultaneously an average (95% CI) decrease of 2.16 (−0.54, 4.86) units in the control group providing a statistically significant (p < 0.001) difference between these two changes. Better performance (higher grades in school lessons) were associated with both higher scores at baseline (p < 0.001) and more pronounced increases due to the intervention (p = 0.035). Finally, girls tended to have higher scores compared to boys both at baseline and at the final test (p = 0.043).

Table 3 Results from multivariable models for the evolution of (a) “True–false” type and (b) “Multiple choices” type knowledge question scores
Grey shaded areas denote factors which were not statistically significant and were not included in the model.a Estimated coefficients refer to logit transformed score values (rescaled to a 0–1 range).b 95% confidence interval.
image file: c5rp00093a-u1.tif


Regarding the “Multiple choice” type knowledge questions, the results follow the same trends. The two groups started from similar score levels (p = 0.516) but students in the control group showed a small but significant decrease at the final test (p = 0.018) whereas students in the experimental group had a substantial increase (p < 0.001). Estimated changes correspond to an average (95% CI) decrease of 4.21 (0.71, 7.71) units for the control group and an average (95% CI) increase of 22.53 (18.95, 26.10) units for the experimental group with highly statistically significant difference (p < 0.001) between the two groups. Higher grades were again associated with higher scores (p < 0.001). Girls had a slight disadvantage at baseline (p = 0.043) but they reached comparable levels with boys at the final test. In both types of knowledge achievements, previous participation of students in EE/ESD programs did not have any significant effect neither at the baseline nor at the final test levels.

Results from a multivariable model for the evolution of attitude related scores are given in Table 4 “Action commitment” scores were comparable at baseline (p = 0.202) for both groups but while the control group showed a small tendency for decreasing scores (p = 0.077), students in the experimental group had a clear improvement (p < 0.001). The estimated average (95% CI) changes from baseline to the final test were −1.45 (−3.06, 0.16) and 4.59 (2.80, 6.39) units, respectively, in the 0–100 scale for the control and experimental group, and the difference between the two groups was statistically significant (p < 0.001). As in previous cases, higher school lesson grades and female gender were associated with higher scores at both tests (p < 0.001 and p = 0.015, respectively). Moreover, in this case, previous participation in EE/ESD programs was associated with higher overall scores (p = 0.013).

Table 4 Results from multivariable models for the evolution of (a) “action commitment” and (b) “verbal commitment” scores
Grey shaded areas denote factors which were not statistically significant and were not included in the model.a Estimated coefficients refer to logit transformed score values (rescaled to a 0–1 range).b 95% confidence interval.
image file: c5rp00093a-u2.tif


Considering the scores for “Verbal commitment” there were significant differences between the two groups with initial scores being higher in the experimental groups (p = 0.001). However, students in the experimental group practically retained their initial levels till the end (estimated change 0.20 units; 95% CI: −1.42, 1.83; p = 0.804) whereas students in the control group had significantly decreased levels at the final test (estimated change −2.14 units; 95% CI: −3.88, −0.39; p = 0.017). The differences between the two groups were rather non-significant (p = 0.065). Similar to other scores, previously analyzed, higher grades in school lessons (p = 0.005) and female sex (p < 0.001) were both associated with higher scores.

The results from the last two multivariable models, of scores on “Efficacy perception of personal action” and “Sustainable orientation of the positive attitude towards the environment”, are summarized in Table 5. As in most previous cases, students in the experimental group scored slightly higher at baseline (p = 0.012 and p = 0.104 for the two scores, respectively) but, while those in the control group had decreased scores at the final test (p < 0.001 for both scores), those in the experimental one achieved increased scores after the intervention (p = 0.040 and p = 0.077 for the two scores, respectively). The estimated (95% CI) changes for the “Efficacy perception of personal action” score were −2.98 (−4.64, −1.33) and 1.64 (0.08, 3.21) units of the 0–100 scale for the control and experimental group, respectively. The corresponding estimates for the “Sustainable orientation of the positive attitude towards the environment” score were −3.88 (−5.52, −2.24) and 1.38 (−0.15, 2.92), respectively. In both scores, the difference between the two groups in terms of changes from baseline to final examination was highly significant (p < 0.001). Similar to previous cases girls and those with higher average grades in school lessons scored significantly higher (p ≤ 0.001 in all cases). It was found that the higher educational level of the students' fathers was significantly associated only with one attribute, the higher “Sustainable orientation of the positive attitude towards the environment” (p = 0.001). Finally, participation in an EE/ESD program before the current study had no effects on the initial scores or in their changes from the baseline to the final test.

Table 5 Results from a multivariable model for the evolution of (a) “efficacy perception of personal action” and (b) “sustainable orientation of the positive attitude towards the environment” scores
Grey shaded areas denote factors which were not statistically significant and were not included in the model.a Estimated coefficients refer to logit transformed score values (rescaled to a 0–1 range).b 95% confidence interval.
image file: c5rp00093a-u3.tif


As it concerns the overall character of the intervention, we observed that students appreciated much more the hands-on activities (such as experiments, construction of models and work in the field) versus the traditional teaching in the classroom. The impact of these activities was recognized by both students and educators through additional evaluation questionnaires and interviews (Koutalidi, 2015; Koutalidi and Scoullos, 2015b).

Discussion

When we decided to undertake the present research we were aware that in Greece, as is the case also in many other countries, chemistry was perceived by students as being a difficult subject (Johnstone, 2000; MacCarthy and Widanski, 2009) and the biogeochemical cycles were considered by many Greek educators as some of the most difficult issues. To choose, therefore, this genuinely difficult and complex subject as the “carrier” for sustainable development issues, including socioeconomic and geopolitical aspects, was both a challenge and a risk. Several educators involved had openly expressed their fears.

However, the results show clearly that the intervention was very successful and has influenced positively the knowledge of students at many levels while it has also a noticeable impact on many components of attitudes. Positive results have been reported previously by other workers using comparable educational interventions linking chemistry to EE, on environmental pollution issues (Mangas et al., 1997; Vasisilopoulou, 1998; Morgil et al., 2004). Those interventions were particularly successful as it concerns enhancement of knowledge. Literature shows that the impact of educational interventions on attitudes may not be so obvious, if at all observed (Kortland, 1997; Smith-Sebasto and Semrau, 2004; Papadopoulos, 2005).

The impact of the intervention in our case, as indicated by the results, was positive for both knowledge and attitudes. It has reduced misconceptions (e.g. in distinguishing between the “greenhouse effect” and climate change) and has made the link between the biogeochemical cycles and critical sustainable development issues (e.g. production and consumption patterns, environmental pollution, ecosystem services) much more visible. The intervention was more effective on better students (those who performed better/obtained higher grades) in general school subjects, a finding which is in agreement with results of other surveys carried out in Greece and elsewhere (Trikaliti, 1995; Yilmaz et al., 2004; Papadopoulos, 2005). The impact of the intervention was also higher on girls who (judging from the degree of change in their attitudes) seem to be more readily sensitized than boys on environmental and sustainable development issues. The better environmental performance of girls has been demonstrated by other researchers too (Trikaliti, 1995; Mogensen and Nielsen, 2001; Yilmaz et al., 2004; Tuncer et al., 2005; Papadopoulos, 2005). This could be, at least partly, explained by the fact that the percentage of “good” students is higher among girls. The fact that the correlation between knowledge and certain components of attitudes was not always very significant may be attributed to the fact that attitudes are shaped to a large extent by emotions and not so much by intellect. In the present approach the use of biogeochemical cycles as a “vehicle” attempts to shape attitudes by developing critical and systemic thinking, relying heavily on science. The new message coming out through our intervention is that visible and invisible aspects of the biogeochemical cycles are interlinked and interrelated, directly and indirectly, with socioeconomic and cultural impacts, health effects and value systems, all of which are critical for the achievement (or not) of sustainable development. The above results explain why the approach is chosen, which “speaks” more to the mind than directly to the heart of students, has a more profound impact on those who “function” better using their intellect, therefore better students, and apparently the more “mature” ones, among which we find more girls than boys of the age of 15–16 years old.

According to the results of the survey, no correlation was found concerning students' knowledge and attitudes with previous participation in EE/ESD programs except from the component of “Action commitment”. This result could be linked, to some extent, to the demographic information of Table 1, showing that most of those who have participated in previous EE/ESD interventions had not selected “biogeochemical cycles” as the project theme. This could be attributed either to the fact that some of these students did not associate in their mind directly the cycles with the environment or, eventually, because some others felt that they had already “enough” on the environment and wanted to explore other fields. The lack of correlation may seem, at first approximation, at odds with other surveys that have been carried out in Greece in the past, according to which students who have participated in environmental programs develop more friendly attitudes towards the environment (Trikaliti, 1995; Papadopoulos, 2005). However, in the above mentioned, purely EE surveys, the intervention was a straightforward information and sensitization process on environmental changes and solid wastes, respectively, and the attitude change was a direct response of the students towards “protecting the environment”. Under such circumstances students could easily recall similar messages from their previous EE experiences, many of which generate emotional reactions. Comprehension of sustainable development issues dealing with complexity and systemic approaches, where attitude changes are the secondary result of subsequent transformation of information to knowledge, is a far more complex intellectual process which primarily requires fresh and alert minds, able to concentrate, imagine, combine and assimilate in a short period of time difficult and abstract notions. In such a process previous experiences may or may not matter, because memory and impact of previous experiences may vary significantly and, though important, come second as a support process to the genuine capacity of the student to “learn and know”. It is not a coincidence that the survey of Dikaiakos (2009), which focused on sustainable development issues linked with energy consumption and climate change, carried out in Greek schools at the 1st year of upper secondary school classes, (viz having exactly the same age target group with the present research), concluded that previous participation of students in EE/ESD programmes had no impact on the “Action commitment” and “Verbal commitment” of attitudes and resulted only in reinforcement of the “Efficacy perception of personal action”. Again the latter was related to the conviction developed by learners about their role in obtaining energy efficiency (a concrete result), if they acted accordingly. Such a message was rather absent or more defused in the biogeochemical cycles approach, which however enhanced specifically the “Action commitment” component of attitude more among the students who have been exposed previously to EE/ESD interventions, in comparison to the rest.

While it is frequently reported in the EE literature that students with better educated parents tend to have (a) higher ability to assimilate knowledge (Trikaliti, 1995; Gambro and Switsky, 1999; Makki et al., 2003; Papadopoulos, 2005), and (b) more environmental sensitivities, more positive attitudes and, in particular, “Verbal commitment”, the results of the present research concluded that the parents' educational background had no impact on neither the knowledge nor the majority of the components of the attitudes, except the “sustainable orientation of the positive attitude towards the environment”. Research on students of the same age (Dikaiakos, 2009) came up with similar results, where it was observed in particular that the parents' educational level had no impact on components of attitudes such as “Efficacy perception of personal action” and “Action commitment”. The potential explanation of the reported differences may be attributed to a number of reasons or rather a combination of them. In many countries, particularly in previous decades, the educational background was, to some extent either the result of a genuine, very strong drive of individuals for knowledge and personal development and to a large extent closely related to prosperity. Better off families secured better and higher education for their children. The relationship between environmental awareness and living standards is well documented for the 1970's and the 1980's, as is also the correlation between prosperity and the level of education obtained, particularly in countries where higher education is not free. In highly stratified societies, the percentage of people with higher education degrees, who better understand environmental, and particularly SD issues and have, at least, high “Verbal commitment” attitude towards the environment is directly proportional to the socioeconomic status. Therefore, and for the first decades of environmental awareness, clear correlations are more visible.

In countries like Greece where education, including higher education, is totally free and particularly in the last few decades, the percentage of people with higher education degree is extremely high: In the study sample 60.2% for fathers and 59.1% for mothers with children of average age of sixteen (see Table 1), whereas those with secondary education diploma represent 28% of fathers and 31.6% of mothers indicating a weak influence on the educational background and lack of direct correlation between prosperity and the level of education. If the recent economic crisis, which has affected vertically the Greek society, is added to the above picture, we may be able to explain, at least partly, the findings, while the fact that SD issues are considered to be new, rapidly evolving and complex for all adds to the equation.

Conclusions

In the present work we report the results of our research in addressing a series of the most common problems of both ESD and chemical/science education, namely the appropriate practical ways and tools in order to fulfil their mission by enhancing meaningful knowledge and facilitate learners to learn how to incorporate new information to existing knowledge developing their own “body of knowledge”, which extends beyond a single subject through critical and systemic thinking into better understanding multi-disciplinary and intra-disciplinary issues and into formulating opinions and positive attitudes towards the environment and sustainable development. To do so we, examined alternative educational options of the Greek schooling system, and excluded the option of a new “separate lesson” on ESD.

Our approach was based on real conditions and pragmatic/feasible approaches exploiting fully the “window of opportunity” offered by the newly introduced compulsory “school project”. We focused on the hydrological cycle and the biogeochemical cycles of basic chemical elements namely carbon, nitrogen, phosphorus, and sulphur, which are extremely important for the environment, natural resources and human societies, as a suitable vehicle for introducing SD principles, notions and practices.

Following a survey described in Part I (Koutalidi and Scoullos, 2015c), through which knowledge gaps, teaching difficulties (Koutalidi and Scoullos, 2015b) and lack of connection with current socioeconomic issues were identified, we designed, produced and validated new didactic materials for students and teachers, which were applied to 569 students of 16 schools from various parts of Greece, through an intervention lasting for one semester by their educators, assisted/guided by the principal researcher. Experimental and control groups were used throughout the research.

The impact of the material was assessed through pre- and post- intervention questionnaires and the results were analysed statistically. A clear positive impact of the intervention on students' knowledge was found. Learners were able to minimize misconceptions, understand better the biogeochemical cycles and comprehend their connection to various aspects of sustainable development, including e.g. the links between climate change and serious disturbance of the water cycle, overpopulation and famine issues linked to the need for agricultural production, the use of traditional and non-conventional water resources and fertilizers linked to the N and P cycles, etc.

Many components of the student's attitudes were clearly impacted positively whereas this was not so clear for others. Neither the educational background of students' parents nor their previous participation in EE/ESD programmes had any noticeable impact.

Furthermore hands-on activities seem to have more impact on students than traditional teaching. The above mentioned results, in combination with interviews of the educators involved, indicate that the use of the biogeochemical cycles as a vehicle for the introduction, at the secondary school level, of knowledge related to sustainable development was very successful. The initial fear and hesitation of some educators before the intervention, related to difficulties linked to the complexity of the natural processes involved, were not confirmed.

Therefore, we suggest that apart from the use of the materials presented in this article the relationship of biogeochemical cycles with SD issues should be elaborated and, included in the curricula and the textbooks of specific relevant subjects of science (e.g. chemistry, biology, etc.), in combination with an increase of the didactic hours devoted in the curricula on the issues mentioned above.

The results also demonstrated that the learners who benefited more were those who had a better overall performance/the better students and, in relative terms, the participating girls, the learning capacity and critical thinking of whom was apparently more readily developed through the materials and the overall intervention described. As it concerns the “weaker students” it should be clarified that in this article they are confined to those with relatively low mean average grade in the entire set of subjects examined. In a further stage of this research we may need to examine the correlation between the impact of the material with the performance of students only in selected, relevant subjects. As a general observation, weaker students benefit more from the hands-on activities which allow them to concentrate and participate more actively. The role of the participating educators also needs to be studied in greater depth, by analyzing, comparing and correlating their competences with the performance of their students as it concerns both knowledge and attitudes. Such an analysis may indicate common knowledge gaps where further training of educators might be needed.

Appendix 1

Attitude questions (indicative sample) (translated from Greek)
Never Seldom Sometimes Often Always
1. In the evenings when I'm at home I switch the lights off, except those in the room where I stay. 1 2 3 4 5

I disagree totally I rather disagree I am not certain I tend to agree I fully agree
2. It's pointless to save small amounts of energy, when huge amounts are wasted in industrial units. 1 2 3 4 5
3. I don't mind if I work in an enterprise which does not respect environmental regulations. 1 2 3 4 5
4. I will use public transport, if available, to go to my work even if I have a car. 1 2 3 4 5
5. Economic development could be combined with lower emissions of greenhouse gases. 1 2 3 4 5
6. I contribute to the reduction of solid waste by choosing products with reduced packaging. 1 2 3 4 5
7. Education for the population of poor areas could not contribute to the improvement of their quality of their life. 1 2 3 4 5

Appendix 2a

Knowledge questions (True–false type) (translated from Greek)
1. Water pollution does not contribute to the spread of serious diseases.
2. Global warming alters the environment and threatens many species of animals and plants.
3. Areas that do not have pollution sources do not address the problem of acid rain.
4. Through forest cutting humans intervene in the carbon cycle.
5. The nitrogen cycle is affected through the introduction of nitrogen fertilizers in agricultural ecosystems in order to increase their productivity.
6. Population growth has no effect on the change of land use and deforestation.
7. Over-consumerism leads to buying useless products, resulting in more wastes reaching the environment.
8. The increase of human population led to the overexploitation of fossil fuels.
9. The uncontrolled urbanization entails severe atmospheric pollution due to transport, central heating and operations of factories.

Appendix 2b

Knowledge questions (indicative sample of multiple choice type) (translated from Greek)
1. Solar energy is captured by producer organisms and transforms into:
a. Thermal energy
b. Dynamic energy
b. Chemical energy
d. Kinetic energy
2. Sulphur dioxide and nitrogen oxides cause:
a. The greenhouse effect
b. Eutrophication
c. The decrease of the ozone layer
d. Acid rain
3. The water of the atmosphere enters in aquatic and terrestrial ecosystems through:
a. Evaporation
b. Transpiration
c. Atmospheric precipitation
d. Agricultural practices
4. Carbon dioxide is released in the atmosphere through:
a. Denitrification
b. Cellular respiration
c. Photosynthesis
d. Nitrification
5. The impact of the greenhouse effect is:
a. Local
b. Continental
c. Planetary/global
d. National

Appendix 3

Statistical data (attitude questions)
Item Scale mean if item deleted Scale variance if item deleted Corrected item-total correlation Cronbach's alpha if item deleted
1 103.64 209.233 0.249 0.827
2 102.95 200.646 0.404 0.821
3 103.36 198.024 0.451 0.819
4 104.90 207.529 0.291 0.826
5 104.16 205.820 0.308 0.825
6 103.39 203.417 0.317 0.825
7 104.02 200.099 0.409 0.821
8 102.45 206.952 0.406 0.823
9 102.70 201.399 0.403 0.822
10 103.37 205.145 0.308 0.825
11 102.77 204.555 0.360 0.823
12 102.98 201.990 0.370 0.823
13 102.91 204.210 0.373 0.823
14 102.42 206.571 0.439 0.822
15 103.33 201.501 0.402 0.822
16 103.42 204.888 0.305 0.825
17 103.05 210.790 0.227 0.827
18 102.90 202.307 0.353 0.824
19 102.21 208.514 0.396 0.823
20 103.17 203.906 0.395 0.822
21 103.10 204.440 0.331 0.824
22 103.52 208.568 0.269 0.826
23 102.60 206.272 0.369 0.823
24 102.92 206.023 0.248 0.828
25 102.30 205.142 0.433 0.821
26 103.00 205.173 0.357 0.823
27 102.94 205.066 0.281 0.827
28 102.45 208.694 0.284 0.826
29 102.46 206.220 0.374 0.823

Scale statistics Mean 106.76
Std. deviation 218.498
Reliability statistics Cronbach's alpha 0.829
No of items 29

Appendix 4a

Statistical data (“True–false” questions)
Item Scale mean if Item deleted Scale variance if item deleted Corrected item-total correlation Cronbach's alpha if item deleted
1 6.59 2.321 0.227 0.594
2 6.53 2.349 0.334 0.575
3 6.79 2.101 0.256 0.594
4 6.72 2.153 0.250 0.593
5 6.62 2.266 0.243 0.591
6 6.62 2.060 0.449 0.536
7 6.54 2.397 0.231 0.592
8 6.63 2.205 0.289 0.579
9 6.63 2.076 0.409 0.546

Scale statistics Mean 7.46
Std. deviation 2.671
Reliability statistics Cronbach's alpha 0.607
No of items 9

Appendix 4b

Statistical data (Multiple choice questions)
Item Scale mean if item deleted Scale variance if item deleted Corrected item-total correlation Cronbach's alpha if item deleted
1 7.63 10.215 0.428 0.715
2 7.45 10.484 0.300 0.728
3 7.52 10.280 0.372 0.720
4 7.40 10.535 0.285 0.729
5 7.08 10.939 0.286 0.729
6 7.39 10.032 0.453 0.712
7 7.58 10.393 0.346 0.723
8 7.52 10.555 0.281 0.730
9 7.44 10.718 0.225 0.735
10 7.20 10.128 0.505 0.709
11 7.63 10.714 0.256 0.732
12 7.62 10.580 0.296 0.728
13 7.59 10.724 0.238 0.734
14 7.21 10.451 0.372 0.721
15 7.46 10.289 0.363 0.721
16 7.49 10.486 0.300 0.728

Scale statistics Mean 7.95
Std. deviation 11.708
Reliability statistics Cronbach's alpha 0.737
No of items 16

Acknowledgements

The survey, the implementation of the didactic material and the pedagogical modules were approved by the Greek Ministry of Education. Special thanks are due to School Headmasters, teachers and the students who participated in this research programme.

References

  1. Anastasi A., (1988), Psycological testing, 6th edn, New York: Macmillan.
  2. Bieger R. G., and Gerlach J. G., (1996), Educational Research: A Practical Approach, New York: Delmar Publishers.
  3. Cohen L. and Manion L., (1997), Methodology of educational research (in greek), Athens: Ekfrasi.
  4. Cohen R. J., Swerdlik M. E. and Phillips S. M., (1996), Psycological testing and assesment: an introduction to tests and measurements, 3rd edn, Mountain View, CA: Mayfield Publishing Company.
  5. Cronbach L. J., (1984), Essentials of psychological testing, 4th edn, New York: Harper and Row.
  6. Dikaiakos D., (2009), Application of Educational material for the sustainable development and the environment on issues regarding energy, PhD thesis, Department of Chemistry, National and Kapodistrian University of Athens, Athens.
  7. Eilam E. and Trop T., (2010), ESD Pedagogy: A Guide for the Perplexed, J. Environ. Educ., 42(1), 43–64.
  8. Gambro J. S. and Switsky H. N., (1999), Variables associated with American high school students' knowledge of environmental issues related to energy and pollution, J. Environ. Educ., 30(2), 15–22.
  9. GG, (2011), Government Gazette, FEK 1213/14.06.2011.
  10. Greek Ministry of Education, (2011), Circular No. 97364/Γ2/30.8.2011, Directions for the teaching of “school project” of A' & B' class of Senior High school for the school year 2012–13.
  11. Johnstone A. H., (2000), Teaching of chemistry – logical or psycological? Chem. Educ. Res. Pract., 1(1), 9–15.
  12. Kortland J., (1997), Garbage: dumping, burning and reusing/recycling: student's perception of waste issue, Int. J. Sci. Educ., 19(1), 65–77.
  13. Koutalidi S., (2015), Investigation and Ιntegration of important environmental biogeochemical processes in secondary school programs, unpublished PhD thesis, Department of Chemistry, National and Kapodistrian University of Athens, Athens.
  14. Koutalidi S. and Scoullos. M., (2015a), Designing didactic material for better understanding of biogeochemical cycles and their connections with global Environmental and Sustainable Development issues. 8th WEEC, Planet and People-how can they develop together? Gothenburg. Proceedings (in press).
  15. Koutalidi S. and Scoullos. M., (2015b), Assessing Educators' opinion for the implementation of ESD didactic material in school project using bio-geochemical cycles as entry points. 8th WEEC, Planet and People-how can they develop together? Gothenburg. Proceedings (in press).
  16. Koutalidi S. and Scoullos. M., (2015c), Biogeochemical cycles for combining chemical knowledge and ESD issues in Greek secondary schools part I: designing the didactic materials, DOI: 10.1039/C5RP00151J.
  17. Likert R., (1974), The method of constructing an attitude scale, in G. Maranel, (ed.) Scalling: A Soursebook for Behavioral Scientists, New Jersey: Transaction, pp. 233–243.
  18. Litwin M. S., (1995), How to measure survey reliability and validity. London: Sage Publications.
  19. MacCarthy W. C. and Widanski B. B., (2009), Assessment of chemistry anxiety in a two year college, J. Chem. Educ., 86(12), 1447–1449.
  20. Makki M. H., Abd-El-Khalick F. and Boujaoude S., (2003), Lebanese secondary school students' environmental knowledge and attitudes, Environ. Educ. Res., 9(1), 21–33.
  21. Mangas V. J., Martinez P. and Pedauye R., (1997), Analysis of environmental concepts and attitudes among Biology degree students, J. Environ. Educ., 29(1), 28–33.
  22. Mogensen F. and Nielsen K., (2001), Students' knowledge about environmental matters and their belief in their own action possibilities – a Danish study, J. Environ. Educ., 33(1), 33–35.
  23. Morgil I., Arda S., Secken N., Yavuz S. and Oksay O. O., (2004), The influence of computer- assisted education on environmental knowledge and environmental awareness, Chem. Educ. Res. Pract., 5(2), 99–110.
  24. Papadopoulos D., (2005), Development, Implementation and Evaluation of Environmental Educational programme on waste management (in Greek). PhD thesis, Department of Chemistry, National and Kapodiatrian University of Athens, Athens.
  25. Papke E. L. and Wooldridge M. J., (1996), Econometric methods for fractional response variables with an application to 401(k) plan participation rates, J. Appl. Econom., 11(6), 619–632.
  26. Roussos G., (2010), Mediterranean and Diet: Educational material for Sustainable Development emphassing on the chemical approach of the Mediterranean Diet (in Greek), PhD thesis, Department of Chemistry of National and Kapodistrian University of Athen, Athens.
  27. Scoullos M., (2010), Education for Sustainable Development: The Concept and Its Connection to Tolerance and Democracy, in A. A. Nikolopoulou (ed.) Education for Sustainable Development, Challenges, Strategies and Practices in a Globalizing World, California, USA: Sage Publications Inc.
  28. Scoullos M. and Malotidi V., (2004), Handbook on Methods used in Environmental Education and Education for Sustainable Development, Athens: MIO-ECSDE.
  29. Scoullos M., Alampei A., Kouroutos V., Malotidi V., Mantzara M. and Psalidas V., (2008), Environmental Education and Education for Sustainable Development in Protected Areas, Educational Material, Athens: MIO-ECSDE.
  30. Smith-Sebasto N. J. and Semrau H. J., (2004), Evaluation of the environmental education program at the New Jersey School of Conservation, J. Environ. Educ., 36(1), 3–18.
  31. Taber K., (2014), Ethical considerations of chemistry education research involving human subjects, Chem. Educ. Res. Pract., 15, 109–113.
  32. Tavakol M. and Dennick R., (2011), Making sence of Cronbach's alpha, Int. J. Med. Educ., 2, 53–55.
  33. Trikaliti Α., (1995), Investigation of acognitive, social and psychological parameters interconnected with environmental education (in Greek), PhD thesis, Departmentl of Philosophy, Pedagogical Psychology of National and Kapodistrian University of Athens, Athens.
  34. Tuncer G., Ertepinar H., Tekkaya C. and Sungur S., (2005), Environmental attitudes of young people in Turkey: effects of school type and gender, Environ. Educ. Res., 11(2), 215–233.
  35. UNECE, (2005), UNECE strategy for Education for Sustainable Development CEP/AC-13/2005/3/Rev.1. Vilnius.
  36. UNESCO, (2014), Aichi-Nagoya Declaration on Education for the Sustainable Development, World Conference Aichi-Nagoya (Japan), 10–12 November 2014.
  37. Vasisilopoulou M., (1998), Investigation and didactic treatment of former views of Junior High School students for biodiversity (in Greek), PhD thesis, National and Kapodistrian University of Athens, Athens.
  38. Wiersma W., (2000), Research Methods in Education: an Introduction, 7th edn, Boston: Allyn and Bacon.
  39. Yilmaz O., Boone W. J. and Andersen H. O., (2004), Views of elementary and middle school Turkish students toward environmental issues, Int. J. Sci. Educ., 26(12), 1527–1546.
  40. Zeger S. L., Liang, K.-Y. and Albert P. S., (1988), Models for Longitudinal Data: A Generalized Estimating Equation Approach, Biometrics, 44(4): 1049–1060.

This journal is © The Royal Society of Chemistry 2016