Aaron G. Jimenez and
David P. August*
School of Chemistry, The University of Edinburgh, David Brewster Road, Edinburgh, EH9 3FJ, UK. E-mail: David.August@ed.ac.uk
First published on 19th June 2025
Designing effective laboratory courses that take prior knowledge and experience into account are important for reducing inequalities and skill gaps within higher education. Whilst many anecdotal trends are known, this study aims to provide quantitative confirmation of skill gaps within first year undergraduate students. Students that studied A-level chemistry considered themselves both more experienced and more confident in a number of lab skills when compared to students who had completed either Scottish Highers or the International Baccalaureate—with skills involving more sophisticated equipment the most likely to differ. A similar relationship was observed between private and state funded schooling respectively, perhaps linked to the fact that a much higher proportion of A-level respondents were privately educated. International students displayed similar experience and confidence in general lab skills compared to students from the UK, but were less confident in their written and spoken English skill—despite the fact that 91% of them completed their final school education in English. International students were also less confident in their ability to design experimental methodologies. Covid-19 continues to have an impact on recent student cohorts, with Scottish students experiencing higher levels of disruption. It is hoped that confirmation of these long-held preconceptions, and the identification of the specific lab skills that vary most with educational background, will help future course design provide focused support to the students who need it most.
With many universities in the UK accepting students from a broad range of cultural and educational backgrounds, even with set entry requirements, there is an inevitable variation in lab skill confidence and competence amongst first year cohorts. Within the UK alone, secondary education curricula include A-levels, the International Baccalaureate and Scottish Highers (or Advanced Highers) but others, including the Irish Leaving Certificate, are also known. The differences in the devolved UK education systems also complicates university admissions further, with Scottish students having the option to leave school and begin higher education a year earlier than their English and Welsh peers, although Scottish universities may also offer the option for Direct Entry to 2nd year provided criteria are met.
There are many widely held beliefs about how prior schooling experience may impact lab skills—Mistry and Gorman have already shown how students’ competency can vary greatly depending on the type of skill (Mistry and Gorman, 2020). Batty and Reilly have also shown how prior laboratory training can affect a student's confidence in undergraduate science laboratories (Grant 2011; Batty and Reilly, 2023). However, there has, to date, been very little quantitative analysis or identification of the factors that most strongly contribute to students’ prior practical experience. This study aims to investigate:
1. How do factors, such as country of study, curriculum followed, and school type influence students’ perceptions of experience and confidence in key laboratory skills?
2. Which groups of students may require additional support at the start of their undergraduate chemistry studies?
3. How can the results of this study inform the curriculum redesign of first-year laboratory courses to narrow the laboratory skill gap and promote equitable retention across diverse schooling backgrounds?
1. Contextual information to assess the students’ previous education and cultural background.
2. Student self-assessments of their experience in 23 key lab skills.
3. Student self-assessments of their confidence in the same set of 23 key lab skills.
4. Student self-assessments of 13 complementary soft skills.
The data collected included contextual information on the students’ school type, the curriculum they followed and their country of study during the final two years of their schooling as well as any final grades achieved. Respondents were also presented with three 7-point Likert scale questions to gauge their overall perceived quality of teaching during this period and a 5-point Likert scale to investigate the impact of Covid-19 on their chemistry education.
The 23 key laboratory skills were chosen and collated from three chemistry high-school curricula: A-levels, Scottish Advanced Highers and the International Baccalaureate. Notably, these foundational skills featured heavily in first-year undergraduate laboratory manuals, the QAA benchmark statement (QAA, 2022) and RSC accreditation criteria (RSC, 2024), representing competencies expected to be acquired by the conclusion of their high school education or first year of university.
A 5-point Likert scale, complemented by detailed scale descriptors (see Section S7 of the ESI†), was utilised to ensure result consistency and mitigate potential ambiguities (Sullivan and Artino, 2013). A value of 1 denoted minimal experience or low confidence, whereas a value of 5 signified extensive experience or high levels of confidence. Descriptors for ‘Experience’ quantified the frequency of skill utilisation, whilst those for ‘Confidence’ also considered the need for guidance, supervision and the participant's comfort level in executing the skill safely and effectively (Hensiek et al., 2016). Students who rated their confidence in a skill as a 4 or a 5 also felt comfortable to teach the skill safely and effectively to others. Participants could also indicate whether they did not encounter a specific skill in their schooling; this was assigned a value of 0.
The final aspect of the survey sought to assess transferable or “soft” skills, deemed critical to success in the laboratory and wider chemistry education (Montgomery et al., 2022). The list of skills used were identified following initial interviews with members of academic teaching and support staff (see Section S2 of the ESI,† for a list of the 13 skills utilised), as well as being guided by existing literature (Reid and Shah, 2007; Kondo and Fair, 2017; Hill et al., 2019). For this section, a 5-point bipolar Likert scale was utilised, ranging from ‘Strongly Disagree’ to ‘Strongly Agree’.
Cronbach Alpha values were calculated for the three ‘Overall perceived quality of teaching’ questions, to determine the consistency and reliability of the Likert scale used (Warmbrod, 2014) (see Section S6 of the ESI†). A value above 0.7 was used to indicate an acceptable scale, where high correlation and consistency is observed in the scale employed (Sullivan and Artino, 2013).
As previously advocated by other studies (Hensiek et al., 2016; Mistry and Gorman, 2020) comparison of mean values using numerical primary data was determined to be a valid method to interpret the data for these questions. Statistical significance was thus determined using a two-tailed independent T-test.
A 1–7 bipolar Likert Scale was employed for the 3 questions related to overall perceptions, allowing for increased granularity and precision in data collection compared to a 5-point scale (Jamieson, 2004). Extreme and central values were given the same scale descriptors, where a value of 1 represented ‘Not at all’, a value of 4 represented ‘Average’ and a value of 7 represented ‘Exceptionally’ (see Section S7 of the ESI†).
Whilst the Cronbach Alpha values suggest reliable scales for the remaining self-assessment practical skill sections, it was decided that the data should not be treated as parametric (Lalla, 2017). As discussed by Lalla, the prescribed scale descriptors used in the survey design are not equidistant, rendering the data non-parametric and ordinal in nature (Lalla, 2017). This disparity becomes particularly apparent when addressing the additional ‘0’ value assigned to students who had not performed this experiment at school. Furthermore, the application of a ‘paired t-test’ is inappropriate for Sections 2 and 3 due to the non-normal distribution of the data (McCrum-Gardner, 2008). For this study, the individual skills data will be treated as non-parametric, ordinal data, assuming unequal variance and non-normal distribution. A Mann–Whitney U test has been employed to determine statistical significance (McKnight and Najab, 2010), with further discussion provided in the Results and discussion section (see Section S5 of the ESI,† for a full list of p-values obtained for each skill).
Survey answers were based on the students’ own perceptions of their skill competency and confidence, rather than any form of skill assessment.
Although respondents were from a range of degree programmes, all results were obtained from a single year group at a single UK research institution. Whilst the number of respondents provides a statistically relevant sample size, the results may be biased towards a single institution's geographical location or student intake. Some groups may also be over- or under-represented with respect to the actual make up of the full cohort.
To better understand the impact of the differences in educational background, specifically in an undergraduate laboratory setting, participants were divided into two categories. Categorisation was determined by the source of educational funding: private or state funded (Table 1). For this analysis, the one respondent who self-reported as home-schooled was omitted.
Private grouping (n = 56) | State grouping (n = 83) |
---|---|
Independent schools (n = 35) | Non-selective state schools (n = 80) |
International schools (n = 14) | Selective state (grammar) schools (n = 3) |
Independent schools with a significant scholarship or bursary (n = 7) |
When assessing the overall perceived quality of teaching by school type (Fig. 1), privately educated students reported feeling that their schools prepared them better for the laboratory, compared to state-educated students (p = 0.036). This is despite the fact that there were no statistical differences observed in the overall perceived quality of teaching of “theory and exams” (p = 0.701) or “lab and practical skills” (p = 0.162).
Further analysis of the student's perceived experience across the key 23 skills showed that privately educated students felt statistically more experienced across 4 key skills and more confident in 6 lab skills (see Table 2). Notably, the majority of these skills involved significant pieces of apparatus (gas syringes and voltmeters) or more expensive glassware (QuickFit). This matches both the known allocation and perceived fact that privately educated students have access to more educational resources than their state funded counterparts (Green, 2022).
Experience | Confidence | Soft skills |
---|---|---|
a The only skill that state-educated students scored statistically higher in was Written English Skills. | ||
Completing a redox titration with a range of indicators | Measuring gas volume using a gas syringe | I am confident designing my own experimental methodologies |
Conducting a calorimetry test | ||
Measuring gas volume using a gas syringe | Constructing a voltaic cell | |
Conducting a calorimetry experiment | Use of QuickFit glassware | (Written English Skills)a |
Tests for key organic molecules and ions | Tests for key organic molecules and ions | |
Writing risk assessments |
The only area in which state educated students indicated a statistically significant increase in experience was Written English Skills. However, this is very likely influenced by the higher proportion of privately educated students who studied abroad (48%), compared to their state-educated counterparts (less than 5%) (Fig. 2). Notably, 78% of international privately educated students stated that English was not their first language, compared to 21% of respondents who attended UK-based private schools. This may also highlight the low number of state funded international students who are able to continue into further education within the UK, or reflect the higher proportion of international educational institutions that are privately funded.
![]() | ||
Fig. 2 Student self-assessed proficiency in written English skills by school type highlighting the differences between privately educated students who were educated in either the UK or abroad. |
Whilst 29% of survey respondents studied in England, 39% of respondents completed A-levels—the standard English pre-university curriculum—indicating a high uptake of A-levels in international students (see Fig. 4). Conversely, 48% of respondents studied at Scottish schools, with only 46% of respondents studying Scottish Highers or Adv. Highers indicating the 2% proportion of Scottish students who completed alternative curricula. State funded schooling within the UK almost always follows the national curriculum with any differences between nationality and curriculum due to the private education sector.
Experience | Confidence | Soft skills |
---|---|---|
Distillation using a Liebig condenser | Experiments under reflux | I understand the theory behind my labs |
Experiments under reflux | Tests for key organic molecules and ions | I am independent in the lab |
Use of QuickFit glassware | Vacuum filtration using a Buchner funnel | |
Tests for key organic molecules and ions | ||
Vacuum filtration using a Buchner funnel | ||
Initial rate method |
The IB itself does not require students to complete prescribed practical work like the A-level does (AQA, 2015), with large sections of both the course and assessment covering flexible teaching approaches or student-led investigations (International Baccalaureate, 2025). This more general and inquiry-led approach may explain why, despite showing less experience in several specific laboratory skills, the overall perception of “preparation for the lab” was statistically equal to A-level students.
Additionally, students who undertook Scottish Highers or Advanced Highers felt less experienced across 11 and less confident across 9 of the surveyed skills (Table 4). As with the IB, many of the skills identified involved access to specific apparatus such as QuickFit glassware or distillation equipment—perhaps due to the higher proportion of A-level students that were educated privately. Of those students who studied Scottish Highers, 89% went on to study Advanced Highers in their final year of school—a level more equivalent to A-level. However, whilst 98% of the surveyed A-level students were awarded a grade of A or A*, only 69% of those who obtained a Scottish Higher went on to obtain a grade of A or B in Advanced Higher. When the results for overall perceived quality of teaching are grouped, there is a significant increase in the quality of “theory and exam” teaching for students achieving an A or B at Advanced Higher level versus those who obtained a C or lower (p = 0.014) (Fig. 6). However, despite the lower grades, those obtaining a C or lower gave a similar rating for their practical skills and lab preparation—perhaps indicating the perceived value of practical experience versus knowledge and understanding. Whilst the trends are less clear for those students that did not take Adv. Highers due to the low numbers of respondents (n = 7), these students still felt statistically less prepared for the lab than students who did study Adv. Higher (p = 0.024 and p = 0.027 versus A/B or <C grades respectively).
Experience | Confidence | Soft skills |
---|---|---|
Measure gas volume using a gas syringe | Measure gas volume using a gas syringe | No significant differences identified. |
Conduct a calorimetry experiment | Conduct a calorimetry experiment | |
Construct a voltaic cell | Construct a voltaic cell | |
Distillation using a Liebig condenser | Distillation using a Liebig condenser | |
Experiment under reflux | Tests for key organic molecules and ions | |
Use of QuickFit glassware | Measure voltage of electrochemical cell | |
Tests for key organic molecules and ions | Writing risk assessments | |
Measure the voltage of an electrochemical cell | Initial rate method | |
Writing risk assessments | Continuous analysis for rate experiments | |
Initial rate method | ||
Continuous analysis for rate experiments |
These results highlight the complications arising from Scottish Highers and university admissions, with Advanced Highers having little to no impact on general university admission criteria in Scotland (although direct 2nd year entry or other adjustments may be available in some Scottish institutions). As a result, many Scottish Higher students enter their first year of university study having either not studied chemistry in their final year of school, or having achieved a significantly lower grade (C or below) in their final year of study. This difference in the undergraduate admissions process likely explains the observation that students who completed Higher/Advanced Higher chemistry perceive their experience and confidence in a range of lab skills to be lower than their A-level counterparts, rather than a direct comparison of the quality and quantity of lab training encountered in each curriculum.
The survey respondents were split into two categories: home (those students who completed their final two years of school in the UK) and International (Table 5). This is distinct from university admission data where some students may have studied within the UK, but still been classified as ‘international’ due to their residency or fee-paying status.
Home grouping (n = 107) | International grouping (n = 33) |
---|---|
Scotland (n = 67) | China (n = 16) |
England & Wales (n = 40) | Other European (n = 10) |
Other (n = 7) |
Home students felt statistically more experienced in only two skills, and more confident in one compared with international students (Table 6). However, there was no significant difference in the overall perception of previous lab teaching between home and international students.
Experience | Confidence | Soft skills |
---|---|---|
Experiments under reflux | Vacuum Filtration using a Buchner Funnel | My written English skills are strong |
Vacuum filtration using a Buchner Funnel | My spoken English skills are strong | |
I feel confident designing my own experimental methodologies |
International students felt less confident in both their English speaking and writing skills compared with their UK counterparts. This is perhaps unsurprising given that 78% of the international students stated that English was not their first language, compared to 15% of home students. However, 91% of the international students surveyed completed their final school studies in English, indicating that previous grades in courses taught in English may be an ineffective mechanism to guarantee a specific level of English proficiency and that post-admission English support may still be relevant for these students.
International students were also statistically less confident in their ability to design their own experimental methodologies. Perhaps this relates to perceived notion that international schooling, particularly in China, can focus more on the recollection of knowledge and facts, rather than application of this knowledge to unknown or unseen problems. However, it is important to note that recent studies have shown “weak” evidence for this difference in critical thinking ability (Rear, 2017; Fan and See, 2022). It may even be that this perceived cultural difference is responsible for the different confidence levels observed.
The overall perceived impact of covid was mixed, with a global mean response of 2.45 and standard deviation of 1.15 from a 5-point Likert scale ranging from 1 – not at all disrupted to 5 – severely disrupted. Despite previous reports on the unequal impact of Covid-19 for students from lower income backgrounds (Betthäuser et al., 2023; Golden et al., 2023), state-educated students reported no significant difference in disruption compared to privately educated students (p = 0.292) (see Section S10 of the ESI†).
Participants who studied in Scotland reported significantly higher disruption compared with those in England/Wales (p = <0.001) or based outside of the UK (p = 0.046), with a clear increase in the number reporting moderate or worse disruption (Fig. 7). A similar trend was observed for participants who studied Scottish Highers/Advanced Highers versus A-levels (p = 0.008). No significant differences were observed for students who undertook the IB.
![]() | ||
Fig. 7 Overall perceived impact of Covid-19 on students’ chemistry school education, separated into three groups dependent on the country of study. |
No significant difference in the impact of Covid-19 was observed between Scottish students who completed an Advanced Higher versus those who only completed Highers (p = 0.973). One reason for the perceived increase in disruption for Scottish students could be the decision to remove the practical assignment and project from both the Higher and Advanced Higher chemistry assessment from 2020 to 2023 (Traynor et al., 2025). This will have been the case for all respondents in this study who completed a Scottish Higher in chemistry.
Experience | Confidence | Soft skills |
---|---|---|
Distillation using a Liebig condenser | Experiments under reflux | I understand the theory behind my labs |
Experiments under reflux | Tests for key organic molecules and ions | I am independent in the lab |
Use of QuickFit glassware | Vacuum filtration using a Buchner funnel | My written English skills are strong |
Tests for key organic molecules and ions | Measure gas volume using a gas syringe | My spoken English skills are strong |
Vacuum filtration using a Buchner Funnel | Conduct a calorimetry experiment | I feel confident designing my own experimental methodologies |
Initial rate method | Construct a voltaic cell | |
Measure gas volume using a gas syringe | Distillation using a Liebig condenser | |
Conduct a calorimetry experiment | Measure voltage of electrochemical cell | |
Construct a voltaic cell | Writing risk assessments | |
Measure the voltage of an electrochemical cell | Initial rate method | |
Writing risk assessments | Continuous analysis for rate experiments | |
Continuous analysis for rate experiments |
Whilst all incoming undergraduate students are likely to have suitable experience with simple lab apparatus, there is a wider skill gap for techniques that involve access to more expensive or specialised equipment (e.g., distillations, gas syringes etc.). Care should therefore be taken in early undergraduate lab sessions to make sure sufficient guidance is provided, either before or during practical sessions, for any apparatus that may not have been widely available in high school laboratories.
International students, or those completing Scottish Highers, perceived themselves as having less experience or confidence in experimental design (or related investigative tasks such as risk assessments). With the popularity of inquiry-led approaches on the rise in undergraduate laboratories (Pavelich and Abraham, 1977; Domin, 1999; Fay et al., 2007; Walker et al., 2011; Thomson and Lamie, 2022), there is a concern that an initial imbalance of student skills may lead to a widening skill gap as previous lab experience may enable greater success. This is particularly true for exercises carried out in groups, where more confident or experienced individuals can take the lead and inadvertently increase the skill gaps further (Francis et al., 2022; Doucette and Singh, 2023).
Whilst this study has identified the skill inequalities likely present in current 1st-year chemistry cohorts at UK institutions, it is not yet clear whether this skill gap continues to exist in chemistry graduates or if existing measures within teaching laboratories, and a reduction in the long-term impact of Covid-19 policies, are sufficient to address existing inequalities. The survey set out in this study can be used to assess specific skill gaps within new undergraduate cohorts at institutions where the majority of applicants hold A-levels, Scottish Highers or an IB—providing the information required to ensure that the resources provided accurately map to the specific skills development required.
Footnote |
† Electronic supplementary information (ESI) available. See DOI: https://doi.org/10.1039/d5rp00129c |
This journal is © The Royal Society of Chemistry 2025 |