Benedicta
Donkor
,
Melissa A.
Collini
and
Jordan
Harshman
*
Department of Chemistry & Biochemistry, Auburn University, Auburn, Alabama 36849, USA. E-mail: jharshman@auburn.edu
First published on 16th December 2024
This qualitative study investigates the goals and outcomes of the individual programmatic elements within US chemistry doctoral programs, based on faculty perspectives. Forty-six faculty participants were interviewed using an interview protocol that was refined through iterative input and consensus building. Faculty perspectives in this study identifies several programmatic elements—such as research, coursework, lab rotations, candidacy process, and teaching assistantship—and explores the goals and outcomes of each. While the program's structure aims to incorporate essential workforce skills as explicit goals and outcomes, findings indicate that this integration often remains questionable. Further analysis of the goals and outcomes yielded three main insights: there is a misalignment between stated goals and enacted practices, necessitating a holistic reform approach to align goals of programmatic elements with students’ career goals and program goals; the structure of some programmatic elements often causes stress and frustration, highlighting the importance of improved integration and support; significant issues with certainty of the goals and outcomes of programmatic elements were identified, suggesting systemic problems that could lead to ineffective education. Addressing these issues through enhanced clarity, alignment, and practical training is vital for improving the experience of doctoral education in chemistry and better preparing students for their careers. While this study focused on US chemistry doctoral programs, the findings offer a framework for improving doctoral programs by addressing misalignments, unclear goals and outcomes, and the integration of real-world skills, providing insights that are applicable across diverse global educational contexts.
i. From faculty perspective, what are the goals (intended outcomes) and outcomes (actual outcomes) of the individual programmatic elements of doctoral education in chemistry?
ii. What insights can be drawn from the goals and outcomes of the individual programmatic elements?
iii. How well do these goals and outcomes align with the reported overall goal (preparing students for careers)?
This study is a part of a larger research project that aims to examine the unique perspectives of faculty members towards DEC from a comprehensive standpoint (Donkor et al., 2024). While the overall project delves into faculty perspectives on various aspects of DEC, the current study specifically focuses on the aforementioned research questions.
Understanding the interdependency of teacher thinking, personal and contextual factors, and enacted practices is vital for effective reform. Although not originally intended for DEC, previous studies, emphasize the model's significance in offering guidance for reform initiatives (Woodbury and Gess-Newsome, 2002; Popova et al., 2021).
Interrater reliability method | Results |
---|---|
Percent agreement | 0.955 |
Cohen's kappa | 0.760 |
a These data include all mentioned outcomes, yet some faculty indicated a lack of confidence in these outcomes. Please see Insight III for more details when considering the reported outcomes in this table. The goals and outcomes in this table are sorted by the highest percentage of participants that mentioned the goals and outcomes for research. The numbers are the percentages of faculty who responded to the questions “what is the primary goal of the programmatic elements” and “what do students actually gain from the programmatic elements.” Each of these percentages have been normalized to the proportion of the number of people that were asked explicitly about these two questions (see Table S2 for the actual number of participants for each element, ESI). The yellow highlights indicate the goals and outcomes discussed in Part I, with the intensity of the colour representing the quartiles: deep colour for the first quartile, medium colour for the second quartile, and light colour for the third quartile. b Legend for abbreviations used for programmatic elements: Group Mtg.– Group meeting, Candidacy – Candidacy process, Defense/Diss.– Dissertation and Defense, Committee – Advisory committee, Annual Eval. – Annual evaluation, TAship – Teaching assistantship. The elements are sorted based on faculty rating of their relative importance. |
---|
![]() |
a These data include all mentioned outcomes, yet some faculty indicated a lack of confidence in these outcomes. Please see Insight III for more details when considering the reported outcomes in this table. The goals and outcomes in this table are sorted by the highest percentage of participants that mentioned the goals and outcomes for research. The numbers are the percentages of faculty who responded to the questions “what is the primary goal of the programmatic elements” and “what do students actually gain from the programmatic elements.” Each of these percentages have been normalized to the proportion of the number of people that were asked explicitly about these two questions (see Table S2 for the actual number of participants for each element, ESI). The yellow highlights indicate the goals and outcomes discussed in Part I, with the intensity of the colour representing the quartiles: deep colour for the first quartile, medium colour for the second quartile, and light colour for the third quartile. b Legend for abbreviations used for programmatic elements: Group Mtg.– Group meeting, Candidacy – Candidacy process, Defense/Diss.– Dissertation and Defense, Committee – Advisory committee, Annual Eval. – Annual evaluation, TAship – Teaching assistantship. The elements are sorted based on faculty rating of their relative importance. |
---|
![]() |
While all faculty-identified goals and outcomes in this study are important, our discussion focuses on the goals and outcomes of the individual programmatic elements where at least 25% of faculty mentioned them. As there were a lot of goals and outcomes to be discussed for each programmatic element, we divided the percentage of faculty that mentioned each goal or outcome into 4 quartiles (75–100 – first quartile, 50–74 – second quartile, 49–25 – third quartile and 1–24 – fourth quartile). It was found that only a few of the goals and outcomes of the individual programmatic elements were in the first and second quartile. Hence the third quartile was chosen as the cut-off point for the goals and outcome to be discussed for each programmatic element. Programmatic elements are discussed based on their average relative importance ranked by faculty participants. We acknowledge the arbitrary nature of establishing these cutoffs in our attempts to communicate results within a reasonable length.
In the following sections, we do not allude to the fact that statements are from faculty perceptions for succinctness (e.g. “the goal of research is…” versus “faculty perceived the goal of research is…”). Additionally, programmatic elements are formatted in bold while specific codes are formatted in bold/italics for reference.
“Well, the research teaches students to do careful experiments and interpret the results from experiments. To modify experiments based on results.”
To be able to carry out research, one needs to first and foremost identify a problem and think about possible ways to solve the problem leading to two primary goals and outcomes mentioned by faculty: critical or independent thinking and problem-solving skills. However, lacking the necessary foundational knowledge about the research to be conducted can make it significantly challenging, if not impossible, to achieve meaningful results. This aligns with the technical knowledge goal and outcome mentioned by faculty. Faculty participants highlighted novel or significant research as a primary goal and outcome for research. The underlying objective is to facilitate captivating and groundbreaking research that is publishable. This is consistent with a previous study that showed that pursuing a doctoral-level education equips students with the skills needed to excel as innovative researchers (Åkerlind and McAlpine, 2017).
Faculty members emphasize the importance of communication skills as research is contingent upon the proficient communication of its data and results. Communication skills is one of the six professional development skills needed by STEM students as highlighted in a previous study (Mackiewicz et al., 2023). The overall goal of attaining all these skills is geared towards students’ career path highlighting the reason faculty mentioned career preparation (St. Clair et al., 2017; Langin, 2019; Okahana, 2019; Cui and Harshman, 2020, 2023, Ganapati and Ritchie, 2021). Through the research process, students learn to plan their research, design experiments, consider time for completing the research, and prepare documents among others thereby leading to the goal and outcome planning or organizational skills. They also learn to persevere and be persistent as research does not always work out with one attempt and they learn to better appreciate the process (affective outcomes). Even though it is expected that students would need someone to guide them through the stages of their research (receiving mentorship), it is expected that they would gain ownership of the process along the way. These primary goals and outcomes are also consistent with a report by Casey, a former ACS president (Casey, 2004). The report highlighted the decision by the representative committee in their institution to provide their graduates with specialized expertise in their respective areas, cultivate a broad scientific knowledge base, enhance problem-solving skills, promote the exploration of new challenges, develop strong communication skills, foster teamwork abilities, and instil confidence and independence as scientists. See Table 2 for more primary goals and outcomes of research.
“Because they need to learn, and they need someone guiding them as they learn. Since I said that research was so critical that they benefit from having an expert guide them and help identify important research problems. And so that's one of the main roles of the advisor”.
The second type of mentorship entails students engaging in mentoring activities or acquiring skills in mentoring others, elaborated by Participant 12:
“……how to mentor other people, that's all part of it too. So, it's a lot that goes into mentoring.”
Previous studies highlight that research advisor is known to be a major contributor to the overall success/progress or failure of a graduate student aside the student's contribution (Jacks et al., 1983; Trinkner, 2014; Qu and Harshman, 2022). In order for students to thrive in their academic endeavours, it is essential that faculty members provide the necessary components outlined in previous studies (Berelson, 1960; Affero and Abiddin, 2009; Barnes and Austin, 2009; Gardner, 2009). These include, but are not limited to, offering students consistent and valuable feedback regarding their progress, fostering their growth as researchers and professionals, and being readily available for them all of which align with the mentorship in this study. Serving as a source of additional resources and providing supplementary resources for students (a form of mentorship found in this study) to enhance their knowledge beyond the scope of their coursework is integral to their development. McLure conducted a study on the impact of advisors on students’ academic progress, emphasizing their role as a dependable source of information (McLure, 1989). Mentoring is an important skill that is valuable regardless of the students’ chosen career paths. This is because they can potentially be assigned leadership or guidance roles in the future, aligning with career preparation. In this regard, Participant 8 said:
“But in principle, your advisor, if it's good advisor and there's a good relationship or for some people, if they become role models. So, you may recognize what it takes to be a successful scientist or to be a certain type of scientist, at least a certain type of scientist. And yeah, I think that most has to do with learning and motivation”.
Prior research highlights the importance of mentoring doctoral students to help them explore diverse career paths (St. Clair et al., 2017; Langin, 2019; Okahana, 2019; Ganapati and Ritchie, 2021). An earlier study revealed that support from advisors significantly impact the desire of doctoral students to pursue careers in academia, suggesting that faculty play a key role in students career choice decisions (Seo et al., 2021).
In light of research resources, Participant 2 said:
“Well, first of all, the research advisor will pay the bills. Someone has to write a proposal and get it funded to support the graduate student, right.”
For students to be able to conduct research while carrying out their duties/responsibilities in chemistry doctoral programs, they need someone to set the stage by providing them with resources (White and Nonnamaker, 2008). Therefore, it is not surprising as faculty mention this as part of the goals of students’ having an advisor. However, none of the participants indicated whether students aspiring to become faculty members receive training on securing research resources. Other goals for advisor mentioned by faculty can be found in Table 2.
Writing and publishing research papers requires a deep understanding of experimental design, data analysis, and the ability to interpret findings (technical research skills). These technical research skills are essential for success in scientific careers. The process of publication, from drafting a manuscript to revising and submitting it, demands strong planning and organizational skills. These skills are indispensable in any professional setting, helping students manage projects, meet deadlines, and work efficiently.
Some faculty also mentioned networking and collaboration which in this context encompasses collegiality, networking and collaboration. Participant 14 explore collegiality:
“It's a chance to learn from other people who are either learning from you or that you’re learning from them. It's a chance to have a less formal environment than the classroom to do group learning.”
Participant 16 highlights networking:
“they’re a place to get various kinds of experts deeply engaged with the people who are closest to you to give you advice about your research.”
Regarding collaboration, Participant 23 said:
“…. I want students to collaborate, and so they need to know what other people in the group are doing, and this is a formal way in which they can do that.”
Building a strong professional network and fostering collaboration with peers, advisors, and industry professionals (when invited to such meetings), are essential for enhancing doctoral students’ research opportunities and career prospects. Effective teamwork on research projects and participation in academic communities lead to valuable co-authored publications, presentations, and networking opportunities, addressing concerns from a prior study about the need for chemistry programs to help students connect with non-academic professionals (Cui and Harshman, 2023).
Evaluation and feedback are vital for doctoral students’ growth, providing constructive insights on research progress and methodologies. Regular feedback help refine their work, improve research design, and address weaknesses, fostering both robust research and personal development through expert guidance. In light of technical knowledge, Participant 7 highlighted developing effective reading and comprehension skills, understanding key elements in academic texts, and engaging in theory building, as complementary supplement to coursework. Group meetings serve as a platform for students to learn about the latest tools and methodologies in their field while engaging with advisors and peers to clarify complex concepts and receive practical advice. These sessions also facilitate mentorship, allowing doctoral students to discuss their research, seek feedback, and learn to mentor others, fostering a supportive culture that aids in navigating their academic and professional paths successfully.
“….it evaluates their progress, allows us to provide feedback on their performance….”
During proposal presentation, students must provide thoughtful, well-developed answers to questions, similar to cumulative or candidacy exams. They receive guidance and feedback from their primary advisor and advisory committee, which offers constructive critiques to refine their proposals and improve their dissertation research. This process helps students address weaknesses, enhance their work, and build confidence while evaluating their skills to determine their readiness to complete the program, aligning with previous study findings (Beebe et al., 1948).
Fostering critical and independent thinking as highlighted by faculty helps students evaluate literature, develop original research questions, and create innovative solutions. This skill is essential for navigating complex research topics and demonstrates their ability to analyse information and propose novel directions, showcasing readiness for advanced research. Some faculty mentioned communication skills and Participant 16 expressed it as:
“they know how to speak to different audiences, speak to non-scientists, speak to semi-experts, to undergraduate sophistication and then to their peers.”
Effective communication is essential for students during the candidacy process, as it enables them to clearly present their research proposals, articulate their ideas and methodologies, and respond to critiques, thereby enhancing their ability to convey their work to diverse audiences (Ananiadou and Claro, 2009). In order to develop a research proposal or successfully complete candidacy process, individuals must carefully plan their approach, thus demonstrating their proficiency in planning or organizational skills. Technical knowledge enables students to understand and apply advanced methodologies and tools in their research field, demonstrating competence in their proposals. Effectively utilizing and explaining these aspects enhances the credibility and feasibility of their work.
There are two goals and outcomes of candidacy process that are concerning; weed out, and stress or harm mental health. The “weed out” process is designed to assess students’ readiness to continue in their doctoral program by ensuring they meet the required academic standards. This aligns with a previous study identifying that some faculty view the candidacy process as a means to weed out students (Nardo, 2024). While it identifies those prepared for advanced research, the process becomes problematic when faculty prioritize filtering out students over helping them succeed. For example, Participant 21 noted that the exams serve as a strict filter, suggesting that students who fail simply lack the necessary ability, rather than focusing on supporting their success. One could have thought that stress or harm mental health could have been highlighted in terms of managing stress and mental health. However, this was talked about in the negative light of causing stress for the students as opposed to providing benefits. In this context, Participant 12 stated:
“…just stress and a lost Saturday morning…”
This suggests that some faculty members not only perceive the candidacy process as a source of stress but also as a significant time drain that could otherwise be allocated to more meaningful activities for doctoral students. If this perspective is held by faculty, it raises concerns about the effectiveness of the candidacy process. It implies that not all candidacy processes are seen as inherently beneficial, indicating a need for a re-evaluation or improvement in its structure to ensure effectiveness.
“…. and you want to make sure that one, you can get along with them personally.”
Lab rotation is a designated period during which students engage with advisors, post-docs, and other graduate students across multiple laboratories for specified durations (Barnard and Shultz, 2020; Artiles et al., 2023). This allows them to gain exposure and make informed decisions about which labs they will ultimately join consistent with a previous study (Donkor and Harshman, 2023). Faculty also mentioned networking and collaboration. Participant 46 highlights that by participating in lab rotation, students build relationships with senior peers and potential future committee members, gaining valuable connections and resources that benefit them long after joining a lab. This exposure allows students to appreciate and understand various individuals and their unique approaches to work and fosters workable environment as mentioned by faculty. This is because the lab serves as the focal point for fostering academic and social interactions among lab colleagues, postdocs, and faculty (White and Nonnamaker, 2008).
“the goal in selecting a guidance committee is to select a group of faculty who can help provide a level of expertise, and knowledge, and insight for the project, that will be beneficial to the student.”
Previous studies indicate that, alongside advisors, the doctoral advisory committee aids students in planning their proposals, guiding their studies, assisting with dissertation preparation, and conducting final examinations (evaluation and feedback), aligning with our findings (Barnes and Austin, 2009; Mauch and Park, 2014). Additionally, the committee provides career preparation by offering advice and serving as references. Other primary goals and outcomes can be found in Table 3.
“then the annual evaluation, the semester evaluations that we’ve had, I think, have been useful in providing feedback and encouragement to the students. And sometimes, you may not tell a student directly how great you think their work is, …”
The annual evaluation is primarily conducted by the student's advisory committee which is to provide students with crucial evaluation and feedback on their academic and research progress. These evaluations provide advisors and the advisory committee a structured opportunity to assess student development, identify strengths, and pinpoint areas for improvement. Constructive feedback helps refine research focus, improve methodologies, and keep students on track with academic milestones, ensuring they meet program expectations while enhancing the quality and impact of their doctoral work. It should also be noted that Participant 35 noted that instead of students actually gaining relationships with other professionals (their advisory committee) during annual meetings, they are probably gaining stress if they have an unsupportive committee.
Also, in order to effectively teach, it is essential to possess effective communication skills, highlighting its significance as a goal/outcome aligning with a previous report (National Academies of Sciences, 2018). Also, faculty participants mentioned that the goal of students being teaching assistants is to help in teaching undergraduate courses and labs (not regarded as an outcome by faculty) hence the goal, help faculty or department. This is in alignment with previous studies that emphasized TAship roles prioritize institutional needs over providing a high-quality learning experience for graduate students (Austin, 2002; Zotos et al., 2020). Some faculty mentioned that personal resources, such as tuition support and stipends, are essential for alleviating the burden of outside work during doctoral training, as previous research indicates that such employment can impede student progress (Seymour, 2005; Pyhältö et al., 2012). On the other hand, having secure funding ensures that students are provided with the necessary support to focus on their research projects (research resources). A previous report highlighted that doctoral programs require students to serve as teaching assistants, aiming to foster educational skills such as pedagogical training and helping undergraduates while also providing them with financial aid aligning with some of the goals/outcomes highlighted by faculty in this study (Golde and Dore, 2001).
Further, the length of this paper is prohibitive of an in-depth discussion for each element about how the TCSR model can shape the goals and outcomes of individual programmatic elements as reported by faculty, However, an example can be used to demonstrate this impact:
The personal factor construct (which includes faculty members’ own doctoral experiences) can influence their perceptions of the goals and outcomes of each element. For instance, Participant 33's personal experience as a graduate student shaped their view of the goal of candidacy exam. This is demonstrated by the statement.
“… based on my experience as a grad student and my experience at these different institutions, I think the candidacy exam is to show that the candidate is ready to….”
Contextual factors, such as a faculty member's field of interest and area of study, influence the methods they employ and shape their practices (enacted practices). For instance, when Participant 2 was asked what students actually gain from research, the response was:
“…For instance, a chemist have to know a certain technique. So, most chemistry techniques you might learn as an undergrad, but as a solid-state materials chemist, our techniques are not taught typically for undergrads, at the undergraduate level…”
This participant illustrated contextual factor in their response by including the specialized techniques required in their field (solid-state materials chemistry), which are not typically taught at the undergraduate level.
The enacted practices are often the enacted goals that lead to the outcomes of the programmatic elements. For instance, some participants stated that they did not know whether students actually gain the stated goals of the programmatic elements (see Insight III for details). The faculty thinking or perspectives has been elaborated above (Part I) for each of the programmatic elements.
Participant 35 pointed out that while seminars are intended to foster critical thinking and effective presentation, many students find them disengaging, indicating a need for reforms to better meet students’ needs. Hence, there should be strategies implemented to increase student engagement in seminars by incorporating their input in the seminar structure to address their current needs and enhance their learning experience. This will help maintain their interest and prevent disengagement.
Similarly, Participant 36 noted that the goal of teaching assistantship should be to equip students with teaching and mentoring skills, yet many TAs are not given proper training, revealing a gap between intended and actual outcomes.
“Should be providing them with experiences that equip them with the skills to teach and to mentor properly and effectively, students who may not know as much as they do…… So, yeah, our TAs are not taught how to teach, but that should be what they learn at the end of the day.”
Participant 46 emphasized that exposing students to teaching through TA roles can uncover latent interests and develop valuable skills, but current practices may not fully support this. These example observations collectively reveal a misalignment between the stated goals/outcomes and the actual experiences (enacted practices) provided by the programmatic elements of various doctoral programs, indicating that the goals and outcomes of some programmatic elements are not effectively realized.
This misalignment is further reflected in participants’ responses when asked if the programmatic elements were serving their intended purposes. Some participants affirmed that the elements were meeting their goals, by mentioning the goals of some of the elements, and with a few mentioning periodic evaluations to assess effectiveness. For instance, Participant 4 noted that their program is evaluated every five to seven years, which they believe ensures that the elements align with their goals. However, some participants who affirmed the elements are serving their intended purposes also expressed concerns about a disconnect between the goals and the actual practices. Participant 3, for example, acknowledged the stated goals of some elements but pointed out that sometimes there is a disconnect between some programmatic elements. Participant 23 acknowledged that while the system's elements serve their intended purposes, it is imperfect, especially in terms of the timing for students’ readiness to propose and defend original ideas as students may not be ready to propose and defend original ideas. Other participants said the elements were not serving their intended purposes and pointed out problems with some programmatic elements. In that light, Participant 14 highlighted specific issues, such as coursework being overly broad, annual meetings requiring tweaks to be more effective, and seminars being considered time-wasting activities that could be replaced with more useful alternatives. These differing perspectives reveal a misalignment between the program's stated goals and how the programmatic elements are enacted in practice.
Participants highlighted that rigid structures and misalignment among programmatic elements undermine their effectiveness and intended purposes, suggesting a need for reform. For instance, Participant 24 indicated that coursework is most useful when closely connected to students’ research projects, suggesting that the lack of such alignment makes other programmatic elements less effective. Participant 23 echoed this sentiment, finding coursework frequently unhelpful due to its lack of synergy with research.
“……I’ll be honest, I don’t think coursework in graduate school is super helpful because it depends on, I guess, what your research is. But oftentimes your research may not be synergistic with the courses that you take. And so sometimes it feels like you’re doing all this work for courses for things that you may never use……”
Participants also discussed specific issues with the programmatic elements. Participant 33 pointed out that the effectiveness of coursework depends on its structure, with well-structured courses being beneficial and poorly structured ones feeling irrelevant, while Participant 24 emphasized that the effectiveness of lab rotations depends on their structure. Participant 31 criticized the training for teaching assistants as insufficient for developing pedagogical skills, suggesting a need for better-focused training programs. The mention of “cheap labor” by this participant hints at an underlying concern about the use of TAship as a cost-effective resource rather than investing in students’ development as educators. This reflects a broader issue where the role of TAs might be undervalued in terms of their professional growth.
Participant 32 questioned the value of the dissertation and defense, proposing that they could be eliminated as they often fail to provide formative experiences for students. Participant 33 stated that for dissertation and defense, students gain confidence (outcome) but there is no way to assess this.
Additionally, the issue of uneven advising was noted, with some faculty not able to provide effective mentorship, which can hinder students’ success, consistent with previous studies (Austin and McDaniels, 2006; Golde and Walker, 2006; Barnes and Austin, 2009). While this study does not identify the cause of this, participants noted that it may not necessarily be the advisors “fault,” but that a variety of factors can contribute to ineffective mentorship. This is in line with previous studies that have shown poor advisor relationships such as inadequate mentorship, mismatched expectations and poor communication between advisors and students, and power imbalance contribute significantly to doctoral program attrition (Jacks et al., 1983; Barnes et al., 2011, 2012). It is crucial for faculty and program administrators to address these issues and ensure that the structure, goals and outcomes of programmatic elements are effectively implemented and aligned with program goals and students’ needs.
“I have no idea. I don’t even remember what I got out of it.” when asked about the candidacy process, while Participant 12 humorously questioned its purpose, saying,
“Man, I don’t know. I’m okay if those disappeared.”
Similarly, Participant 24 doubted the value of writing a dissertation, asking,
“Why on earth do we make people write a book that nobody reads?”
Participants 20 and 21 were confused about the purpose of lab rotations, with Participant 20 stating,
“I don’t know why they set it up in the first place…”
Participant 31 criticized the effectiveness of teaching assistantship, saying,
“Cheap labour. I don’t know. Oh yeah, so it is help them to be able to teach better, but I’m not certain that the way the general TAship here is going to help that much with it. I mean, I guess it makes you a little bit more comfortable talking at students, but I don’t know that you learn a lot about pedagogy or anything like that. So yeah, I don’t know.”
It is unclear how many of the outcomes indicated by faculty align more with faculty “hopes” or “assumptions” as opposed to actual outcomes. Often, participants acknowledged that there was no real way to assess the outcomes. For example, Participant 41 said,
“…we hope they actually gain the knowledge…”
When asked what students actually gain from coursework, indicating a lack of real evidence supporting these aspirations. Thus, it is unclear how many of the outcomes are actual outcomes.
Participant 24 also expressed uncertainty about whether the programmatic elements are achieving their intended goals by indicating that we as researchers may be wrong in assuming that the programmatic elements have intended goals. This participant shared an anecdote about a faculty meeting in which the purpose of coursework was questioned, but there was no apparent answer given by the faculty. The participant recalled that a colleague stated that courses are “performative” and only necessary to maintain accreditation, while another proposed that courses should align with the specific activities of researchers, suggesting a need for more information about lab work to choose relevant courses. Participant 24 summed up the uncertainty by stating:
“And the fact that we were having this question about what is the point of these courses, and we really weren’t super sure indicates to me that there really may not be an intended purpose for those courses beyond it's a thing we’ve always done.”
These responses reflect a broader issue: a significant lack of certainty regarding the goals and outcomes of the programmatic elements. The uncertainty expressed by faculty suggests that the goals and outcomes of these elements are not effectively communicated, leading to confusion, a perceived lack of value, and potentially hindering the effective achievement of program goals. These findings highlight the need for better alignment and clearer communication of the goals and outcomes of these programmatic elements to enhance their effectiveness and relevance in doctoral education in chemistry.
![]() | ||
Fig. 2 An overview of the alignment of the skills framework used to assess career preparation in DEC. First column: 21st-century skills categorized by the National Research Council (National Research Council, 2012); second column: skills for professional chemists identified by Cui & Harshman (Cui and Harshman, 2020); third Column: the combination of these used to assess career preparation in DEC (21st-century skills needed for professional chemists); fourth Column: skills identified in this study as goals and/or outcomes of programmatic elements of DEC. Not included in this were non-skill codes and outcomes, or those found to be specific to graduate training rather than career preparation (e.g. advisor selection, or helping department). |
To answer the research question, the goals and outcomes identified for each programmatic element in this study were then compared to the thirteen 21st-century skills needed for professional chemist identified in literature as shown in Table 4 (National Research Council, 2012; Cui and Harshman, 2020). Generally, all the programmatic elements contribute to these skills, indicating that the goals and outcomes of the programmatic elements are well-aligned with the intended goal of chemistry doctoral education. However, comments made by several participants make it clear that although the goals of these elements may be intended to prepare students for their career, faculty are hesitant to vouch for actual outcomes, making the degree of alignment of outcomes questionable (see Insights I, II, and III above). Faculty perspectives indicate that the integration might lack depth, practical application, or true effectiveness. Without developing evaluation for the effectiveness of these outcomes, it is unclear how much of this is what the faculty “hopes for” with no real evidence, as noted above in Insight III. For instance, looking deeper into career preparation in Table 4, first glance indicates that there are intended goals and actual outcomes that prepare students for their career within every programmatic element, yet there is evidence that a student aspiring to become a research-intensive faculty may not receive sufficient training or guidance on critical skills such as teaching and mentoring students (Committee on Professional Training, 2015; Heemstra and Moore, 2021; Deng et al., 2024), setting up a lab, and securing funding among others. This is supported by a statement by Participant 8:
21st-Century skills for professional chemists goal (G) outcome (O)* | Programmatic elements | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
RS | AD | PB | GM | CE | CW | DD | LR | AC | AE | SM | TA | |
NB: 21st-century skills without *** are skills that align perfectly with the literature identified 21st-century skills necessary for PhD Chemists while those with *** do align partially with the literature identified 21st-century skills necessary for PhD Chemists. (✓) means at least one participant mentioned it as a goal/outcome for the programmatic element. * These data include all mentioned outcomes, yet some faculty indicated a lack of confidence in these outcomes. Please see Insight III for more details when considering the reported outcomes in this table. **RS – Research, AD – Advisor, PB – Publications, GM – Group meeting, CE – Candidacy process, CW – Coursework, DD – Dissertation and Defense, LR – Lab rotations, AC – Advisory committee, AE – Annual evaluation, SM – Seminar, TA – Teaching assistantship. | ||||||||||||
Communication skills | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✗ | ✓ | ✓ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✗ | ✓ | ✓ | ✓ |
Critical or independent thinking | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✗ | ✓ | ✓ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✗ | ✓ | ✓ | ✓ |
Mentorship (learning and receiving) | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Networking/collaboration | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ |
Novel or significant research | ||||||||||||
G | ✓ | ✗ | ✓ | ✗ | ✗ | ✗ | ✓ | ✗ | ✗ | ✗ | ✗ | ✗ |
O | ✓ | ✓ | ✓ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
Planning or organizational skills | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✗ | ✓ | ✓ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✗ | ✓ | ✓ | ✓ |
Problem solving | ||||||||||||
G | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✗ | ✗ | ✗ | ✓ | ✗ | ✓ |
O | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✗ | ✗ | ✗ | ✓ | ✗ | ✓ |
Teaching skills | ||||||||||||
G | ✓ | ✓ | ✗ | ✓ | ✗ | ✓ | ✗ | ✗ | ✗ | ✗ | ✓ | ✓ |
O | ✓ | ✓ | ✗ | ✓ | ✗ | ✓ | ✗ | ✗ | ✗ | ✗ | ✓ | ✓ |
Technical knowledge/research skills | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ |
Affective outcomes*** | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✗ | ✓ | ✗ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✗ | ✓ | ✗ | ✓ |
Evaluation*** | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Career preparation*** | ||||||||||||
G | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
O | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Ethics*** | ||||||||||||
G | ✓ | ✗ | ✗ | ✓ | ✗ | ✗ | ✗ | ✗ | ✗ | ✓ | ✗ | ✗ |
O | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ |
“I didn’t receive any training and mentorship in my life. I have never been trained to be a mentor. So, in that sense, very likely I am not very good in many areas because again, I have been guided by my own gut of what to do. And when you are guided by your own gut, I think that you just do things that fit with your own persona and that doesn't necessarily get the most appropriate for everybody's personas.”
Furthermore, this issue is compounded by the fact that many doctoral programs focus heavily on academic preparation, even as the career aspirations of graduates increasingly extend beyond academia, often leaving them underprepared for non-academic careers (Golde and Dore, 2001; Donkor et al., 2024). This is elaborated by Participant 40 who cited that candidacy exams could be more effective if they provided tailored feedback to help students align their current focus with their future career goals, such as highlighting overlooked skills like budgeting or stakeholder management for those aiming to work in nonprofits.
Ultimately, despite faculty mentioning that most of the elements had goals/outcomes related to career preparation, these important concerns still exist.
The examination of the goals and outcomes of the programmatic elements of chemistry doctoral programs yielded three key insights:
First, there is a misalignment between stated goals and enacted practices, highlighting the need for reform to enhance program effectiveness. Educating doctoral students requires more than just addressing the programmatic elements in isolation; it demands a holistic approach where each programmatic element, from research to teaching assistantship, aligns with the overarching program goals (preparing students to be competitive for various careers). Reforms should focus on improving the communication and integration of programmatic elements’ goals and outcomes and providing practical training that reflects real-world applications. If there is misalignment, students’ educational experiences and professional growth can be diminished and/or hindered. To better support students, programs must align elements’ goals and outcomes with their program's goals, ensure clear communication of goals and outcomes, and adapt based on student feedback and evolving standards. This misalignment has broader implications for all stakeholders: students may miss key opportunities for growth, faculty may struggle to mentor effectively, administrators must address gaps to improve program coherence, and funding agencies should support initiatives that align program goals with outcomes to enhance the quality of doctoral education.
Second, there are significant issues in the structure of chemistry doctoral programs, emphasizing the need for reform and better alignment of programmatic elements. Structural misalignment between the programmatic elements contributes to student stress, frustration, and diminished educational value. These challenges underscore the importance of integrating programmatic elements to support students’ research and professional development. Uneven advising quality and inadequate training for teaching assistants further compound these issues. To improve program effectiveness, faculty and administrators must address these issues by enhancing communication, alignment, and support systems. Faculty should offer more relevant coursework and mentorship, while administrators should restructure programs to align with students’ research goals and professional needs. The problematic structure of the programmatic elements undermines both academic and professional growth of students. Therefore, faculty and administrators should make efforts to address these issues, while funding agencies should support initiatives that prioritize the creation of student-centred, well-structured doctoral programs to improve educational outcomes.
Third, there is uncertainty about the benefits derived from the key programmatic elements in chemistry doctoral programs. Faculty perspectives reveal that the goals and outcomes of programmatic elements such as coursework, candidacy process, and lab rotations among others are unclear. This lack of clarity can result in misaligned goals/outcomes and ineffective education for students. To address these issues, faculty and program administrators must clearly articulate the goals and outcomes of each programmatic element, ideally including them in written documents to ensure alignment with program goals and student needs. This will enhance program coherence, improve the doctoral education experience, and benefit all stakeholders. For students, clearer goals will reduce confusion and frustration, while faculty will be better equipped to support student learning. Also, administrators should ensure that programmatic elements are beneficial and relevant.
The study also indicates that while the structure of chemistry doctoral program is designed to incorporate essential 21st-century skills to prepare chemists for their careers, the actual integration of these skills is questionable. The alignment between programmatic goals/outcomes and workforce needs exists at a conceptual level but may fall short in practice. Faculty acknowledge that 21st-century skills needed for career chemists like communication skills, networking and collaboration, and career preparation among others are theoretically included in the program, yet the depth, practical application, and acquisition of these skills may be limited. This suggests a need for assessment (and potentially reform) to ensure that these skills are not only addressed in theory in the program's curriculum but are genuinely developed and effectively integrated into students’ educational experiences, thereby enhancing their readiness for real-world careers.
To implement change reflective of these key insights, program advisors can encourage their faculty to engage with self-reflection questions, as outlined in Table 2 of Harshman's review of doctoral education in chemistry (Harshman, 2021). This will allow faculty to critically evaluate how well these skills are being incorporated and to identify areas for improvement in their teaching and mentoring practices and program structure.
Also, programs with clearly defined goals of the program and their programmatic elements can determine how to best align enacted practices with those goals (Donkor and Harshman, 2023). To support this, written documentation of goals and outcomes of each programmatic element, paired with regular evaluation and feedback, would enhance clarity and ensure that programs’ goals are explicit and actionable. Regularly collecting feedback from students and faculty through surveys or focus groups would be essential for identifying and addressing misalignments, helping to ensure that programmatic elements meet student needs and broader program goals. Furthermore, fostering open communication among students, faculty, and administrators creates additional opportunities to identify areas for improvement and implement solutions.
Although this paper offers insights into the structure and effectiveness of doctoral programs in the United States, the implications extend beyond this context, offering contributions that can resonate internationally, given the commonalities of graduate education worldwide. While the study centres on chemistry doctoral programs, the findings regarding misalignments between stated goals and enacted practices, structural deficiencies, and unclear outcomes are widely applicable to doctoral programs in other disciplines and countries. By advocating for a holistic, student-centred approach to curriculum design, clear articulation of goals, and meaningful integration of professional development elements, this paper offers a framework that can be adapted to a variety of educational contexts. Consequently, its outcomes contribute to a broader understanding of how to enhance the effectiveness and relevance of doctoral programs, ensuring they better meet both academic and professional needs of students globally.
Footnote |
† Electronic supplementary information (ESI) available. See DOI: https://doi.org/10.1039/d4rp00308j |
This journal is © The Royal Society of Chemistry 2025 |