Keith S.
Taber
Science Education Centre, University of Cambridge Faculty of Education, 184 Hills Road, Cambridge, CB2 8PQ, UK. E-mail: kst24@cam.ac.uk
![]() | ||
Fig. 1 A successful research journal relies upon a network of people with different (and sometimes multiple) roles, taking their responsibilities seriously. |
I was also especially fortunate to have been invited to edit a journal on the basis that authors would not be expected to pay publication fees, yet the material selected for publication would be made freely available on the web to anyone who wished to access it. That was possible because the RSC sees educational work as part of its charitable mission. By supporting chemical education, including classroom teachers and the researchers who inform their work, the RSC seeks to help secure the future of chemistry. Even so, seeing CERP as an investment worth supporting from the Society's resources was (and, indeed, is) not inevitable, but reflects the support given to the journal by the Council of the Education Division. As a membership organisation, RSC members’ priorities and views have to be taken seriously by the professional officers employed to carry out the Society's work. As an organisation of professional chemical scientists, the RSC has a governance structure that gives its members (through their ‘Divisions’) a major role in influencing the direction of the Society.
This generosity has allowed CERP to not only be read by those working in those universities and institutions with sufficient library funding to purchase institutional subscriptions to RSC journals, but also by both academics in universities and teacher training colleges in developing countries with limited access to resources, and classroom teachers at any level anywhere in the world. Naturally, a Society has to spend its funds carefully, and this policy is rightly open to review, but I am sure many readers of CERP recognise the value of supporting educational research and scholarship by providing a means for publication that is not limited by author funds or reader wealth, and which shares scholarly knowledge for the benefit of all, regardless of ability to pay. Of course, many academics in well-resourced universities do access CERP through institutional access to the RSC's publications, thus CERP also contributes to the value and profile of the RSC journal package.
The work of the journal has been supported by its Editorial Board, under a succession of Chairs (currently Prof. David Treagust of Curtin University) who have been available to offer wise counsel when called upon, and an international Advisory Panel; as well as by a team of people working in the editorial offices at the RSC, and the oversight of a managing editor. Recently, the journal has operated with a team of editors, including not only Michael, but also Ajda Kahveci and Scott Lewis. It would be possible to say much more, and to name many more individual people (which would certainly be deserved) – but the point is that a journal relies on a distributed partnership.
Mutual respect and a sense of being part of a team with shared purposes provides a partnership for moving forward and responding to such tensions constructively. Indeed, part of the responsibility of having a particular role in such a diverse team is in representing the specific interests and concerns associated with that role, and I would suspect that a journal team that never faced difficult discussions is not blessed with a full complement of conscientious critical friends representing the different interests at play.
That said, there is a careful judgement to be made, and editors should always keep in mind that part of the rationale for having a peer review system is that editors are advised by subject experts. So there is a balance of considerations at work here. An editor who sees their role as primarily technical, seeking and acting on peer review, risks overseeing a journal that makes inconsistent publishing decisions and lacks a clear sense of direction and ‘personality’. This is why the top journals seek leading academics in the field who can make decisions from a position of authority, and who have a sense of vision for the field. (I have seen how our new editor, Dr Seery, has been serving and influencing the field through his work with the Chemical Education Research Group and as the chair of the Editorial Board of Education in Chemistry.) On the other hand, as they say, power corrupts and editorial power can corrupt absolutely. Well, at least, there is a danger of the expert editor seeing themselves as sole arbiter of what is good and worthy, and so of the journal (in effect, the journal-as-manifestation-of-the-editor) trying too hard to lead and shape the field, and not being responsive enough to promising research directions emerging among the wider scholarly community. So the ideal editor has the confidence to make definitive and clear decisions, but the humility to recognise limitations and fallibility, and so to know when they should first seek further advice.
Sometimes editors can take an intermediate stance and reject a submission, but offer guidance on where it falls down. This approach has been increasingly adopted in CERP in recent years; offering feedback that falls short of full peer review, but highlights key areas for development rather than simply giving a stark rejection at the initial screening stage. That can be valuable to a new researcher (perhaps not fully appreciating what is needed) who may omit important aspects of a research report making full evaluation in review impossible – a feature that a surprising number of submissions share – but who may have the necessary information to update the submission (or the motivation to undertake any additional work needed before a study is ready to be reported). In such cases the editor's rejection may be accompanied by a potential invitation to make a new submission if certain things can be included in a new manuscript.
There are sometimes nuanced judgements to be made here, and editors can sometimes get decisions wrong, but the editor's responsibility is to do their best in giving suitable submissions a chance in peer review and yet making immediate rejections where there seems no value in a full review – for example, where it seems inevitable that referees will respond that a proper evaluation is simply not possible because the submission lacks sufficient detail of, perhaps, the teaching being undertaken during an intervention, or of the instruments used to collect key data that are the grounds for conclusions and recommendations.
During my time as editor for CERP, I have also used editorials to provide supplementary advice to detail and explain expectations to potential authors – mostly in response to recurring issues that have arisen from scoping enquiries, or during screening or peer review, that led me to believe more guidance may be useful to support authors in appreciating what is expected of an article in CERP. Table 1 specifies a number of the editorials that have included this kind of guidance.
Theme | Issue | Title | Editorial |
---|---|---|---|
Scope | Types of articles sought for publication – and expectations for what is included. | Recognising quality in reports of chemistry education research and practice | Volume 13 (Issue 1) doi: 10.1039/C1RP90058G |
Scope – reporting practice | The requirements for an account of innovative practice to be suitable for reporting as a research paper. | What is wrong with ‘practice’ papers | Volume 17 (Issue 4) doi: 10.1039/C6RP90009G |
Scope – demarcating the field | Discriminating chemical education research from other research carried out in chemistry teaching contexts. | Three levels of chemistry educational research | Volume 14 (Issue 2) doi: 10.1039/C3RP90003G |
Scope – responding to published articles | The nature of ‘Comments’ and ‘Replies’ considered for publication. | The role of interpretation in inferring student knowledge and understanding from research data | Volume 16 (Issue 3) doi: 10.1039/C5RP90008E |
Authorship | Applying authorship criteria in establishing author lists. | Who counts as an author when reporting educational research? | Volume 14 (Issue 1) doi: 10.1039/c2rp90014a |
Ethics | Requirements for studies that involve human participants. | Ethical considerations of chemistry education research involving “human subjects” | Volume 15 (Issue 2) doi: 10.1039/C4RP90003K |
Randomisation | Minimum details required to justify a claim of randomisation in a study. | Non-random thoughts about research | Volume 14 (Issue 4) doi: 10.1039/C3RP90009F |
Appendices | Use and format of appendices for supplementary material. | Supplementing the text: the role of appendices in academic papers | Volume 17 (Issue 1) doi: 10.1039/C5RP90014J |
Translation | The requirements: (a), to explicitly report that data (or instruments/resources) reported are translated from another language; and (b), to offer assurance of the quality of translations. | Lost and found in translation: guidelines for reporting research data in an ‘other’ language | Volume 19 (Issue 3) doi: 10.1039/C8RP90006J |
What is not acceptable, and indeed may sometimes be harder to spot, is where authors deliberately enhance reports to cover up limitations or deficiencies in their research. This does not seem (N.B., as far as we know!) to happen often, but I have seen (in reviewing for other journals) an example of where sample sizes seemed to have been deliberately inflated. That only came to light through the coincidence of being asked to review different versions of the same study for different publications, and would not have been apparent to someone only having access to one version of the submission. Pressure to publish can be severe, and it may seem harmless to falsify something like sample size (perhaps based on a referee comment along the lines that a small sample undermined drawing implications from a study, which an author may have felt was ill informed if the sample was the entire available cohort) but one would hope that any researcher would recognise that the whole scholarly edifice quickly begins to become worthless once a non-negligible proportion of research reports are fictional.
Similar points may be made about authorship disputes. These can occur because people do not understand the expectations; or because in some situations the basic guidelines need careful interpretation; or because someone who knows the rules decides to exclude or include authors inappropriately for some personal motive (to curry favour; to take more credit; to enter an authorship cartel that boosts its members’ publication lists). The first type of case invites better education for new scholars, but there should be no blame on the ignorant when such guidance was not available. They say ignorance of the law does not provide mitigation when a criminal offence is committed, but in the educational community we all have to recognise that our knowledge is partial and flawed – this is perhaps the most generalisable finding from decades of work in science education (Taber, 2009) – and our areas of ignorance are immense.
The second kind of case will always sometimes occur (if only because each potential author inevitably brings some subjectivity to sharing out credit for work), but the frequency can be avoided by following simple procedures and protocols from the outset of any collaboration that might lead to published outputs (Taber, 2018). The final type of case should not be excused. We may understand the pressures that lead to forms of academic misconduct, but we cannot tolerate such behaviours. That is, we may show understanding and compassion for the individual offender, but we must be vigilant to combat the offence.
What seems less excusable is the submission to CERP of papers that are not only not chemistry education research or scholarship (in the opinion of editors and/or expert reviewers) but which are not located by their authors in the field of chemistry education at all. It has amazed me over the years how many manuscripts I have screened which report work in chemistry (or indeed, sometimes, other disciplines!) with no pretence at being about chemistry education, and which it is not possible to construe as having anything to do with chemistry education beyond the trivial sense that someone reading an account of chemical research may learn some chemistry.
Just as editors have responsibilities to carefully consider whether a submission is related to the field before rejecting it as being ‘out of scope’, surely authors should have a responsibility to look at a journal and perhaps even read how it is described by the publisher, before deciding to submit to it and invite a certain rejection? One is left with the impression that some authors are happy to submit to a journal without doing any basic research to find out what kinds of articles are considered, or to familiarise themselves with the types of work recently published in the journal (i.e., the ‘due diligence’ I referred to above). This does not improve their reputations as scholars, nor their publication lists.
I might also add that a good editor tries to ignore the covering letters sometimes received with submissions making the case for why the authors feel their contribution fits perfectly in… a different journal. Sometimes this seems to be simply getting the name of the journal wrong (lack of due diligence again?), at other times it seems to be a letter originally written for another journal which has not been updated for submission to CERP. Both explanations might suggest sloppiness on behalf of authors. (If researchers do not take care about the name of the journal they are submitting work to, then can we be confident they have carefully checked the data and analysis presented in the manuscript they wish considered for publication?) Whilst on that theme, I have not been impressed by the argument challenging my summary rejection of a submission that I felt was not strong enough for peer review, that I must be making a poor decision because the same submission was only rejected by another journal after peer review. (Perhaps if the authors of such a manuscript had not submitted the ‘same’ manuscript to CERP, but rather had taken into account the peer review comments offered by referees for the other journal in order to improve their manuscript it might have been judged less harshly by CERP.)
I found that authors of published research, as well as of manuscripts I had been asked to review, often suggested that alpha was a measure of the ‘reliability’ of an instrument such as a test of chemical knowledge, and that the important criterion was that alpha should reach at least 0.7, with the higher the value the better. My reading-up of the topic, however, suggested that alpha measured internal consistency (not reliability as it is usually understood in science in terms of an instrument giving repeatable measurements) of a particular administration of a unidimensional scale (i.e., one intended to measure a distinct unitary construct), and was highly sensitive to the number of items included. So, for example, an alpha of 0.7 for a three item scale needs to be interpreted very differently than an alpha of 0.7 for a 20 item scale. Moreover, very high values of alpha (e.g., 0.95) that were presented as indicators of high quality by some authors actually suggested a suboptimal instrument with too much redundancy. I found sloppy or causal uses of alpha to be widespread in published articles in top science education journals (Taber, 2017), suggesting that other colleagues might also benefit from learning more about the tool.
Having accepted an assignment, it is possible that the manuscript seems quite different from what the reviewer expected based on a title and abstract. If so, it is acceptable, and indeed may be appropriate, to withdraw (without losing face) and indeed the fault may be more a matter of an incomplete or unhelpful abstract than an insufficiently selective acceptance of the assignment by the potential reviewer. More often, reviewers may feel they have partial expertise – being in a strong position to critique, and offer constructive advice on, the theoretical framework, perhaps, but not the details of a particular methodology or research design or analytical technique. This may be quite common as in a specialist field there may be no suitable reviewer who can address all aspects of a manuscript outside of the authors’ own group and other collaborators.
The editor's responsibility is to find reviewers who can collectively ‘cover the bases’, whilst a reviewer has a responsibility to acknowledge any areas of relative weakness to support the editor in this task. As a reviewer, I have sometimes pointed out to editors that I can only offer a superficial evaluation of some specific quantitative analytical techniques, and that I hope and recommend that this aspect of a manuscript is being looked at by another reviewer.
Editors have a responsibility to moderate as well as give due weight to reviewer recommendations: to balance competing views, to seek additional viewpoints if initial reports do not provide a strong basis for a clear decision, and ultimately to use their own judgement when there are genuine disagreements among peer reviewers. Ideally, we would want authors to be able to revise their submissions sufficiently to meet any reviewer concerns so that everyone is satisfied – an article gets published, but is improved through responses to peer review. Despite taking such a constructive perspective, editors have to be prepared to recognise when this is not going to happen and authors are simply not able to address serious concerns about an article's quality. I have always tried, and usually succeeded, in looking to make a decision within a day or so of the completed reviews being available.
I have felt obliged to do that as the RSC itself works quickly. Articles may be published within a couple of hours of acceptance (as a manuscript ‘accepted’ version) and the proofs usually get sent to authors within a matter of days. In the case of CERP, where authors do not currently pay fees to publish their work, this is an exceptional service, and I have always felt privileged to be part of this enterprise; my experience as an author elsewhere is sometimes quite different. Indeed CERP sometimes rivals the turn-around promised by those journals with much less substantial and rigorous peer review processes and quality criteria. I have even heard informally that at least one major ‘competitor’ journal has revisited its own procedures in view of what CERP was offering.
Publishers generally see it as their responsibility to protect the copyright in published works, and, for example, look to remove pirate copies of publications from unauthorised websites (most authors of books will, if they search, find pdf copies of their works being offered for free to tempt visitors to dubious websites). Again the author has responsibilities. In signing the publishing agreement the author gives an assurance that the work submitted for publication is entirely the copyright of the author. This may not be true if the author has lazily ‘cut and pasted’ large segments of an already published work that they have previously licensed to another publisher. Some authors (probably inadvertently) ‘sell’ exclusive rights to the same product to different publishers. These authors may assume they retain copyright on their previous works despite having already offered it to publishers in return for consideration – which may be financial or the service of publishing the work. Most publishers are perfectly happy for authors to republish a limited amount of previous material, as long as they use a set form of acknowledgement to the prior publication – a very small thing to ask of authors.
The oft-seen term ‘copyright-free’ is unfortunate, as (certainly in English law) copyright is automatic, and so recent works are never free of copyright: but of course a copyright owner may chose to waive their right to control copying and give permission for free use of materials. Whether scanned/downloaded images freely incorporated in teaching materials restricted to a single classroom are infringing copyright may be a question that is unlikely to ever be legally tested, but if such materials are then used in research publications reporting on the teaching concerned, then this becomes a very clear case of the publisher needing to know that the legal copyright owner has given permission for use in the publication.
Copyright is not the only moral right offered to authors in law in most countries. Authors are also given the right to be named as the author of a work – thus the wording in the front material of many books reporting that some person asserts their right to be named as the author of that work. Actually, the author is allowed to choose whether they prefer to be anonymous, or to use a pen name, although this is unlikely to be something an academic publisher would allow for scholarly works. However, those readers who have come across, and maybe even used, Student's t-test may not appreciate that Student (1908) was a pseudonym for a statistician whose employers did not wish him to publish work under his own name!
Of course, no respectable academic publisher would be so careless or malicious as to do such a thing. Yet some perfectly respectable publishers, unsure how developments in new technology will impact on scholarly publishing, are asking authors to sign a legal waiver of their statutory moral rights as part of publishing contracts. For example, one contract I was recently offered (and declined) asked me to agree that “amendments, alterations or additions to the Contribution made by the Publisher or an authorized third party, such as the Editor” would not “infringe the Contributing Author's right of integrity in the Contribution which the Contributing Author may now or at any future time be entitled…” (OUP, 2018, p. 2). I was asked to sign to confirm that I waived my legal right to the integrity of my published work.
In effect, the author is here being asked, as a condition of having their work published, to agree that the publisher may make any changes to the author's work or any subsidiary work derived from it, that they see fit, at any time, for any purpose, without consultation with the author and without acknowledging that the published text has been modified from that provided by the named author. It is very hard to imagine any circumstances where a publisher would need to make such changes without (preferably) getting the author's agreement or (otherwise) acknowledging to readers that another party had amended the text. Indeed, when I have asked what circumstances might require such actions (when told that the waiver clause was not negotiable in a contract), no one has been able to suggest any.
Despite this, some publishers are routinely asking authors to sign such waivers. This is a situation where publishers, just as authors, need to take their responsibilities seriously. Other leading publishers who had previously adopted such clauses have since withdrawn them from publishing agreements and acknowledged that they are not appropriate in academic publishing. It is hard to see how a careful publisher would accidentally leave themselves open to legal action for damaging a scholar's reputation by corrupting their work on publication – but a publisher who wishes to be taken seriously by scholars will see it is their responsibility to take sufficient care not to make such mistakes, and would not ask contributors to waive protections provided in law.
The law then offers protections to all parties against deliberate or accidental abuses of rights – protection against the author who thinks they can simply reuse a published diagram that is someone else's copyright, or who ‘cuts and pastes’ from their previous writings even when they have licensed the rights to that work elsewhere; protection against a publisher failing to identify the author of a published article, or making unauthorised changes that distort an author's text when publishing their work. No responsible publisher with careful quality assurance procedures should need to fear legal redress for corrupting an author's text, and therefore authors might suspect that publishers asking authors to waive their legal rights should not be trusted with their work. Similarly, publishers have a right to expect authors to be equally carefully in terms of their side of the contract, and – for example – to ensure they are in a position to offer a licence to publish all that is included in their submitted work.
This can sometimes be an uneven partnership. Authors may be very aware of the debt that research owes to participants – at least at the point of negotiating access and seeking volunteers. Sometimes, once data is collected, there is a shift of focus – perhaps because normally the people who helped us then become (appropriately) anonymised in our analyses and reports. We should seek to ensure people receive some benefit for their input (and are at least offered information on outcomes), and where all we can offer is the good feeling that comes from an altruist act then we must at least be confident that this act was based on a free choice without coercion or fear of consequences of non-participation.
There is nothing wrong with asking our students, or institutional colleagues, or teachers attending our professional development courses, to voluntarily help us in our research; but we should never take it for granted that they will think there is good reason to volunteer. Procedures and safeguards are especially important in these circumstances (Taber, 2013). We should use our position of greater knowledge and power to protect participants, and certainly should not see them as just the means to an end. For example, we should not set up control conditions that we know are likely to be educationally detrimental in order to make it more likely that an experimental intervention provides (comparatively) positive outcomes.
It is easy to become convinced that our own work is inherently interesting and potentially important – but we have no right to expect potential participants to take that view, and no reason to expect them to see our research as the best use of their time and energies. This is sometimes the ignored or forgotten partnership in academic publishing – and if we want to continue to benefit from the gift of data, then we should always enter such relationships aware of the rights of participants (for example, their copyright in their own work), and our responsibilities (as well as our gratitude) towards them.
This journal is © The Royal Society of Chemistry 2019 |