Why Is Peer Review Important When Publishing Experimental Results
EJIFCC. 2014 Oct; 25(three): 227–243.
Published online 2014 Oct 24.
Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide
Jacalyn Kelly
1Clinical Biochemistry, Section of Pediatric Laboratory Medicine, The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
Tara Sadeghieh
oneClinical Biochemistry, Department of Pediatric Laboratory Medicine, The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
Khosrow Adeli
1Clinical Biochemistry, Section of Pediatric Laboratory Medicine, The Infirmary for Sick Children, University of Toronto, Toronto, Ontario, Canada
2Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Canada
3Chair, Communications and Publications Sectionalization (CPD), International Federation for Ill Clinical Chemistry (IFCC), Milan, Italian republic
Abstract
Peer review has been defined every bit a process of subjecting an author's scholarly work, inquiry or ideas to the scrutiny of others who are experts in the same field. Information technology functions to encourage authors to meet the accepted high standards of their subject area and to control the dissemination of inquiry data to ensure that unwarranted claims, unacceptable interpretations or personal views are not published without prior good review. Despite its broad-spread use by nigh journals, the peer review process has also been widely criticised due to the slowness of the procedure to publish new findings and due to perceived bias past the editors and/or reviewers. Inside the scientific community, peer review has become an essential component of the bookish writing process. It helps ensure that papers published in scientific journals answer meaningful enquiry questions and draw accurate conclusions based on professionally executed experimentation. Submission of depression quality manuscripts has get increasingly prevalent, and peer review acts as a filter to preclude this work from reaching the scientific community. The major reward of a peer review procedure is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific knowledge is cumulative and builds on itself, this trust is particularly of import. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts as a poor screen confronting plagiarism. Despite its downfalls, there has not nonetheless been a foolproof system developed to take the place of peer review, however, researchers have been looking into electronic means of improving the peer review process. Unfortunately, the contempo explosion in online only/electronic journals has led to mass publication of a large number of scientific articles with footling or no peer review. This poses significant take a chance to advances in scientific noesis and its futurity potential. The electric current commodity summarizes the peer review process, highlights the pros and cons associated with unlike types of peer review, and describes new methods for improving peer review.
Cardinal words: peer review, manuscript, publication, journal, open access
WHAT IS PEER REVIEW AND WHAT IS ITS PURPOSE?
Peer Review is defined every bit "a procedure of subjecting an author'due south scholarly work, research or ideas to the scrutiny of others who are experts in the same field" (i). Peer review is intended to serve two primary purposes. Firstly, it acts every bit a filter to ensure that only high quality enquiry is published, specially in reputable journals, past determining the validity, significance and originality of the study. Secondly, peer review is intended to improve the quality of manuscripts that are deemed suitable for publication. Peer reviewers provide suggestions to authors on how to better the quality of their manuscripts, and also identify any errors that need correcting before publication.
HISTORY OF PEER REVIEW
The concept of peer review was adult long before the scholarly journal. In fact, the peer review process is idea to have been used as a method of evaluating written work since ancient Hellenic republic (two). The peer review process was kickoff described by a physician named Ishaq bin Ali al-Rahwi of Syria, who lived from 854-931 CE, in his book Ethics of the Physician (two). There, he stated that physicians must have notes describing the land of their patients' medical weather condition upon each visit. Following treatment, the notes were scrutinized by a local medical council to determine whether the md had met the required standards of medical care. If the medical council deemed that the appropriate standards were non met, the medico in question could receive a lawsuit from the maltreated patient (2).
The invention of the printing printing in 1453 allowed written documents to exist distributed to the general public (3). At this time, it became more of import to regulate the quality of the written fabric that became publicly available, and editing by peers increased in prevalence. In 1620, Francis Salary wrote the piece of work Novum Organum, where he described what somewhen became known as the start universal method for generating and assessing new science (three). His piece of work was instrumental in shaping the Scientific Method (three). In 1665, the French Journal des sçavans and the English Philosophical Transactions of the Royal Society were the commencement scientific journals to systematically publish research results (four). Philosophical Transactions of the Majestic Social club is thought to be the first journal to formalize the peer review process in 1665 (5), notwithstanding, it is important to note that peer review was initially introduced to help editors decide which manuscripts to publish in their journals, and at that time it did non serve to ensure the validity of the research (6). It did non accept long for the peer review process to evolve, and before long thereafter papers were distributed to reviewers with the intent of authenticating the integrity of the research written report before publication. The Regal Guild of Edinburgh adhered to the following peer review process, published in their Medical Essays and Observations in 1731: "Memoirs sent past correspondence are distributed co-ordinate to the subject field matter to those members who are virtually versed in these matters. The study of their identity is not known to the author." (7). The Royal Society of London adopted this review procedure in 1752 and developed the "Committee on Papers" to review manuscripts earlier they were published in Philosophical Transactions (half-dozen).
Peer review in the systematized and institutionalized form has adult immensely since the 2d World War, at least partly due to the big increase in scientific research during this period (7). It is now used non only to ensure that a scientific manuscript is experimentally and ethically sound, but also to determine which papers sufficiently encounter the periodical's standards of quality and originality before publication. Peer review is now standard exercise past most credible scientific journals, and is an essential part of determining the credibility and quality of work submitted.
Touch OF THE PEER REVIEW PROCESS
Peer review has become the foundation of the scholarly publication organization because it effectively subjects an writer'south work to the scrutiny of other experts in the field. Thus, information technology encourages authors to strive to produce high quality research that will accelerate the field. Peer review also supports and maintains integrity and authenticity in the advocacy of science. A scientific hypothesis or argument is mostly not accustomed by the bookish community unless information technology has been published in a peer-reviewed journal (eight). The Institute for Scientific Data (ISI) only considers journals that are peer-reviewed equally candidates to receive Affect Factors. Peer review is a well-established process which has been a formal part of scientific communication for over 300 years.
OVERVIEW OF THE PEER REVIEW PROCESS
The peer review procedure begins when a scientist completes a enquiry study and writes a manuscript that describes the purpose, experimental design, results, and conclusions of the study. The scientist then submits this paper to a suitable journal that specializes in a relevant research field, a step referred to as pre-submission. The editors of the journal will review the paper to ensure that the bailiwick matter is in line with that of the periodical, and that information technology fits with the editorial platform. Very few papers pass this initial evaluation. If the journal editors feel the paper sufficiently meets these requirements and is written by a credible source, they will transport the paper to accomplished researchers in the field for a formal peer review. Peer reviewers are also known as referees (this procedure is summarized in Effigy 1). The role of the editor is to select the most advisable manuscripts for the journal, and to implement and monitor the peer review procedure. Editors must ensure that peer reviews are conducted fairly, and in an constructive and timely fashion. They must also ensure that there are no conflicts of involvement involved in the peer review process.
Overview of the review procedure
When a reviewer is provided with a paper, he or she reads it carefully and scrutinizes it to evaluate the validity of the science, the quality of the experimental design, and the appropriateness of the methods used. The reviewer also assesses the significance of the enquiry, and judges whether the work will contribute to advancement in the field by evaluating the importance of the findings, and determining the originality of the research. Additionally, reviewers place any scientific errors and references that are missing or incorrect. Peer reviewers requite recommendations to the editor regarding whether the newspaper should exist accepted, rejected, or improved earlier publication in the journal. The editor volition mediate author-referee give-and-take in order to clarify the priority of certain referee requests, suggest areas that tin exist strengthened, and overrule reviewer recommendations that are across the study'southward scope (ix). If the paper is accepted, as per suggestion past the peer reviewer, the paper goes into the product stage, where it is tweaked and formatted by the editors, and finally published in the scientific journal. An overview of the review process is presented in Figure 1.
WHO CONDUCTS REVIEWS?
Peer reviews are conducted by scientific experts with specialized knowledge on the content of the manuscript, besides as past scientists with a more than general knowledge base. Peer reviewers can exist anyone who has competence and expertise in the discipline areas that the journal covers. Reviewers tin can range from young and up-and-coming researchers to quondam masters in the field. Often, the immature reviewers are the most responsive and deliver the all-time quality reviews, though this is not always the example. On boilerplate, a reviewer volition conduct approximately viii reviews per year, according to a study on peer review by the Publishing Research Consortium (Prc) (7). Journals volition ofttimes have a pool of reviewers with diverse backgrounds to allow for many dissimilar perspectives. They will also proceed a rather big reviewer banking concern, and then that reviewers do not get burnt out, overwhelmed or time constrained from reviewing multiple manufactures simultaneously.
WHY Exercise REVIEWERS REVIEW?
Referees are typically not paid to conduct peer reviews and the procedure takes considerable effort, then the question is raised as to what incentive referees have to review at all. Some feel an academic duty to perform reviews, and are of the mentality that if their peers are expected to review their papers, then they should review the work of their peers too. Reviewers may also have personal contacts with editors, and may want to aid as much as possible. Others review to keep up-to-date with the latest developments in their field, and reading new scientific papers is an effective way to practice so. Some scientists utilise peer review equally an opportunity to advance their own research equally information technology stimulates new ideas and allows them to read most new experimental techniques. Other reviewers are keen on building associations with prestigious journals and editors and condign office of their customs, as sometimes reviewers who bear witness dedication to the journal are later hired as editors. Some scientists see peer review as a risk to become aware of the latest enquiry earlier their peers, and thus exist first to develop new insights from the material. Finally, in terms of career development, peer reviewing can be desirable as it is often noted on one's resume or CV. Many institutions consider a researcher's involvement in peer review when assessing their functioning for promotions (11). Peer reviewing can also be an effective mode for a scientist to show their superiors that they are committed to their scientific field (five).
ARE REVIEWERS Not bad TO REVIEW?
A 2009 international survey of 4000 peer reviewers conducted by the clemency Sense Virtually Science at the British Science Festival at the University of Surrey, found that 90% of reviewers were keen to peer review (12). I third of respondents to the survey said they were happy to review up to five papers per year, and an additional ane third of respondents were happy to review up to ten.
HOW LONG DOES IT Have TO REVIEW ONE PAPER?
On average, it takes approximately six hours to review one paper (12), notwithstanding, this number may vary profoundly depending on the content of the paper and the nature of the peer reviewer. I in every 100 participants in the "Sense About Science" survey claims to take taken more than 100 hours to review their last paper (12).
HOW TO Make up one's mind IF A JOURNAL IS PEER REVIEWED
Ulrichsweb is a directory that provides data on over 300,000 periodicals, including information regarding which journals are peer reviewed (13). After logging into the system using an institutional login (eg. from the University of Toronto), search terms, journal titles or ISSN numbers can be entered into the search bar. The database provides the title, publisher, and country of origin of the journal, and indicates whether the periodical is still actively publishing. The blackness book symbol (labelled 'refereed') reveals that the journal is peer reviewed.
THE EVALUATION CRITERIA FOR PEER REVIEW OF SCIENTIFIC PAPERS
Every bit previously mentioned, when a reviewer receives a scientific manuscript, he/she will first make up one's mind if the discipline matter is well suited for the content of the journal. The reviewer will and so consider whether the research question is important and original, a process which may be aided by a literature scan of review articles.
Scientific papers submitted for peer review ordinarily follow a specific construction that begins with the championship, followed past the abstract, introduction, methodology, results, discussion, conclusions, and references. The championship must be descriptive and include the concept and organism investigated, and potentially the variable manipulated and the systems used in the written report. The peer reviewer evaluates if the title is descriptive enough, and ensures that it is articulate and concise. A written report past the National Association of Realtors (NAR) published by the Oxford Academy Press in 2006 indicated that the championship of a manuscript plays a pregnant part in determining reader interest, as 72% of respondents said they could usually judge whether an article will be of interest to them based on the title and the author, while 13% of respondents claimed to ever be able to exercise so (14).
The abstract is a summary of the paper, which briefly mentions the groundwork or purpose, methods, key results, and major conclusions of the written report. The peer reviewer assesses whether the abstract is sufficiently informative and if the content of the abstract is consequent with the rest of the paper. The NAR study indicated that xl% of respondents could determine whether an article would be of interest to them based on the abstract lone lx-fourscore% of the fourth dimension, while 32% could judge an article based on the abstruse eighty-100% of the time (14). This demonstrates that the abstract alone is oftentimes used to assess the value of an article.
The introduction of a scientific newspaper presents the research question in the context of what is already known nigh the topic, in order to identify why the question being studied is of interest to the scientific community, and what gap in noesis the study aims to make full (15). The introduction identifies the study's purpose and scope, briefly describes the full general methods of investigation, and outlines the hypothesis and predictions (xv). The peer reviewer determines whether the introduction provides sufficient background data on the research topic, and ensures that the research question and hypothesis are clearly identifiable.
The methods section describes the experimental procedures, and explains why each experiment was conducted. The methods section also includes the equipment and reagents used in the investigation. The methods section should be detailed enough that it can be used it to repeat the experiment (fifteen). Methods are written in the past tense and in the active voice. The peer reviewer assesses whether the advisable methods were used to reply the inquiry question, and if they were written with sufficient detail. If information is missing from the methods section, it is the peer reviewer'south job to identify what details need to be added.
The results section is where the outcomes of the experiment and trends in the data are explained without judgement, bias or estimation (xv). This section tin include statistical tests performed on the data, likewise as figures and tables in addition to the text. The peer reviewer ensures that the results are described with sufficient detail, and determines their credibility. Reviewers also confirm that the text is consistent with the information presented in tables and figures, and that all figures and tables included are important and relevant (fifteen). The peer reviewer will besides make sure that tabular array and figure captions are advisable both contextually and in length, and that tables and figures present the data accurately.
The discussion section is where the data is analyzed. Hither, the results are interpreted and related to past studies (15). The discussion describes the meaning and significance of the results in terms of the inquiry question and hypothesis, and states whether the hypothesis was supported or rejected. This section may also provide possible explanations for unusual results and suggestions for future inquiry (15). The discussion should stop with a conclusions section that summarizes the major findings of the investigation. The peer reviewer determines whether the word is clear and focused, and whether the conclusions are an appropriate estimation of the results. Reviewers as well ensure that the discussion addresses the limitations of the written report, whatsoever anomalies in the results, the human relationship of the study to previous research, and the theoretical implications and practical applications of the study.
The references are establish at the end of the newspaper, and list all of the information sources cited in the text to describe the background, methods, and/or interpret results. Depending on the citation method used, the references are listed in alphabetical social club according to writer last name, or numbered according to the order in which they appear in the paper. The peer reviewer ensures that references are used appropriately, cited accurately, formatted correctly, and that none are missing.
Finally, the peer reviewer determines whether the newspaper is clearly written and if the content seems logical. Subsequently thoroughly reading through the unabridged manuscript, they make up one's mind whether information technology meets the journal's standards for publication,
and whether it falls within the top 25% of papers in its field (16) to determine priority for publication. An overview of what a peer reviewer looks for when evaluating a manuscript, in lodge of importance, is presented in Figure two.
How a peer review evaluates a manuscript
To increase the chance of success in the peer review process, the writer must ensure that the paper fully complies with the periodical guidelines before submission. The author must likewise exist open to criticism and suggested revisions, and learn from mistakes fabricated in previous submissions.
ADVANTAGES AND DISADVANTAGES OF THE Dissimilar TYPES OF PEER REVIEW
The peer review process is mostly conducted in i of three means: open up review, unmarried-bullheaded review, or double-blind review. In an open review, both the author of the paper and the peer reviewer know one another'due south identity. Alternatively, in unmarried-blind review, the reviewer's identity is kept individual, merely the author's identity is revealed to the reviewer. In double-blind review, the identities of both the reviewer and author are kept bearding. Open peer review is advantageous in that it prevents the reviewer from leaving malicious comments, beingness devil-may-care, or procrastinating completion of the review (2). Information technology encourages reviewers to be open and honest without beingness disrespectful. Open reviewing also discourages plagiarism among authors (2). On the other hand, open peer review can also preclude reviewers from being honest for fear of developing bad rapport with the author. The reviewer may withhold or tone downward their criticisms in club to exist polite (2). This is especially truthful when younger reviewers are given a more esteemed author's work, in which instance the reviewer may be hesitant to provide criticism for fear that it will damper their relationship with a superior (2). According to the Sense About Science survey, editors find that completely open reviewing decreases the number of people willing to participate, and leads to reviews of little value (12). In the aforementioned written report by the PRC, only 23% of authors surveyed had experience with open peer review (7).
Single-blind peer review is by far the most common. In the Communist china study, 85% of authors surveyed had experience with unmarried-blind peer review (7). This method is advantageous as the reviewer is more probable to provide honest feedback when their identity is concealed (2). This allows the reviewer to make independent decisions without the influence of the author (2). The main disadvantage of reviewer anonymity, notwithstanding, is that reviewers who receive manuscripts on subjects similar to their ain inquiry may be tempted to delay completing the review in order to publish their own data first (2).
Double-blind peer review is advantageous as information technology prevents the reviewer from being biased against the author based on their land of origin or previous work (2). This allows the paper to be judged based on the quality of the content, rather than the reputation of the author. The Sense Near Science survey indicates that 76% of researchers remember double-blind peer review is a good idea (12), and the Communist china survey indicates that 45% of authors have had experience with double-bullheaded peer review (seven). The disadvantage of double-blind peer review is that, especially in niche areas of research, information technology tin can sometimes exist easy for the reviewer to determine the identity of the author based on writing style, subject area matter or self-commendation, and thus, impart bias (2).
Masking the author's identity from peer reviewers, as is the instance in double-blind review, is generally idea to minimize bias and maintain review quality. A study by Justice et al. in 1998 investigated whether masking author identity affected the quality of the review (17). One hundred and eighteen manuscripts were randomized; 26 were peer reviewed as normal, and 92 were moved into the 'intervention' arm, where editor quality assessments were completed for 77 manuscripts and author quality assessments were completed for xl manuscripts (17). There was no perceived difference in quality between the masked and unmasked reviews. Additionally, the masking itself was often unsuccessful, specially with well-known authors (17). However, a previous study conducted by McNutt et al. had different results (18). In this case, blinding was successful 73% of the time, and they establish that when author identity was masked, the quality of review was slightly higher (eighteen). Although Justice et al. argued that this difference was too small to be consequential, their written report targeted only biomedical journals, and the results cannot be generalized to journals of a different subject matter (17). Additionally, there were problems masking the identities of well-known authors, introducing a flaw in the methods. Regardless, Justice et al. concluded that masking writer identity from reviewers may not ameliorate review quality (17).
In add-on to open, single-blind and double-bullheaded peer review, there are two experimental forms of peer review. In some cases, following publication, papers may be subjected to post-publication peer review. Every bit many papers are now published online, the scientific community has the opportunity to comment on these papers, engage in online discussions and mail a formal review. For case, online publishers PLOS and BioMed Fundamental have enabled scientists to post comments on published papers if they are registered users of the site (x). Philica is some other journal launched with this experimental form of peer review. Only 8% of authors surveyed in the PRC study had experience with post-publication review (7). Another experimental form of peer review called Dynamic Peer Review has also emerged. Dynamic peer review is conducted on websites such as Naboj, which allow scientists to conduct peer reviews on articles in the preprint media (19). The peer review is conducted on repositories and is a continuous process, which allows the public to see both the article and the reviews equally the commodity is being developed (19). Dynamic peer review helps foreclose plagiarism every bit the scientific community will already be familiar with the piece of work before the peer reviewed version appears in print (19). Dynamic review also reduces the time lag between manuscript submission and publishing. An case of a preprint server is the 'arXiv' developed by Paul Ginsparg in 1991, which is used primarily by physicists (xix). These alternative forms of peer review are still un-established and experimental. Traditional peer review is time-tested and still highly utilized. All methods of peer review accept their advantages and deficiencies, and all are prone to mistake.
PEER REVIEW OF OPEN Access JOURNALS
Open admission (OA) journals are becoming increasingly popular as they allow the potential for widespread distribution of publications in a timely manner (xx). Nevertheless, at that place can be issues regarding the peer review procedure of open access journals. In a study published in Scientific discipline in 2013, John Bohannon submitted 304 slightly different versions of a fictional scientific paper (written by a fake author, working out of a not-existent institution) to a selected grouping of OA journals. This study was performed in club to make up one's mind whether papers submitted to OA journals are properly reviewed earlier publication in comparison to subscription-based journals. The journals in this study were selected from the Directory of Open Access Journals (DOAJ) and Biall's List, a list of journals which are potentially predatory, and all required a fee for publishing (21). Of the 304 journals, 157 accepted a fake newspaper, suggesting that acceptance was based on financial interest rather than the quality of article itself, while 98 journals promptly rejected the fakes (21). Although this written report highlights useful information on the problems associated with lower quality publishers that do not accept an effective peer review organisation in identify, the commodity also generalizes the study results to all OA journals, which tin exist detrimental to the full general perception of OA journals. In that location were two limitations of the report that fabricated information technology impossible to accurately decide the human relationship betwixt peer review and OA journals: 1) there was no control group (subscription-based journals), and 2) the fake papers were sent to a not-randomized selection of journals, resulting in bias.
JOURNAL ACCEPTANCE RATES
Based on a contempo survey, the average acceptance rate for papers submitted to scientific journals is nearly 50% (vii). Xx percent of the submitted manuscripts that are not accustomed are rejected prior to review, and xxx% are rejected following review (seven). Of the l% accepted, 41% are accepted with the status of revision, while only 9% are accepted without the request for revision (seven).
SATISFACTION WITH THE PEER REVIEW SYSTEM
Based on a contempo survey by the Prc, 64% of academics are satisfied with the current system of peer review, and only 12% claimed to be 'dissatisfied' (7). The large bulk, 85%, agreed with the statement that 'scientific communication is profoundly helped by peer review' (7). There was a similarly high level of support (83%) for the thought that peer review 'provides control in scientific communication' (vii).
HOW TO PEER REVIEW EFFECTIVELY
The following are ten tips on how to exist an constructive peer reviewer every bit indicated past Brian Lucey, an skilful on the subject (22):
1) Be professional
Peer review is a mutual responsibility amidst swain scientists, and scientists are expected, as part of the academic customs, to take role in peer review. If one is to await others to review their work, they should commit to reviewing the piece of work of others as well, and put effort into it.
2) Be pleasant
If the paper is of low quality, propose that it be rejected, but practise non go out advertisement hominem comments. There is no benefit to existence ruthless.
3) Read the invite
When emailing a scientist to ask them to conduct a peer review, the majority of journals will provide a link to either accept or refuse. Do not respond to the email, respond to the link.
4) Be helpful
Suggest how the authors can overcome the shortcomings in their newspaper. A review should guide the author on what is skilful and what needs work from the reviewer'south perspective.
5) Be scientific
The peer reviewer plays the role of a scientific peer, non an editor for proofreading or controlling. Don't fill a review with comments on editorial and typographic problems. Instead, focus on adding value with scientific knowledge and commenting on the brownie of the research conducted and conclusions drawn. If the paper has a lot of typographical errors, suggest that information technology be professionally proof edited equally function of the review.
6) Be timely
Stick to the timeline given when conducting a peer review. Editors runway who is reviewing what and when and will know if someone is late on completing a review. It is important to be timely both out of respect for the journal and the author, as well every bit to not develop a reputation of being late for review deadlines.
7) Be realistic
The peer reviewer must be realistic about the work presented, the changes they advise and their function. Peer reviewers may fix the bar too high for the paper they are editing by proposing changes that are as well ambitious and editors must override them.
eight) Be empathetic
Ensure that the review is scientific, helpful and courteous. Exist sensitive and respectful with word choice and tone in a review.
9) Exist open
Remember that both specialists and generalists can provide valuable insight when peer reviewing. Editors will endeavor to become both specialised and general reviewers for any item paper to allow for dissimilar perspectives. If someone is asked to review, the editor has adamant they take a valid and useful function to play, even if the paper is not in their area of expertise.
10) Exist organised
A review requires structure and logical flow. A reviewer should proofread their review before submitting it for structural, grammatical and spelling errors too as for clarity. Nearly publishers provide short guides on structuring a peer review on their website. Begin with an overview of the proposed improvements; then provide feedback on the paper structure, the quality of information sources and methods of investigation used, the logical menstruum of argument, and the validity of conclusions drawn. Then provide feedback on style, voice and lexical concerns, with suggestions on how to better.
In addition, the American Physiology Social club (APS) recommends in its Peer Review 101 Handout that peer reviewers should put themselves in both the editor's and writer's shoes to ensure that they provide what both the editor and the writer need and wait (eleven). To please the editor, the reviewer should ensure that the peer review is completed on time, and that it provides clear explanations to back up recommendations. To be helpful to the author, the reviewer must ensure that their feedback is constructive. It is suggested that the reviewer accept time to think almost the paper; they should read information technology once, expect at least a day, and then re-read it earlier writing the review (11). The APS also suggests that Graduate students and researchers pay attention to how peer reviewers edit their work, equally well every bit to what edits they find helpful, in society to larn how to peer review effectively (11). Additionally, it is suggested that Graduate students exercise reviewing by editing their peers' papers and asking a faculty fellow member for feedback on their efforts. It is recommended that young scientists offer to peer review every bit ofttimes as possible in order to get skilled at the process (11). The majority of students, fellows and trainees exercise non get formal preparation in peer review, just rather acquire by observing their mentors. According to the APS, ane acquires experience through networking and referrals, and should therefore try to strengthen relationships with journal editors by offering to review manuscripts (11). The APS also suggests that experienced reviewers provide constructive feedback to students and junior colleagues on their peer review efforts, and encourages them to peer review to demonstrate the importance of this process in improving science (11).
The peer reviewer should only comment on areas of the manuscript that they are knowledgeable nearly (23). If there is any section of the manuscript they feel they are non qualified to review, they should mention this in their comments and non provide farther feedback on that section. The peer reviewer is not permitted to share any office of the manuscript with a colleague (fifty-fifty if they may be more knowledgeable in the subject affair) without first obtaining permission from the editor (23). If a peer reviewer comes beyond something they are unsure of in the newspaper, they can consult the literature to try and proceeds insight. It is important for scientists to remember that if a newspaper can be improved past the expertise of one of their colleagues, the journal must exist informed of the colleague's assist, and approval must be obtained for their colleague to read the protected certificate. Additionally, the colleague must be identified in the confidential comments to the editor, in club to ensure that he/she is appropriately credited for any contributions (23). It is the job of the reviewer to make sure that the colleague assisting is enlightened of the confidentiality of the peer review procedure (23). Once the review is consummate, the manuscript must exist destroyed and cannot be saved electronically past the reviewers (23).
COMMON ERRORS IN SCIENTIFIC PAPERS
When performing a peer review, there are some common scientific errors to await out for. Most of these errors are violations of logic and mutual sense: these may include contradicting statements, unwarranted conclusions, suggestion of causation when there is simply back up for correlation, inappropriate extrapolation, circular reasoning, or pursuit of a piddling question (24). It is also common for authors to advise that ii variables are dissimilar considering the furnishings of one variable are statistically significant while the effects of the other variable are not, rather than directly comparing the ii variables (24). Authors sometimes oversee a confounding variable and practise not control for it, or forget to include important details on how their experiments were controlled or the concrete land of the organisms studied (24). Another mutual fault is the author's failure to define terms or use words with precision, as these practices can mislead readers (24). Jargon and/or misused terms can be a serious problem in papers. Inaccurate statements well-nigh specific citations are also a common occurrence (24). Additionally, many studies produce knowledge that can be applied to areas of science outside the scope of the original report, therefore it is ameliorate for reviewers to expect at the novelty of the idea, conclusions, information, and methodology, rather than scrutinize whether or not the newspaper answered the specific question at hand (24). Although information technology is important to recognize these points, when performing a review it is generally improve practice for the peer reviewer to not focus on a checklist of things that could be wrong, but rather advisedly identify the bug specific to each paper and continuously ask themselves if annihilation is missing (24). An extremely detailed description of how to deport peer review finer is presented in the paper How I Review an Original Scientific Article written past Frederic Grand. Hoppin, Jr. Information technology tin be accessed through the American Physiological Lodge website under the Peer Review Resource section.
CRITICISM OF PEER REVIEW
A major criticism of peer review is that there is little evidence that the process really works, that information technology is really an effective screen for skillful quality scientific work, and that it actually improves the quality of scientific literature. Equally a 2002 written report published in the Periodical of the American Medical Association ended, 'Editorial peer review, although widely used, is largely untested and its furnishings are uncertain' (25). Critics besides argue that peer review is not effective at detecting errors. Highlighting this point, an experiment by Godlee et al. published in the British Medical Journal (BMJ) inserted viii deliberate errors into a newspaper that was almost ready for publication, and and so sent the paper to 420 potential reviewers (7). Of the 420 reviewers that received the newspaper, 221 (53%) responded, the average number of errors spotted by reviewers was two, no reviewer spotted more than five errors, and 35 reviewers (16%) did not spot any.
Another criticism of peer review is that the process is not conducted thoroughly by scientific conferences with the goal of obtaining large numbers of submitted papers. Such conferences often have any newspaper sent in, regardless of its credibility or the prevalence of errors, considering the more than papers they have, the more money they tin make from author registration fees (26). This misconduct was exposed in 2014 by 3 MIT graduate students past the names of Jeremy Stribling, Dan Aguayo and Maxwell Krohn, who developed a simple estimator program chosen SCIgen that generates nonsense papers and presents them as scientific papers (26). Afterwards, a nonsense SCIgen newspaper submitted to a conference was promptly accepted. Nature recently reported that French researcher Cyril Labbé discovered that xvi SCIgen nonsense papers had been used by the High german academic publisher Springer (26). Over 100 nonsense papers generated by SCIgen were published by the US Institute of Electrical and Electronic Engineers (IEEE) (26). Both organisations have been working to remove the papers. Labbé developed a program to detect SCIgen papers and has fabricated it freely available to ensure publishers and conference organizers do non have nonsense work in the future. It is available at this link: http://scigendetect.on.imag.fr/main.php (26).
Additionally, peer review is frequently criticized for being unable to accurately find plagiarism. However, many believe that detecting plagiarism cannot practically exist included equally a component of peer review. As explained by Alice Tuff, development manager at Sense About Scientific discipline, 'The vast majority of authors and reviewers think peer review should discover plagiarism (81%) but but a minority (38%) think it is capable. The academic time involved in detecting plagiarism through peer review would crusade the system to grind to a halt' (27). Publishing house Elsevier began developing electronic plagiarism tools with the help of journal editors in 2009 to help improve this issue (27).
It has likewise been argued that peer review has lowered research quality past limiting inventiveness amid researchers. Proponents of this view claim that peer review has repressed scientists from pursuing innovative research ideas and bold research questions that have the potential to make major advances and image shifts in the field, as they believe that this work will probable be rejected by their peers upon review (28). Indeed, in some cases peer review may consequence in rejection of innovative enquiry, every bit some studies may not seem peculiarly strong initially, yet may be capable of yielding very interesting and useful developments when examined under dissimilar circumstances, or in the lite of new information (28). Scientists that do not believe in peer review argue that the process stifles the development of ingenious ideas, and thus the release of fresh noesis and new developments into the scientific customs.
Another issue that peer review is criticized for, is that there are a limited number of people that are competent to carry peer review compared to the vast number of papers that need reviewing. An enormous number of papers published (ane.three meg papers in 23,750 journals in 2006), but the number of competent peer reviewers available could non have reviewed them all (29). Thus, people who lack the required expertise to analyze the quality of a inquiry paper are conducting reviews, and weak papers are beingness accepted every bit a result. It is now possible to publish any newspaper in an obscure journal that claims to be peer-reviewed, though the paper or periodical itself could be substandard (29). On a like note, the US National Library of Medicine indexes 39 journals that specialize in alternative medicine, and though they all identify themselves equally "peer-reviewed", they rarely publish any loftier quality enquiry (29). This highlights the fact that peer review of more controversial or specialized work is typically performed past people who are interested and hold like views or opinions as the writer, which tin can crusade bias in their review. For instance, a paper on homeopathy is probable to be reviewed past fellow practicing homeopaths, and thus is likely to be accepted equally apparent, though other scientists may find the paper to be nonsense (29). In some cases, papers are initially published, but their credibility is challenged at a afterwards date and they are subsequently retracted. Retraction Watch is a website dedicated to revealing papers that accept been retracted afterwards publishing, potentially due to improper peer review (30).
Additionally, despite its many positive outcomes, peer review is also criticized for being a delay to the broadcasting of new knowledge into the scientific community, and equally an unpaid-action that takes scientists' time away from activities that they would otherwise prioritize, such as research and education, for which they are paid (31). As described by Eva Amsen, Outreach Manager for F1000Research, peer review was originally developed as a means of helping editors choose which papers to publish when journals had to limit the number of papers they could impress in i result (32). Notwithstanding, nowadays nigh journals are available online, either exclusively or in addition to print, and many journals take very limited printing runs (32). Since there are no longer page limits to journals, any practiced work can and should be published. Consequently, existence selective for the purpose of saving space in a journal is no longer a valid excuse that peer reviewers can use to reject a newspaper (32). Withal, some reviewers have used this excuse when they take personal ulterior motives, such every bit getting their ain research published first.
RECENT INITIATIVES TOWARDS IMPROVING PEER REVIEW
F1000Research was launched in Jan 2013 by Kinesthesia of thou as an open access periodical that immediately publishes papers (after an initial check to ensure that the paper is in fact produced by a scientist and has not been plagiarised), and then conducts transparent post-publication peer review (32). F1000Research aims to prevent delays in new science reaching the academic community that are caused past prolonged publication times (32). It too aims to brand peer reviewing more fair by eliminating whatever anonymity, which prevents reviewers from delaying the completion of a review then they can publish their own similar piece of work commencement (32). F1000Research offers completely open up peer review, where everything is published, including the proper noun of the reviewers, their review reports, and the editorial decision letters (32).
PeerJ was founded by Jason Hoyt and Peter Binfield in June 2012 equally an open access, peer reviewed scholarly journal for the Biological and Medical Sciences (33). PeerJ selects articles to publish based only on scientific and methodological soundness, not on subjective determinants of 'touch on', 'novelty' or 'interest' (34). Information technology works on a "lifetime publishing plan" model which charges scientists for publishing plans that give them lifetime rights to publish with PeerJ, rather than charging them per publication (34). PeerJ also encourages open up peer review, and authors are given the choice to post the total peer review history of their submission with their published article (34). PeerJ as well offers a pre-print review service called PeerJ Pre-prints, in which paper drafts are reviewed before being sent to PeerJ to publish (34).
Rubriq is an contained peer review service designed by Shashi Mudunuri and Keith Collier to amend the peer review system (35). Rubriq is intended to decrease redundancy in the peer review process and then that the time lost in redundant reviewing can be put back into research (35). According to Keith Collier, over 15 one thousand thousand hours are lost each twelvemonth to redundant peer review, as papers go rejected from ane journal and are after submitted to a less prestigious periodical where they are reviewed again (35). Authors often take to submit their manuscript to multiple journals, and are ofttimes rejected multiple times before they detect the right match. This process could take months or fifty-fifty years (35). Rubriq makes peer review portable in society to aid authors choose the journal that is best suited for their manuscript from the offset, thus reducing the time before their newspaper is published (35). Rubriq operates under an writer-pay model, in which the author pays a fee and their manuscript undergoes double-blind peer review by three expert academic reviewers using a standardized scorecard (35). The majority of the writer'south fee goes towards a reviewer honorarium (35). The papers are too screened for plagiarism using iThenticate (35). One time the manuscript has been reviewed by the three experts, the most appropriate journal for submission is determined based on the topic and quality of the paper (35). The paper is returned to the author in ane-ii weeks with the Rubriq Report (35). The writer can and then submit their newspaper to the suggested journal with the Rubriq Written report attached. The Rubriq Report will give the journal editors a much stronger incentive to consider the paper as it shows that 3 experts take recommended the paper to them (35). Rubriq also has its benefits for reviewers; the Rubriq scorecard gives structure to the peer review procedure, and thus makes information technology consistent and efficient, which decreases time and stress for the reviewer. Reviewers also receive feedback on their reviews and virtually significantly, they are compensated for their time (35). Journals also do good, every bit they receive pre-screened papers, reducing the number of papers sent to their own reviewers, which oftentimes end upwards rejected (35). This tin reduce reviewer fatigue, and allow just higher-quality articles to exist sent to their peer reviewers (35).
According to Eva Amsen, peer review and scientific publishing are moving in a new direction, in which all papers volition exist posted online, and a mail service-publication peer review will take identify that is independent of specific journal criteria and solely focused on improving paper quality (32). Journals will and so cull papers that they notice relevant based on the peer reviews and publish those papers every bit a collection (32). In this process, peer review and individual journals are uncoupled (32). In Keith Collier'southward stance, mail service-publication peer review is likely to go more prevalent equally a complement to pre-publication peer review, only not every bit a replacement (35). Post-publication peer review volition not serve to identify errors and fraud but will provide an boosted measurement of bear on (35). Collier also believes that as journals and publishers consolidate into larger systems, there will be stronger potential for "cascading" and shared peer review (35).
Final REMARKS
Peer review has become fundamental in assisting editors in selecting credible, high quality, novel and interesting research papers to publish in scientific journals and to ensure the correction of whatever errors or issues nowadays in submitted papers. Though the peer review process however has some flaws and deficiencies, a more suitable screening method for scientific papers has non yet been proposed or developed. Researchers take begun and must continue to look for means of addressing the current problems with peer review to ensure that information technology is a full-proof system that ensures only quality enquiry papers are released into the scientific community.
REFERENCES
iii. Spier R. (2002). "The History of the Peer-review Procedure." Trends Biotechnol, twenty(8): 357-358. [PubMed] [Google Scholar]
4. Liumbruno GM., Velati C., Pasaualetti P., Franchini M. (2012). "How to Write a Scientific Manuscript for Publica-tíon." Blood Transfus, 11(2): 217-226. [PMC free article] [PubMed] [Google Scholar]
7. Ware One thousand. (2008). "Peer Review: Benefits, Perceptions and Alternatives." Red china Summary Papers, 4:4-20. [Google Scholar]
8. Mulligan A. (2005). "Is Peer Review in Crunch?" Oral On-col. 41(ii): 135-141. [PubMed] [Google Scholar]
9. Simons-Morton B., Abraido-Lanza AF., Bernhardt JM., Schoenthaler A., Schnitzer A., Allegerante JP. (2012). "Demystifying Peer Review.", 39(1): iii-7. [PubMed] [Google Scholar]
17. Justice AC., Cho MK., Winker MA., Berlin JA., Rennie D. (1998)."Does Masking Writer Identity Ameliorate Peer Review Quality?" JAMA, 280(3):240-242. [PubMed] [Google Scholar]
18. McNutt RA, Evans AT., Fletcher RH., Fletcher SW. (1990). "The Effects of Blinding on the Quality of Peer Review." JAMA, 263(10):1371-1376. [PubMed] [Google Scholar]
19. Kumar Chiliad. (2009). "A Review of the Review Process: Manuscript Peer-review in Biomedical Enquiry." Biology and Medicine, 1(4): ane-16. [Google Scholar]
20. Falagas ME. (2007). "Peer Review in Open Admission Scientific Journals." Open Medicine, ane(1): 49-51. [PMC complimentary commodity] [PubMed] [Google Scholar]
21. Bohannon J. (2013). "Who's Afraid of Peer Review?" Science, 342(6154):lx-65. [PubMed] [Google Scholar]
23. Nichols NL, Sasser JM. (2014). "The Other Side of the Submit Button: How to Become a Reviewer for Scientific Journals." The Physiologist, 57(2): 88-91. [PubMed] [Google Scholar]
24. Hoppin FG., Jr. (2002). "How I Review an Original Scientific Article." Am J Respir Crit Intendance Med, 166(eight): 1019-1023. [PubMed] [Google Scholar]
25. Jefferson T, Alderson P, Wager Due east, Davidoff F. (2002). "Effects of Editorial Peer Review: A Systematic Review." JAMA, 287(21): 2784-2786. [PubMed] [Google Scholar]
Manufactures from EJIFCC are provided hither courtesy of International Federation of Clinical Chemical science and Laboratory Medicine
macphersonmakeekly.blogspot.com
Source: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4975196/#:~:text=Peer%20review%20has%20become%20the,that%20will%20advance%20the%20field.
0 Response to "Why Is Peer Review Important When Publishing Experimental Results"
Post a Comment