- Open Access
- Open Peer Review
Authors' opinions on publication in relation to annual performance assessment
BMC Medical Education volume 10, Article number: 21 (2010)
In the past 50 years there has been a substantial increase in the volume of published research and in the number of authors per scientific publication. There is also significant pressure exerted on researchers to produce publications. Thus, the purpose of this study was to survey corresponding authors in published medical journals to determine their opinion on publication impact in relation to performance review and promotion.
Cross-sectional survey of corresponding authors of original research articles published in June 2007 among 72 medical journals. Measurement outcomes included the number of publications, number of authors, authorship order and journal impact factor in relation to performance review and promotion.
Of 687 surveys, 478 were analyzed (response rate 69.6%). Corresponding authors self-reported that number of publications (78.7%), journal impact factor (67.8%) and being the first author (75.9%) were most influential for their annual performance review and assessment. Only 17.6% of authors reported that the number of authors on a manuscript was important criteria for performance review and assessment. A higher percentage of Asian authors reported that the number of authors was key to performance review and promotion (41.4% versus 7.8 to 22.2%). compared to authors from other countries.
The number of publications, authorship order and journal impact factor were important factors for performance reviews and promotion at academic and non-academic institutes. The number of authors was not identified as important criteria. These factors may be contributing to the increase in the number of authors per publication.
In the past fifty years there has been a substantial increase in the volume of published research. The number of papers cited by Pub Med each year has also grown linearly, to a current total exceeding 18 million . The increase in publications has been accompanied by an increase in the number of authors per scientific publication [2–5]. In fact the average number of authors in major medical journals has increased from 4.5 in 1980 to 6.9 in 2000, and single authored articles have diminished [5, 6]. For example, in January 2009 a manuscript was published with almost 3000 authors [7, 8]. This increase has resulted in carefully defined criteria to be established by journal editors to define authorship requirements, with limitations on the number of authors established by some medical journals [3, 5].
Researchers have implicated the increased complexity of research (including technological advances) and the increase in multi-center and multidisciplinary research collaborations to the growth in the number of authors per manuscript. However, it can be argued that other factors have a stronger impact on this so-called "author inflation". These factors include professional and social advancement (promotion), tenure, prestige, funding, and honorary authorships. Promotion and tenure committees use different procedures, criterion, and weight to evaluate researchers within faculties and across institutions; both academic and non-academic. Some institutions may reward publications, particularly for publication in "high impact journals" . Therefore, there is significant pressure exerted on researchers to produce publications in top journals . The journal impact factor is frequently used as a proxy for the importance of a journal in its particular field .
We surveyed corresponding authors in published medical journals to determine their opinion on aspects of publication (authorship order, number and journal impact factor) in relation to performance review and promotion.
Identifying Journals, Annals and Articles
We identified potential authors to survey through the following steps. A listing of medical journal names, classified by medical field, were initially extracted from the Journal Citation Report (JCR) of 2006 , which were classified according to medical field. The JCR offers a systematic, objective mean to critically evaluate journals in over 7600 scholarly and technical journals, from more than 3300 publishers in over 60 countries. Specifically we extracted journal names that were indexed as 'medicine general and internal' and medically related annals. From that list we included all articles published in June 2007 (month chosen for article extraction) which were online at the time of the literature search in August 2007 (see Appendix 1). Articles were then selected if they were published in English in June 2007, included corresponding author information, and were original research studies.
The following data was extracted from each article identified: research design (randomized controlled trial (RCT) or non-RCT), research field (bio-medical or non-biomedical), number of authors listed, position of corresponding author on manuscript (first, last, middle), as well as corresponding author's name, country of residence and email address.
Each corresponding author was sent a survey via email. After three weeks a reminder email was sent to non-respondents, with a final reminder email sent to non-respondents two months later. The survey included questions regarding authorship order, decision of authorship position on the manuscript (first, last, middle author) and author affiliation (position at institution). The survey also included questions regarding whether the number of publications, number of authors, authorship order and journal impact factor contributed towards their performance review and promotion at their institution.
Surveys with missing responses were excluded from the analysis. Statistical analyses were performed using Stata Verson 10 (Stata, College Station TX). To address the purpose of this study the data analysis was primarily descriptive.
The study was approved by the Conjoint Health Research Ethics Board, University of Calgary.
We identified 687 original research articles published in June 2007 from 72 journals which met our eligibility criteria. Of 687 surveys, 494 (71.9%) were returned. After excluding those with missing data (n = 16), 478 surveys were available for the analysis, for a final response rate of 69.6% (Figure 1). The response rate was slightly higher for first authors (72.4%) compared to last (63.7%) and middle authors (65.2%).
The characteristics of articles and corresponding authors are shown in Table 1. The majority of the research articles were non randomized controlled trials (93.5%), with 56.7% of articles bio-medical or laboratory based studies. Eighty-percent of articles were published in a journal with an impact factor less than 6. The average number of authors listed per manuscript was 6; five articles had one author listed. Among articles with a journal impact factor of ≥ 10, 60% (n = 18) had more than 10 authors listed on the manuscript. The majority of corresponding authors were from Europe (38.7%), North America (35.0%), and Asia (20.7%) and held an academic position within their institution (68.8%).
Authors self-reported that the number of publications (78.7%), the journal impact factor (67.8%) and being the first author (75.9%) were most influential for their annual performance review and assessment (Table 2). Only 17.6% of authors reported that the number of authors on a manuscript was an important criterion for performance review and assessment. Even when we stratified the variables by corresponding author characteristics, the results remained similar (Table 3). Compared to other authors a higher percentage of Asian authors reported that the number of authors was key to performance review and promotion (41.4% versus 7.8% to 22.2%).
Corresponding authors were asked when the initial decision was made regarding the authorship order for the manuscript. Fifty eight percent reported it was decided prior to writing the manuscript, 28.9% during writing of the manuscript, and 12.0% after the manuscript was written. Only 12.0% of authors reported that the authorship order changed after the initial authorship order decision was made.
Of the surveys, 26.4% of authors believed that the number of authors on a manuscript should be limited by a journal. Among those authors, the average limit they suggested was 6.
We conducted a survey among corresponding authors to assess their opinions of publication impact in relation to performance review and promotion. Overall we found that most respondents considered the journal impact factor, number of publications, and authorship order important to their performance review and promotion. The number of authors on a paper did not seem to affect performance review and promotion except among Asian authors.
In general, performance reviews are challenging. Promotion and tenure committees attempt to include objective criteria, yet most use varying procedures, criterion, and weighting schemes to evaluate researchers for promotion and tenure . The absolute number of publications and authorship order are only a few variables that institutions may use in performance review and promotion. Some institutions also evaluate the journal, enhancing the desire for researchers to publish in top journals. Our study results show that the journal impact factor is important to author's performance review and promotion. This was true regardless of the corresponding author's position at their institution or on the manuscript, and country of residence. Interestingly even non-academic authors reported that it was an important aspect of their evaluation.
There is pressure on researchers to publish due to evaluation procedures, and the desire for prestige, employment and tenure . Coinciding with this pressure, we found that the number of publications is important to performance review and promotion. Could this pressure be responsible for the large number of manuscripts being published? It has been suggested that this pressure may contribute to authorship misconduct, such as "undeserved authorship" and "honorary authorship" [3, 4, 12]. This has resulted in some journal editors requiring a written rationale regarding authorship and a published explanation of each author's contribution .
Journal editors have also discussed the possibility of limiting the number of authors on a manuscript to try and reduce authorship misconduct . Guidelines produced by the International Committee of Medical Journal Editors and the American Psychological Association have suggested that authorship should be limited to those who have substantially contributed to the manuscript [7, 15]. In our study only a small proportion of authors felt that medical journals should limit the number of authors on published manuscripts. Perhaps this is because researchers want to take advantage of every opportunity to publish due to the publication pressure placed on them by institutions. Other reasons may include researchers wanting to include senior authors on manuscripts to give them more "power" and creditability . Additionally, there has been an increase in group authorship and researchers may want their names to be listed on manuscripts as many institutions do not recognize these as individual research contributions in performance review and promotion .
There are few organizations  with specific authorship guidelines regarding author order and a suggested time period for when this should be decided. In our study we found that the majority of authors established authorship order prior to writing the manuscript. Although some journals require authorship to be alphabetical, the Journal of American Statistical Association suggests that authorship order should be determined by the magnitude of intellectual contribution to the project, rather than by status, seniority or power within the group .
Some universities only merit first or corresponding authors in annual performance review and promotion. Other universities recognized second or third authors; however being first or corresponding author has the most recognition and financial compensation . In fact some Asian countries, such as China and Japan, give incentives for first and corresponding authors and for publications in high impact factors journals. However, this type of recognition may limit research collaboration. This is consistent with the results from our study in which only Asian authors reported that the number of authors on a manuscript was important to their performance review and promotion whereas in other continents this was not as significant.
Our study has limitations. First, we only surveyed corresponding authors and not those responsible for implementing performance reviews and promotion (for example department heads). The authors surveyed however should be aware and able to accurately report the criteria used by their institutions for performance reviews and promotion. Second, we surveyed authors from medical-related journals that were published in English, thus our finding may not be generalizeable to other disciples such as mathematics and physics. In addition we only surveyed authors with published articles, thus we do not know the opinions of non-published authors. Finally, there was a 30.4% non-response rate; we have no way of assessing if the opinions of these authors are consistent with those of the respondents.
In summary we found that corresponding authors published in English language medical journals considered the number of publications, authorship order and journal impact factor to be important factors for their performance reviews and promotion. The number of authors on a publication was not identified as important criteria. These factors may be contributing to the increase in the number of authors per publication, and the so-called author inflation.
Appendix 1: Journal Included in the Survey
Am Fam Physician
Am J Chinese Med
Am J Manag Care
Am J Med
Am J Med Sci
Am J Prev Med
Arch Intern Med
Aviat Space Envir Md
Brit Med J
Can Fam Physician
Can Med Assoc J
Chinese Med J-Peking
Croat Med J
Curr Med Res Opin
Indian J Med Res
Intern Med J
Irish J Med Sci
Israel Med Assoc J
J Eval Clin Pract
J Korean Med Sci
J Lab Clin Med
J Natl Med Assoc
J Pain Symptom Manag
J R Soc Med
J Travel Med
J Womens Health
J Am Med Assoc
Journal of Cutaneous Pathology
Mayo Clin Proc
Med J Australia
Med Prin Pract
Neth J Med
New Engl J M
Postgrad Med J
Qjm-Int J Med
Rev Med Chile
Rev Med Interne
Saudi Med J
South Med J
Swiss Med Wkly
Tohoku J Exp Med
Upsala J Med Sci
Wien Klin Wochenschr
Yonsei Med J
Ann Acad Med Singap
Ann Allerg Asthma Im
Ann Emerg Med
Ann Endocrinol Paris
Ann Fam Med
Ann Intern Med
Ann Plas Surg
Ann Rheum Dis
Ann Surg Oncol
Ann Thorac Surg
Ann Trop Paediatr
PubMed: National Library of Medicine. 2009
Paneth N: Separating Authorship Responsibility and Authorship Credit: a Proposal for Biomedical Journals. Am J Public Health. 1998, 88: 824-826. 10.2105/AJPH.88.5.824.
Grieger MCA: Authorship: an Ethical Dilemma of Science. Sao Paulo Med J. 2005, 123: 242-246. 10.1590/S1516-31802005000500008.
Drenth JPH: Multiple authorship the contribution of senior authors. J Am Med Assoc. 1998, 280: 219-221. 10.1001/jama.280.3.219.
Weeks WB, Wallace AE, Kimberly BCS: Changes in authorship patterns in prestigious US medical journals. Soc Sci Med. 2004, 59: 1949-1954. 10.1016/j.socscimed.2004.02.029.
Drenth JP: Proliferation of authors on research reports in medicine. Sci Eng Ethics. 1996, 2: 469-480. 10.1007/BF02583933.
Claxton LD: Scientific authorship: Part 2. History, recurring issues, practices, and guidelines. Mutation Research/Reviews in Mutation Research. 2005, 589: 31-45. 10.1016/j.mrrev.2004.07.002.
Parker A: The Large Hadron Collider: entering uncharted territory. 2009, University of Cambridge
Nederhof AJ: Policy impact of bibliometric rankings of research performance of departments and individuals in economics. Scientometrics. 2008, 74: 163-174. 10.1007/s11192-008-0109-0.
Garfield E: The history and meaning of the journal impact factor. J Am Med Assoc. 2006, 295: 90-93. 10.1001/jama.295.1.90.
ISI Web of Knowledge: Medicine, General & Internal. Journal Citation Reports. 2006
Levsky ME, Rosin A, Coon TP, Enslow WL, Miller MA: A Descriptive Analysis of Authorship Within Medical Journals, 1995-2005. Southern Med J. 2007, 100: 371.
Marusic M, Bozikov J, Katavic V, Hren D, Kljakovic-Gaspic M, Marusic A: Authorship in a Small Medical Journal: a Study of Contributorship Statements by Corresponding Authors. Sci Eng Ethics. 2004, 10: 493-502. 10.1007/s11948-004-0007-7.
Jones AH: Can authorship policies help prevent scientific misconduct? What role for scientific societies?. Sci Eng Ethics. 2003, 9: 243-256. 10.1007/s11948-003-0011-3.
Osborne JW, Holland A: What is authorship, and what should it be? A survey of prominent guidelines for determining authorship in scientific publications. Practical Assessment, Research & Evaluation. 2009, 14: 1-19.
Drenth JP: Multiple authorship: the contribution of senior authors. JAMA. 1998, 280: 219-221. 10.1001/jama.280.3.219.
Peffers K, Hui W: Collaboration and author order: Changing patterns in IS research. Communications of the AIS. 2003, 11: 166-190.
The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1472-6920/10/21/prepub
The authors thank Samuel Quan for his assistance in data collection. There was no source of funding for this study/analysis.
The authors declare that they have no competing interests.
RW participated in the conception and design, analysis and interpretation of data, drafting the manuscript, and statistical analysis. LS participated in the conception and design, acquisition of data, drafting of the manuscript, and administrative and technical support. BH participated in the conception and design, analysis and interpretation of data, critical revision of the manuscript for important intellectual content, and supervision. HQ participated in the conception and design, analysis and interpretation of data, critical revision of the manuscript for important intellectual content, and supervision. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Walker, R.L., Sykes, L., Hemmelgarn, B.R. et al. Authors' opinions on publication in relation to annual performance assessment. BMC Med Educ 10, 21 (2010) doi:10.1186/1472-6920-10-21
- Journal Editor
- Journal Citation Report
- Journal Impact Factor
- Original Research Article
- Performance Review