Comprehensive Researcher Achievement Model (CRAM): a framework for measuring researcher achievement, impact and influence derived from a systematic literature review of metrics and models.
Comprehensive Researcher Achievement Model (CRAM)
citations
h-index
journal impact factor
outputs
research metrics
researcher assessment
Journal
BMJ open
ISSN: 2044-6055
Titre abrégé: BMJ Open
Pays: England
ID NLM: 101552874
Informations de publication
Date de publication:
30 03 2019
30 03 2019
Historique:
entrez:
1
4
2019
pubmed:
1
4
2019
medline:
24
3
2020
Statut:
epublish
Résumé
Effective researcher assessment is key to decisions about funding allocations, promotion and tenure. We aimed to identify what is known about methods for assessing researcher achievements, leading to a new composite assessment model. We systematically reviewed the literature via the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols framework. All Web of Science databases (including Core Collection, MEDLINE and BIOSIS Citation Index) to the end of 2017. ELIGIBILITY CRITERIA: (1) English language, (2) published in the last 10 years (2007-2017), (3) full text was available and (4) the article discussed an approach to the assessment of an individual researcher's achievements. Articles were allocated among four pairs of reviewers for screening, with each pair randomly assigned 5% of their allocation to review concurrently against inclusion criteria. Inter-rater reliability was assessed using Cohen's Kappa (ĸ). The ĸ statistic showed agreement ranging from moderate to almost perfect (0.4848-0.9039). Following screening, selected articles underwent full-text review and bias was assessed. Four hundred and seventy-eight articles were included in the final review. Established approaches developed prior to our inclusion period (eg, citations and outputs, h-index and journal impact factor) remained dominant in the literature and in practice. New bibliometric methods and models emerged in the last 10 years including: measures based on PageRank algorithms or 'altmetric' data, methods to apply peer judgement and techniques to assign values to publication quantity and quality. Each assessment method tended to prioritise certain aspects of achievement over others. All metrics and models focus on an element or elements at the expense of others. A new composite design, the Comprehensive Researcher Achievement Model (CRAM), is presented, which supersedes past anachronistic models. The CRAM is modifiable to a range of applications.
Identifiants
pubmed: 30928941
pii: bmjopen-2018-025320
doi: 10.1136/bmjopen-2018-025320
pmc: PMC6475357
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Systematic Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
e025320Informations de copyright
© Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.
Déclaration de conflit d'intérêts
Competing interests: None declared.
Références
Scientometrics. 2011 Jul;88(1):91-106
pubmed: 21765564
PLoS Biol. 2009 Nov;7(11):e1000242
pubmed: 19918558
World Neurosurg. 2013 Nov;80(5):e85-90
pubmed: 22381859
Radiology. 2010 May;255(2):342-51
pubmed: 20413749
BMJ Open. 2017 Nov 8;7(11):e017708
pubmed: 29122796
PLoS Biol. 2014 Nov 25;12(11):e1002003
pubmed: 25423184
Nature. 2010 Dec 23;468(7327):1011
pubmed: 21179138
J Med Internet Res. 2011 Dec 19;13(4):e123
pubmed: 22173204
Nature. 2017 Apr 26;544(7651):394
pubmed: 28447650
PLoS Biol. 2013 Oct;11(10):e1001675
pubmed: 24115908
BMJ Open. 2016 Feb 08;6(2):e009889
pubmed: 26857105
Retrovirology. 2008 Nov 25;5:106
pubmed: 19032780
J Korean Med Sci. 2017 Feb;32(2):173-179
pubmed: 28049225
PLoS One. 2014 Dec 26;9(12):e115962
pubmed: 25542026
J Vet Cardiol. 2015 Jun;17(2):77-82
pubmed: 26007711
Anaesth Crit Care Pain Med. 2017 Dec;36(6):347-348
pubmed: 28694228
Sci Rep. 2013;3:1649
pubmed: 23575957
Nurse Educ Today. 2012 Oct;32(7):744-6
pubmed: 22748192
Qual Health Res. 2002 Nov;12(9):1284-99
pubmed: 12448672
Arq Bras Cardiol. 2011 Jul;97(1):88; author reply 88-9
pubmed: 21894399
Clin Spine Surg. 2017 Jun;30(5):226-228
pubmed: 28338492
BMJ. 2015 Jan 02;350:g7647
pubmed: 25555855
Clin Res Hepatol Gastroenterol. 2011 May;35(5):336-7
pubmed: 21621176
PLoS One. 2017 Mar 9;12(3):e0173152
pubmed: 28278243
World Neurosurg. 2013 Dec;80(6):787-8
pubmed: 24103549
Circ Res. 2016 Dec 9;119(12):1273-1275
pubmed: 27932470
Acad Med. 2009 Nov;84(11):1610-6
pubmed: 19858825
Proc Natl Acad Sci U S A. 2005 Nov 15;102(46):16569-72
pubmed: 16275915
J Gen Physiol. 2013 Sep;142(3):175
pubmed: 23980189
PLoS One. 2017 Mar 28;12(3):e0174205
pubmed: 28350849
Plast Reconstr Surg. 2015 Sep;136(3):622-3
pubmed: 26313831
Asian J Androl. 2016 Mar-Apr;18(2):296-309
pubmed: 26806079
Bioessays. 2010 Sep;32(9):744-7
pubmed: 20652896
Clin Exp Optom. 2011 Nov;94(6):600-5
pubmed: 21943182
Proc Natl Acad Sci U S A. 2013 Jun 11;110(24):9680-5
pubmed: 23720314
Nature. 2015 Apr 23;520(7548):429-31
pubmed: 25903611
Evid Based Ment Health. 2017 May;20(2):33-34
pubmed: 28385690
Crit Care Med. 2016 Dec;44(12):2293-2296
pubmed: 27858820
PLoS One. 2012;7(11):e46428
pubmed: 23144782
J Contemp Dent Pract. 2014 Mar 01;15(2):258-62
pubmed: 25095854
J Pediatr Surg. 2017 Jul;52(7):1079-1083
pubmed: 28017413
Account Res. 2016;23(4):230-44
pubmed: 26636372
Aesthet Surg J. 2014 Sep;34(7):1123-6
pubmed: 25024453
Eplasty. 2015 Nov 18;15:e50
pubmed: 26664673
Eval Health Prof. 2016 Mar;39(1):49-64
pubmed: 25015081
Sci Transl Med. 2011 May 25;3(84):84cm13
pubmed: 21613620
PLoS One. 2013 Apr 24;8(4):e62395
pubmed: 23638064
Res Q Exerc Sport. 2014 Dec;85(4):429-30
pubmed: 25412123
Science. 2015 Jan 9;347(6218):139-40
pubmed: 25574014
Nature. 2010 Jun 17;465(7300):864-6
pubmed: 20559362
Mol Biol Cell. 2017 Jun 1;28(11):1401-1408
pubmed: 28559438
Chirurgia (Bucur). 2017 Mar-Apr;112(2):117-123
pubmed: 28463679
PLoS One. 2013;8(3):e58727
pubmed: 23516542
J Vet Intern Med. 2017 May;31(3):629-632
pubmed: 28493532
PLoS One. 2013 Dec 31;8(12):e84334
pubmed: 24391941
Scientometrics. 2017 Jan;110(1):521-528
pubmed: 29795961
Front Comput Neurosci. 2011 Nov 10;5:48
pubmed: 22102840
PLoS One. 2015 Nov 16;10(11):e0143108
pubmed: 26571133
Med Intensiva. 2013 Jun-Jul;37(5):343-54
pubmed: 23517697
J Med Libr Assoc. 2015 Oct;103(4):219-21
pubmed: 26512227
BMC Public Health. 2011 Jul 25;11:588
pubmed: 21787432
PLoS One. 2016 Sep 08;11(9):e0162364
pubmed: 27606817
J Parkinsons Dis. 2011;1(1):3-13
pubmed: 23939254
Am Psychol. 2008 Apr;63(3):160-8
pubmed: 18377106
Ann Emerg Med. 2015 Nov;66(5):549-53
pubmed: 26004769
PLoS One. 2016 May 19;11(5):e0155732
pubmed: 27195701
J Pediatr. 2016 Feb;169:272-6
pubmed: 26563533
J Neurosurg. 2015 Sep;123(3):543-4
pubmed: 26115465
PLoS One. 2011;6(11):e27537
pubmed: 22110667
Science. 2013 Oct 4;342(6154):127-32
pubmed: 24092745
Acad Radiol. 2012 May;19(5):632-4
pubmed: 22463962
Am J Pharm Educ. 2013 Oct 14;77(8):167
pubmed: 24159208
Acad Med. 2016 Aug;91(8):1074-9
pubmed: 27276002
PLoS Biol. 2016 Jul 01;14(7):e1002501
pubmed: 27367269
BMJ Open. 2016 Feb 17;6(2):e008681
pubmed: 26888726
Acad Med. 2017 Oct;92(10):1449-1455
pubmed: 28817430
PLoS One. 2016 Sep 14;11(9):e0161755
pubmed: 27627767
Radiographics. 2014 Jan-Feb;34(1):116-8
pubmed: 24428285
Biometrics. 1977 Mar;33(1):159-74
pubmed: 843571
J Korean Med Sci. 2017 Feb;32(2):180-182
pubmed: 28049226
Am Psychol. 2010 Oct;65(7):660-73
pubmed: 20873883
Nature. 2016 Jul 08;535(7611):210-1
pubmed: 27411614
J Med Libr Assoc. 2015 Jan;103(1):49-54
pubmed: 25552946
Acad Med. 2015 Jan;90(1):69-75
pubmed: 25140529
Indian J Pharmacol. 2015 Sep-Oct;47(5):570-1
pubmed: 26600654
PeerJ. 2013 Oct 22;1:e183
pubmed: 24167778