Building less-flawed metrics: Understanding and creating better measurement and incentive systems.
Journal
Patterns (New York, N.Y.)
ISSN: 2666-3899
Titre abrégé: Patterns (N Y)
Pays: United States
ID NLM: 101767765
Informations de publication
Date de publication:
13 Oct 2023
13 Oct 2023
Historique:
medline:
25
10
2023
pubmed:
25
10
2023
entrez:
25
10
2023
Statut:
epublish
Résumé
Metrics are useful for measuring systems and motivating behaviors in academia as well as in public policy, medicine, business, and other systems. Unfortunately, naive application of metrics to a system can distort the system and even undermine the original goal. There are two interrelated problems to overcome in building better metrics in academia and elsewhere. The first, specifying evaluable metrics that correspond to the goals, is well recognized but still often ignored. The second, minimizing perverse effects that undermine the metric or that enable people to game the rewards, is less recognized but is critical. This perspective discusses designing metrics, beginning with design considerations and processes; the presentation of specific strategies for mitigating perverse impacts, including secrecy, randomization, diversification, and post hoc specification; and continuing with important
Identifiants
pubmed: 37876897
doi: 10.1016/j.patter.2023.100842
pii: S2666-3899(23)00221-0
pmc: PMC10591122
doi:
Types de publication
Journal Article
Review
Langues
eng
Pagination
100842Informations de copyright
© 2023 The Author(s).
Déclaration de conflit d'intérêts
The authors declare no competing interests.
Références
J Am Geriatr Soc. 2003 Feb;51(2):213-21
pubmed: 12558718
Proc Natl Acad Sci U S A. 2005 Nov 15;102(46):16569-72
pubmed: 16275915
Psychol Rev. 1956 Mar;63(2):129-38
pubmed: 13310708
Harv Bus Rev. 2003 Jan;81(1):87-96
pubmed: 12545925
Public Health Pract (Oxf). 2021 Nov;2:100208
pubmed: 34729542
Psychol Rev. 2004 Oct;111(4):1061-71
pubmed: 15482073
Nutr Rev. 1990 Oct;48(10):373-9
pubmed: 2082216
Patterns (N Y). 2022 May 13;3(5):100476
pubmed: 35607624
Med Probl Perform Art. 2015 Mar;30(1):20-5
pubmed: 25743602