Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review.
Apple Watch
Fitbit
Garmin
Polar
commercial wearable devices
energy expenditure
heart rate
step count
systematic review
Journal
JMIR mHealth and uHealth
ISSN: 2291-5222
Titre abrégé: JMIR Mhealth Uhealth
Pays: Canada
ID NLM: 101624439
Informations de publication
Date de publication:
08 09 2020
08 09 2020
Historique:
received:
30
03
2020
accepted:
25
06
2020
revised:
22
06
2020
entrez:
8
9
2020
pubmed:
9
9
2020
medline:
16
3
2021
Statut:
epublish
Résumé
Consumer-wearable activity trackers are small electronic devices that record fitness and health-related measures. The purpose of this systematic review was to examine the validity and reliability of commercial wearables in measuring step count, heart rate, and energy expenditure. We identified devices to be included in the review. Database searches were conducted in PubMed, Embase, and SPORTDiscus, and only articles published in the English language up to May 2019 were considered. Studies were excluded if they did not identify the device used and if they did not examine the validity or reliability of the device. Studies involving the general population and all special populations were included. We operationalized validity as criterion validity (as compared with other measures) and construct validity (degree to which the device is measuring what it claims). Reliability measures focused on intradevice and interdevice reliability. We included 158 publications examining nine different commercial wearable device brands. Fitbit was by far the most studied brand. In laboratory-based settings, Fitbit, Apple Watch, and Samsung appeared to measure steps accurately. Heart rate measurement was more variable, with Apple Watch and Garmin being the most accurate and Fitbit tending toward underestimation. For energy expenditure, no brand was accurate. We also examined validity between devices within a specific brand. Commercial wearable devices are accurate for measuring steps and heart rate in laboratory-based settings, but this varies by the manufacturer and device type. Devices are constantly being upgraded and redesigned to new models, suggesting the need for more current reviews and research.
Sections du résumé
BACKGROUND
Consumer-wearable activity trackers are small electronic devices that record fitness and health-related measures.
OBJECTIVE
The purpose of this systematic review was to examine the validity and reliability of commercial wearables in measuring step count, heart rate, and energy expenditure.
METHODS
We identified devices to be included in the review. Database searches were conducted in PubMed, Embase, and SPORTDiscus, and only articles published in the English language up to May 2019 were considered. Studies were excluded if they did not identify the device used and if they did not examine the validity or reliability of the device. Studies involving the general population and all special populations were included. We operationalized validity as criterion validity (as compared with other measures) and construct validity (degree to which the device is measuring what it claims). Reliability measures focused on intradevice and interdevice reliability.
RESULTS
We included 158 publications examining nine different commercial wearable device brands. Fitbit was by far the most studied brand. In laboratory-based settings, Fitbit, Apple Watch, and Samsung appeared to measure steps accurately. Heart rate measurement was more variable, with Apple Watch and Garmin being the most accurate and Fitbit tending toward underestimation. For energy expenditure, no brand was accurate. We also examined validity between devices within a specific brand.
CONCLUSIONS
Commercial wearable devices are accurate for measuring steps and heart rate in laboratory-based settings, but this varies by the manufacturer and device type. Devices are constantly being upgraded and redesigned to new models, suggesting the need for more current reviews and research.
Identifiants
pubmed: 32897239
pii: v8i9e18694
doi: 10.2196/18694
pmc: PMC7509623
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Systematic Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
e18694Informations de copyright
©Daniel Fuller, Emily Colwell, Jonathan Low, Kassia Orychock, Melissa Ann Tobin, Bo Simango, Richard Buote, Desiree Van Heerden, Hui Luan, Kimberley Cullen, Logan Slade, Nathan G A Taylor. Originally published in JMIR mHealth and uHealth (http://mhealth.jmir.org), 08.09.2020.
Références
PLoS One. 2018 Jan 2;13(1):e0189298
pubmed: 29293532
JMIR Mhealth Uhealth. 2017 Jun 28;5(6):e88
pubmed: 28659255
JMIR Mhealth Uhealth. 2018 Apr 02;6(4):e70
pubmed: 29610110
Sensors (Basel). 2017 Jan 22;17(1):
pubmed: 28117736
PLoS One. 2019 May 21;14(5):e0216891
pubmed: 31112585
BMC Public Health. 2018 Jul 11;18(1):858
pubmed: 29996797
Res Gerontol Nurs. 2015 Sep-Oct;8(5):213-9
pubmed: 25942386
JAMA. 2015 Feb 10;313(6):625-6
pubmed: 25668268
Int J Cardiol. 2018 Sep 1;266:124-127
pubmed: 29887428
J Med Eng Technol. 2018 May;42(4):259-264
pubmed: 30198806
J Med Internet Res. 2016 Sep 20;18(9):e253
pubmed: 27651304
J Neurol. 2017 Feb;264(2):316-326
pubmed: 27896433
J Sports Sci. 2019 Feb;37(3):244-248
pubmed: 29958058
Mult Scler J Exp Transl Clin. 2016 Mar 4;2:2055217316634754
pubmed: 28607720
JMIR Mhealth Uhealth. 2017 Oct 20;5(10):e157
pubmed: 29055881
Telemed J E Health. 2016 May;22(5):441-9
pubmed: 26451900
JMIR Mhealth Uhealth. 2018 Apr 12;6(4):e94
pubmed: 29650506
Dev Med Child Neurol. 2019 Nov;61(11):1309-1313
pubmed: 30883727
Med Sci Sports Exerc. 2016 Jan;48(1):151-8
pubmed: 26154336
Health Inf Sci Syst. 2015 Feb 24;3(Suppl 1 HISA Big Data in Biomedicine and Healthcare 2013 Con):S1
pubmed: 26019809
JMIR Mhealth Uhealth. 2017 Mar 16;5(3):e34
pubmed: 28302596
PLoS One. 2016 Jun 15;11(6):e0157229
pubmed: 27305105
J Strength Cond Res. 2017 Apr;31(4):1097-1106
pubmed: 27465631
Stroke. 2017 Sep;48(9):2614-2617
pubmed: 28784922
BMJ Open. 2017 Mar 31;7(3):e011742
pubmed: 28363918
PLoS One. 2016 May 27;11(5):e0154420
pubmed: 27232714
Telemed J E Health. 2018 Sep;24(9):669-677
pubmed: 29303680
BMC Res Notes. 2016 Sep 21;9(1):448
pubmed: 27655477
JMIR Mhealth Uhealth. 2018 Aug 09;6(8):e10527
pubmed: 30093371
J Sports Sci. 2015;33(10):991-1000
pubmed: 25517396
JMIR Cardio. 2018 Jan 04;2(1):e1
pubmed: 31758760
BMJ Open Sport Exerc Med. 2017 Sep 13;3(1):e000254
pubmed: 29018543
J Med Internet Res. 2016 Sep 07;18(9):e239
pubmed: 27604226
J Sci Med Sport. 2014 Sep;17(5):496-500
pubmed: 24268570
Disabil Rehabil. 2020 Mar;42(6):863-868
pubmed: 30326754
JMIR Mhealth Uhealth. 2019 Mar 19;7(3):e11889
pubmed: 30888332
Can J Cardiol. 2017 Jun;33(6):799-805
pubmed: 28347581
Ann Transl Med. 2016 Aug;4(15):278
pubmed: 27570772
Adapt Phys Activ Q. 2017 Apr;34(2):195-200
pubmed: 28556761
PLoS One. 2015 Mar 19;10(3):e0118723
pubmed: 25789630
Am J Health Promot. 2018 Nov;32(8):1671-1678
pubmed: 29558811
PLoS One. 2017 Feb 24;12(2):e0171720
pubmed: 28234979
Am J Health Behav. 2019 May 1;43(3):498-505
pubmed: 31046881
PM R. 2019 Sep;11(9):963-971
pubmed: 30688026
JMIR Mhealth Uhealth. 2017 Aug 11;5(8):e106
pubmed: 28801304
Gait Posture. 2018 Jan;59:177-181
pubmed: 29049964
J Clin Epidemiol. 2016 Jul;75:40-6
pubmed: 27005575
J Med Eng Technol. 2018 May;42(4):265-273
pubmed: 29911930
Physiother Theory Pract. 2017 Oct;33(10):788-796
pubmed: 28777710
J Sports Sci. 2019 Apr;37(8):895-901
pubmed: 30326780
J Med Internet Res. 2016 Oct 06;18(10):e268
pubmed: 27713114
J Med Syst. 2019 May 22;43(7):195
pubmed: 31119387
Physiother Can. 2018;70(1):81-89
pubmed: 29434422
PLoS One. 2019 Jan 30;14(1):e0211231
pubmed: 30699159
Eur J Sport Sci. 2017 Apr;17(3):360-368
pubmed: 27912681
Phys Ther. 2018 Aug 1;98(8):705-714
pubmed: 29718452
Gait Posture. 2018 Mar;61:339-345
pubmed: 29427859
BMJ Open Sport Exerc Med. 2017 Oct 11;3(1):e000272
pubmed: 29081984
Med Sci Sports Exerc. 2014 Sep;46(9):1840-8
pubmed: 24777201
Med Sci Sports Exerc. 2013 Nov;45(11):2105-12
pubmed: 23669877
Chronobiol Int. 2019 Jul;36(7):927-933
pubmed: 30990098
Int J Sports Phys Ther. 2018 Aug;13(5):860-870
pubmed: 30276018
J Rehabil Med. 2015 Oct 5;47(9):830-5
pubmed: 26181670
Med Sci Sports Exerc. 2018 Jun;50(6):1315-1322
pubmed: 29381649
Br J Sports Med. 2018 Jul;52(13):844-850
pubmed: 28483930
Disabil Health J. 2016 Apr;9(2):320-3
pubmed: 26905972
PLoS One. 2016 May 11;11(5):e0154956
pubmed: 27167121
PLoS One. 2016 Sep 02;11(9):e0161224
pubmed: 27589592
J Gen Intern Med. 2018 Jun;33(6):795-796
pubmed: 29633143
BMJ Open. 2016 Jul 07;6(7):e011243
pubmed: 27388359
J Aging Phys Act. 2019 Apr 1;27(2):222-229
pubmed: 30117355
J Sports Sci. 2019 Jan;37(1):42-49
pubmed: 29863968
BMJ Open Sport Exerc Med. 2015 Jul 8;1(1):e000013
pubmed: 27900119
Korean Circ J. 2019 May;49(5):437-445
pubmed: 30808083
Phys Ther. 2014 Feb;94(2):222-9
pubmed: 24052577
J Med Eng Technol. 2016 Aug;40(6):298-306
pubmed: 27266422
Gait Posture. 2016 Jul;48:36-41
pubmed: 27477705
Res Q Exerc Sport. 2019 Sep;90(3):377-384
pubmed: 31046630
Syst Rev. 2015 Jan 01;4:1
pubmed: 25554246
J Sci Med Sport. 2017 Jun;20(6):578-582
pubmed: 27887786
Int J Exerc Sci. 2018 Jan 02;11(7):503-515
pubmed: 29541338
Phys Ther. 2016 Mar;96(3):355-60
pubmed: 26251478
Prev Chronic Dis. 2006 Oct;3(4):A129
pubmed: 16978504
J Sports Sci. 2018 Jul;36(13):1447-1452
pubmed: 29090987
BMC Res Notes. 2016 Apr 12;9:213
pubmed: 27068022
Physiother Can. 2018 Fall;70(4):314-320
pubmed: 30745716
Int J Behav Nutr Phys Act. 2015 Dec 18;12:159
pubmed: 26684758
Telemed J E Health. 2018 Oct;24(10):782-789
pubmed: 29364065
J Sports Med Phys Fitness. 2019 May;59(5):784-790
pubmed: 29619803
Digit Health. 2018 Apr 13;4:2055207618770322
pubmed: 29942628
Med Sci Sports Exerc. 2017 Feb;49(2):371-377
pubmed: 27580155
Int J Behav Nutr Phys Act. 2011 Jul 28;8:79
pubmed: 21798015
PLoS One. 2017 Feb 24;12(2):e0172535
pubmed: 28234953
JMIR Mhealth Uhealth. 2020 Sep 8;8(9):e18694
pubmed: 32897239
Am J Public Health. 2011 Apr;101(4):751-8
pubmed: 21330590
Chronic Obstr Pulm Dis. 2016;3(3):636-642
pubmed: 27547817
JMIR Mhealth Uhealth. 2018 Dec 13;6(12):e10972
pubmed: 30545810
Children (Basel). 2018 Mar 08;5(3):
pubmed: 29518020
BMC Res Notes. 2017 Apr 20;10(1):161
pubmed: 28427441
Int J Behav Nutr Phys Act. 2015 Mar 27;12:42
pubmed: 25890168
BMJ Open Sport Exerc Med. 2016 Apr 25;2(1):e000106
pubmed: 27900173
JAMA Intern Med. 2016 May 1;176(5):702-3
pubmed: 26999758
J Sports Sci. 2019 Jun;37(12):1411-1419
pubmed: 30657025
J Med Eng Technol. 2013 Oct;37(7):456-62
pubmed: 24007317
JMIR Cancer. 2017 Apr 18;3(1):e5
pubmed: 28420602
Sports Med Int Open. 2017 Oct 18;1(6):E206-E211
pubmed: 30539109
PLoS One. 2018 Feb 28;13(2):e0192691
pubmed: 29489850
Scand J Med Sci Sports. 2018 Jul;28(7):1818-1827
pubmed: 29460319
Eur J Prev Cardiol. 2016 Sep;23(14):1476-85
pubmed: 26907794
Int J Cardiol. 2015 Apr 15;185:138-40
pubmed: 25795203
JMIR Mhealth Uhealth. 2018 Dec 10;6(12):e10338
pubmed: 30530451
Front Physiol. 2017 Sep 22;8:725
pubmed: 29018355
Rehabil Res Pract. 2018 Jun 19;2018:3521271
pubmed: 30018824
Gait Posture. 2019 May;70:30-32
pubmed: 30798092
Ann Intern Med. 2017 Apr 18;166(8):610-612
pubmed: 28395305
Gait Posture. 2017 Sep;57:199-203
pubmed: 28666177
Int J Exerc Sci. 2019 Mar 01;12(4):374-384
pubmed: 30899350
Am J Prev Med. 2009 May;36(5):410-5
pubmed: 19362695
Int J Technol Assess Health Care. 2012 Apr;28(2):138-44
pubmed: 22559755
J Sports Sci. 2018 Aug;36(15):1734-1741
pubmed: 29210326
BMC Res Notes. 2014 Dec 23;7:952
pubmed: 25539733
Med Sci Sports Exerc. 2017 Apr;49(4):793-800
pubmed: 28319983
J Med Eng Technol. 2017 Apr;41(3):200-207
pubmed: 28078908
Med Sci Sports Exerc. 2017 Aug;49(8):1697-1703
pubmed: 28709155
J Gerontol A Biol Sci Med Sci. 2017 Feb;72(2):229-236
pubmed: 27257217
Gait Posture. 2018 Jun;63:104-108
pubmed: 29729611
Mayo Clin Proc. 2018 Dec;93(12):1873-1874
pubmed: 30522597
Disabil Rehabil. 2019 Apr 12;:1-7
pubmed: 30978125
JMIR Mhealth Uhealth. 2015 Jul 28;3(3):e78
pubmed: 26220691
BMC Geriatr. 2018 May 3;18(1):103
pubmed: 29724191
J Phys Act Health. 2015 Feb;12(2):149-54
pubmed: 24770438
J Sports Sci Med. 2016 Aug 05;15(3):540-547
pubmed: 27803634
PLoS One. 2017 Jan 13;12(1):e0169616
pubmed: 28085918
Am J Health Promot. 2006 Nov-Dec;21(2):85-9
pubmed: 17152246
Med Sci Sports Exerc. 2016 Oct;48(10):1942-9
pubmed: 27183123
Med Sci Sports Exerc. 2018 Mar;50(3):624-633
pubmed: 29189666
JMIR Mhealth Uhealth. 2016 Sep 19;4(3):e110
pubmed: 27644334
Int J Exerc Sci. 2019 Mar 01;12(5):471-482
pubmed: 30899354
Med Sci Sports Exerc. 2017 Jun;49(6):1270-1279
pubmed: 28511193
Med Sci Sports Exerc. 2016 Aug;48(8):1619-28
pubmed: 27015387
Int J Exerc Sci. 2017 Jan 1;10(1):146-153
pubmed: 28479955
Pediatr Exerc Sci. 2019 Feb 1;31(1):130-136
pubmed: 30304974
J Med Eng Technol. 2017 Apr;41(3):208-215
pubmed: 27919170
Phys Ther. 2017 May 1;97(5):581-588
pubmed: 28339904
J Med Eng Technol. 2017 Aug;41(6):480-485
pubmed: 28675070
J Med Eng Technol. 2016 Aug;40(6):325-9
pubmed: 27280592
J Aging Phys Act. 2018 Jan 1;26(1):128-135
pubmed: 28595019
JAMA Cardiol. 2017 Jan 1;2(1):104-106
pubmed: 27732703
BMC Sports Sci Med Rehabil. 2017 Dec 20;9:22
pubmed: 29296281
Prosthet Orthot Int. 2018 Oct;42(5):518-526
pubmed: 29623810
Int J Epidemiol. 2002 Feb;31(1):115-23
pubmed: 11914306
JMIR Form Res. 2019 Apr 24;3(2):e11489
pubmed: 31017587
Int J Med Inform. 2017 Jun;102:87-92
pubmed: 28495352
BMC Sports Sci Med Rehabil. 2015 Oct 12;7:24
pubmed: 26464801
Am J Occup Ther. 2019 Mar/Apr;73(2):7302205150p1-7302205150p6
pubmed: 30915976
Med Eng Phys. 2014 Jun;36(6):659-69
pubmed: 24656871
Med Sci Sports Exerc. 2016 Mar;48(3):457-65
pubmed: 26484953
Nurs Outlook. 2006 Jan-Feb;54(1):23-9
pubmed: 16487776
Games Health J. 2019 Jun;8(3):205-212
pubmed: 31045446