Validity of Estimating the Maximal Oxygen Consumption by Consumer Wearables: A Systematic Review with Meta-analysis and Expert Statement of the INTERLIVE Network.
Journal
Sports medicine (Auckland, N.Z.)
ISSN: 1179-2035
Titre abrégé: Sports Med
Pays: New Zealand
ID NLM: 8412297
Informations de publication
Date de publication:
07 2022
07 2022
Historique:
accepted:
20
12
2021
pubmed:
25
1
2022
medline:
24
6
2022
entrez:
24
1
2022
Statut:
ppublish
Résumé
Technological advances have recently made possible the estimation of maximal oxygen consumption (VO The aim was to (1) quantitatively summarize previous studies investigating the validity of the VO First, we conducted a systematic review and meta-analysis of studies validating the estimation of VO Fourteen validation studies were included in the systematic review and meta-analysis. Meta-analysis results revealed that wearables using resting condition information in their algorithms significantly overestimated VO Our meta-analysis suggests that the estimations of VO CRD42021246192.
Sections du résumé
BACKGROUND
Technological advances have recently made possible the estimation of maximal oxygen consumption (VO
OBJECTIVE
The aim was to (1) quantitatively summarize previous studies investigating the validity of the VO
METHODS
First, we conducted a systematic review and meta-analysis of studies validating the estimation of VO
RESULTS
Fourteen validation studies were included in the systematic review and meta-analysis. Meta-analysis results revealed that wearables using resting condition information in their algorithms significantly overestimated VO
CONCLUSIONS
Our meta-analysis suggests that the estimations of VO
PROSPERO ID
CRD42021246192.
Identifiants
pubmed: 35072942
doi: 10.1007/s40279-021-01639-y
pii: 10.1007/s40279-021-01639-y
pmc: PMC9213394
doi:
Types de publication
Meta-Analysis
Systematic Review
Langues
eng
Sous-ensembles de citation
IM
Pagination
1577-1597Informations de copyright
© 2022. The Author(s).
Références
Tankovska H. Fitness & activity tracker—statistics & facts [Internet]. Statistica. 2020 [cited 2021 Apr 16]. https://www.statista.com/topics/4393/fitness-and-a .
Strain T, Wijndaele K, Dempsey PC, Sharp SJ, Pearce M, Jeon J, et al. Wearable-device-measured physical activity and future health risk. Nat Med [Internet]. 2020;26:1385–91. http://www.nature.com/articles/s41591-020-1012-3 .
Brickwood KJ, Watson G, O’brien J, Williams AD. Consumer-based wearable activity trackers increase physical activity participation: systematic review and meta-analysis. JMIR mHealth uHealth. 2019.
Althoff T, Sosič R, Hicks JL, King AC, Delp SL, Leskovec J. Large-scale physical activity data reveal worldwide activity inequality. Nature. 2017.
Ross R, Blair SN, Arena R, Church TS, Després JP, Franklin BA, et al. Importance of assessing cardiorespiratory fitness in clinical practice: a case for fitness as a clinical vital sign: a Scientific Statement from the American Heart Association. Circulation. 2016.
Bassett DR, Howley ET. Limiting factors for maximum oxygen uptake and determinants of endurance performance. Med Sci Sports Exerc. 2000.
ACSM. ACSM guidelines for exercise testing and preescripción. Am. Coll. Sport. Med. 2018.
Bennett H, Parfitt G, Davison K, Eston R. Validity of submaximal step tests to estimate maximal oxygen uptake in healthy adults. Sport Med. 2016;46:737–50.
doi: 10.1007/s40279-015-0445-1
Smith AE, Evans H, Parfitt G, Eston R, Ferrar K. Submaximal exercise-based equations to predict maximal oxygen uptake in older adults: a systematic review. Arch Phys Med Rehabil. 2016;97:1003–12. https://doi.org/10.1016/j.apmr.2015.09.023 .
doi: 10.1016/j.apmr.2015.09.023
pubmed: 26525524
Behind our Science | Polar Global [Internet]. [cited 2021 Apr 22]. https://www.polar.com/en/science .
• Garmin R&D expenses 2014–2020 | Statista [Internet]. [cited 2021 Apr 22]. https://www.statista.com/statistics/1036222/garmin-randd-expenditure/ .
Evenson KR, Goto MM, Furberg RD. Systematic review of the validity and reliability of consumer-wearable activity trackers. Int J Behav Nutr Phys Act. 2015. https://doi.org/10.1186/s12966-015-0314-1 .
doi: 10.1186/s12966-015-0314-1
pubmed: 26684758
pmcid: 4683756
Straiton N, Alharbi M, Bauman A, Neubeck L, Gullick J, Bhindi R, et al. The validity and reliability of consumer-grade activity trackers in older, community-dwelling adults: a systematic review. Maturitas. 2018.
Fuller D, Colwell E, Low J, Orychock K, Tobin MA, Simango B, et al. Reliability and Validity of commercially available wearable devices for measuring steps, energy expenditure, and heart rate: systematic review. JMIR mHealth uHealth [Internet]. 2020;8:e18694. http://mhealth.jmir.org/2020/9/e18694/ .
Zhang Y, Weaver RG, Armstrong B, Burkart S, Zhang S, Beets MW. Validity of Wrist-Worn photoplethysmography devices to measure heart rate: a systematic review and meta-analysis. J. Sports Sci. 2020.
O’Driscoll R, Turicchi J, Beaulieu K, Scott S, Matu J, Deighton K, et al. How well do activity monitors estimate energy expenditure? A systematic review and meta-analysis of the validity of current technologies. Br J Sports Med. 2020;54:332–40.
pubmed: 30194221
Keadle SK, Lyden KA, Strath SJ, Staudenmayer JW, Freedson PS. A Framework to evaluate devices that assess physical behavior. Exerc Sport Sci Rev. 2019;47:206–14.
doi: 10.1249/JES.0000000000000206
Welk GJ, Bai Y, Lee JM, Godino JOB, Saint-Maurice PF, Carr L. Standardizing analytic methods and reporting in activity monitor validation studies. Med Sci Sports Exerc. 2019;51:1767–80.
doi: 10.1249/MSS.0000000000001966
Mühlen JM, Stang J, Lykke Skovgaard E, Judice PB, Molina-Garcia P, Johnston W, et al. Recommendations for determining the validity of consumer wearable heart rate devices: expert statement and checklist of the INTERLIVE Network. Br J Sports Med. 2021.
Johnston W, Judice PB, Molina García P, Mühlen JM, Lykke Skovgaard E, Stang J, et al. Recommendations for determining the validity of consumer wearable and smartphone step count: expert statement and checklist of the INTERLIVE network. Br J Sports Med. 2020.
Standards—Tagged “Health and Fitness”—Consumer Technology Association
Mokkink LB, Boers M, van der Vleuten CPM, Bouter LM, Alonso J, Patrick DL, et al. COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study. BMC Med Res Methodol. 2020;20:1–13.
doi: 10.1186/s12874-020-01179-5
Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019.
Higgins JPT, Thompson SG, Spiegelhalter DJ. A re-evaluation of random-effects meta-analysis. J R Stat Soc Ser A Stat Soc. 2009.
Klepin K, Wing D, Higgins M, Nichols J, Godino JG. Validity of cardiorespiratory fitness measured with fitbit compared to VO
doi: 10.1249/MSS.0000000000002041
Robergs RA, Dwyer D, Astorino T. Recommendations for improved data processing from expired gas analysis indirect calorimetry. Sport Med. 2010.
Crouter SE, Albright C, Bassett DRJ. Accuracy of polar S410 heart rate monitor to estimate energy cost of exercise. Med Sci Sports Exerc United States. 2004;36:1433–9.
doi: 10.1249/01.MSS.0000135794.01507.48
Snyder NC, Willoughby CA, Smith BK. Comparison of the Polar V800 and the Garmin Forerunner 230 to predict [Formula: see text]O
Anderson JC, Chisenall T, Tolbert B, Ruffner J, Whitehead PN, Conners RT. Validating the commercially available Garmin Fenix 5x wrist-worn optical sensor for aerobic capacity. Int J Innov Educ Res. 2019;7:147–58.
doi: 10.31686/ijier.vol7.iss1.1293
Kraft GL, Roberts RA. Validation of the Garmin Forerunner 920XT Fitness Watch VO
Kraft GL, Dow M. Validation of the polar fitness test. Int J Innov Educ Res [Internet]. 2018;6:27–34. https://ijier.net/ijier/article/view/893 .
16.1.3.2 Imputing standard deviations for changes from baseline [Internet]. [cited 2021 Apr 24]. https://handbook-5-1.cochrane.org/chapter_16/16_1_3_2_imputing_standard_deviations_for_changes_from_baseline.htm .
Drevon D, Fursa SR, Malcolm AL. Intercoder reliability and validity of WebPlotDigitizer in extracting graphed data. Behav Modif. 2017.
Tipton E, Shuster J. A framework for the meta-analysis of Bland-Altman studies based on a limits of agreement approach. Stat Med. 2017;36:3621–35.
doi: 10.1002/sim.7352
DerSimonian R, Laird N. Meta-analysis in clinical trials revisited. Contemp Clin Trials. 2015.
Sterne JAC, Egger M, Smith GD. Systematic reviews in health care: investigating and dealing with publication and other biases in meta-analysis. Br. Med. J. 2001.
Esco MR, Mugu EM, Williford HN, McHugh AN, Bloomquist BE. Cross-validation of the polar fitness test
Lowe AL, Lloyd LK, Miller BK, McCurdy KW, Pope ML. Accuracy of polar F6 in estimating the energy cost of aerobic dance bench stepping in college-age females. J Sports Med Phys Fit. 2010;50:385–94.
Passler S, Bohrer J, Blöchinger L, Senner V. Validity of wrist-worn activity trackers for estimating VO
Esco MR, Snarr RL, Williford HN. Monitoring changes in VO
doi: 10.1080/02640414.2013.879672
pubmed: 24506090
Esco MR, Mugu EM, Williford HN, McHugh AN, Bloomquist BE. Cross-validation of the polar fitness test
Wagner M, Engel F, Klier K, Klughardt S, Wallner F, Wieczorek A. Zur Reliabilität von Wearable Devices am Beispiel einer Premium Multisport-Smartwatch. Ger J Exerc Sport Res [Internet]. 2020. https://doi.org/10.1007/s12662-020-00682-7 .
Lu MJ, Zhong WH, Liu YX, Miao HZ, Li YC, Ji MH. Sample size for assessing agreement between two methods of measurement by Bland–Altman method. Int J Biostat. 2016.
Carrier B, Creer A, Williams LR, Holmes TM, Jolley BD, Dahl S, et al. Validation of Garmin Fenix 3 HR fitness tracker biomechanics and metabolics (VO
doi: 10.1123/jmpb.2019-0066
Schoffelen PFM, Plasqui G. Classical experiments in whole-body metabolism: open-circuit respirometry—diluted flow chamber, hood, or facemask systems. Eur J Appl Physiol. 2018.
Freeberg KA, Baughman BR, Vickey T, Sullivan JA, Sawyer BJ. Assessing the ability of the Fitbit Charge 2 to accurately predict VO
Cooper KD, Shafer AB. Validity and reliability of the Polar A300’s fitness test feature to predict VO
pubmed: 30899351
pmcid: 6413855
Cooper JA, Watras AC, O’Brien MJ, Luke A, Dobratz JR, Earthman CP, et al. Assessing validity and reliability of resting metabolic rate in six gas analysis systems. J Am Diet Assoc. 2009;109:128–32.
doi: 10.1016/j.jada.2008.10.004
Carter J, Jeukendrup AE. Validity and reliability of three commercially available breath-by-breath respiratory systems. Eur J Appl Physiol. 2002.
Macfarlane DJ. Open-circuit respirometry: a historical review of portable gas analysis systems. Eur J Appl Physiol. 2017;117:2369–86. https://doi.org/10.1007/s00421-017-3716-8 .
doi: 10.1007/s00421-017-3716-8
pubmed: 29043499
Lowe AL, Lloyd LK, Miller BK, McCurdy KW, Pope ML. Accuracy of polar F6 in estimating the energy cost of aerobic dance bench stepping in college-age females. J Sports Med Phys Fit [Internet]. 2010;50:385–94. http://www.ncbi.nlm.nih.gov/pubmed/21178923 .
Zhang Y, Weaver RG, Armstrong B, Burkart S, Zhang S, Beets MW. Validity of Wrist-Worn photoplethysmography devices to measure heart rate: a systematic review and meta-analysis. J Sports Sci. 2020;38:2021–34. https://doi.org/10.1080/02640414.2020.1767348 .
doi: 10.1080/02640414.2020.1767348
pubmed: 32552580
Beltz NM, Gibson AL, Janot JM, Kravitz L, Mermier CM, Dalleck LC. Graded exercise testing protocols for the determination of VO
doi: 10.1155/2016/3968393
Mezzani A. Cardiopulmonary exercise testing: Basics of methodology and measurements. Ann Am Thorac Soc. 2017.
Schaun GZ. The maximal oxygen uptake verification phase: a light at the end of the tunnel? Sport Med Open. 2017;3.
Polar Fitness Test | Polar Blog [Internet]. [cited 2021 Apr 21]. https://www.polar.com/blog/lets-talk-polar-polar-fitness-test/ .
Polar Orthostatic Test. 2019 [cited 2021 Apr 16]. www.polar.com .
What is my cardio fitness score? [Internet]. [cited 2021 Apr 21]. https://help.fitbit.com/articles/en_US/Help_article/2096.htm .
What is VO
Bishop-Fitzpatrick L, Mazefsky CA, Eack SM. The combined impact of social support and perceived stress on quality of life in adults with autism spectrum disorder and without intellectual disability. Autism [Internet]. University of Wisconsin, Madison, United States: SAGE Publications Ltd; 2018;22:703–11. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85041625154&doi=10.1177%2F1362361317703090&partnerID=40&md5=8380eb3d3e32bf5f51dc1ac5cbd7a6af .
Martin Bland J, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986.
Zaki R, Bulgiba A, Ismail R, Ismail NA. Statistical methods used to test for agreement of medical instruments measuring continuous variables in method comparison studies: a systematic review. PLoS One. 2012.
Tayman J, Swanson DA. On the validity of MAPE as a measure of population forecast accuracy. Popul Res Policy Rev. 1999.
Kodama S, Saito K, Tanaka S, Maki M, Yachi Y, Asumi M, et al. Cardiorespiratory fitness as a quantitative predictor of all-cause mortality and cardiovascular events in healthy men and women: a meta-analysis. JAMA. 2009.
Polar Research and Technology (White Paper). Polar Fitness Test [Internet]. 2019. https://www.polar.com/en/science/whitepapers/fitness-test .
Firstbeat. Automated fitness level (VO
Nelson MB, Kaminsky LA, Dickin DC, Montoye AHK. Validity of consumer-based physical activity monitors for specific activity types. Med Sci Sports Exerc. 2016.
Zeiher J, Ombrellaro KJ, Perumal N, Keil T, Mensink GBM, Finger JD. Correlates and determinants of cardiorespiratory fitness in adults: a systematic review. Sport Med Open. 2019.
Gillinov S, Etiwy M, Wang R, Blackburn G, Phelan D, Gillinov AM, et al. Variable accuracy of wearable heart rate monitors during aerobic exercise. Med Sci Sports Exerc. 2017.
Ferrar K, Evans H, Smith A, Parfitt G, Eston R. A systematic review and meta-analysis of submaximal exercise-based equations to predict maximal oxygen uptake in young people. Pediatr Exerc Sci. 2014;26:342–57.
doi: 10.1123/pes.2013-0153