Stressing the accuracy: Wrist-worn wearable sensor validation over different conditions.
Adolescent
Adult
Electrocardiography
Female
Fingers
Galvanic Skin Response
/ physiology
Heart Rate
/ physiology
Humans
Male
Middle Aged
Monitoring, Ambulatory
/ instrumentation
Motor Activity
/ physiology
Psychomotor Performance
/ physiology
Stress, Psychological
/ diagnosis
Wearable Electronic Devices
/ standards
Wrist
Young Adult
autonomic
heart rate
heart rate variability
skin conductance
stress
wearable sensor
Journal
Psychophysiology
ISSN: 1540-5958
Titre abrégé: Psychophysiology
Pays: United States
ID NLM: 0142657
Informations de publication
Date de publication:
11 2019
11 2019
Historique:
received:
13
12
2018
revised:
29
04
2019
accepted:
24
06
2019
pubmed:
25
7
2019
medline:
4
8
2020
entrez:
24
7
2019
Statut:
ppublish
Résumé
Wearable sensors are promising instruments for conducting both laboratory and ambulatory research in psychophysiology. However, scholars should be aware of their measurement error and the conditions in which accuracy is achieved. This study aimed to assess the accuracy of a wearable sensor designed for research purposes, the E4 wristband (Empatica, Milan, Italy), in measuring heart rate (HR), heart rate variability (HRV), and skin conductance (SC) over five laboratory conditions widely used in stress reactivity research (seated rest, paced breathing, orthostatic, Stroop, speech task) and two ecological conditions (slow walking, keyboard typing). Forty healthy participants concurrently wore the wristband and two gold standard measurement systems (i.e., electrocardiography and finger SC sensor). The wristband accuracy was determined by evaluating the signal quality and the correlations with and the Bland-Altman plots against gold standard-derived measurements. Moreover, exploratory analyses were performed to assess predictors of measurement error. Mean HR measures showed the best accuracy over all conditions. HRV measures showed satisfactory accuracy in seated rest, paced breathing, and recovery conditions but not in dynamic conditions, including speaking. Accuracy was diminished by wrist movements, cognitive and emotional stress, nonstationarity, and larger wrist circumferences. Wrist SC measures showed neither correlation nor visual resemblance with finger SC signal, suggesting that the two sites may reflect different phenomena. Future studies are needed to assess the responsivity of wrist SC to emotional and cognitive stress. Limitations and implications for laboratory and ambulatory research are discussed.
Types de publication
Journal Article
Validation Study
Langues
eng
Sous-ensembles de citation
IM
Pagination
e13441Informations de copyright
© 2019 Society for Psychophysiological Research.
Références
Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Caski (Eds.), Proceedings of the second international symposium on information theory (pp. 267-281). Budapest, Hungary: Akademiai Kiado. https://doi.org/10.1007/978-1-4612-1694-0_15
Bali, A., & Jaggi, A. S. (2015). Clinical experimental stress studies: Methods and assessment. Reviews in the Neurosciences, 26(5), 555-579. https://doi.org/10.1515/revneuro-2015-0004
Benedek, M., & Kaernbach, C. (2010). A continuous measure of phasic electrodermal activity. Journal of Neuroscience Methods, 190(1), 80-91. https://doi.org/10.1016/j.jneumeth.2010.04.028
Berntson, G. G., Quigley, K. S., Jang, J. F., & Boysen, S. T. (1990). An approach to artefact identification: Application to heart period data. Psychophysiology, 27(5), 586-598. https://doi.org/10.1111/j.1469-8986.1990.tb01982.x
Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 327(8476), 307-310. https://doi.org/10.1016/S0140-6736(86)90837-8
Bland, J. M., & Altman, D. G. (1999). Measuring agreement in method comparison studies. Statistical Methods in Medical Research, 8(2), 135-160. https://doi.org/10.1177/096228029900800204
Borchers, H. W. (2018). “pracma”: Practical numerical math functions. R package version 2.1.5 (Computer software). Retrieved from https://CRAN.R-project.org/package=pracma
Boucsein, W., Fowles, D. C., Grimnes, S., Ben-Shakhar, G., Roth, W. T., Dawson, M. E., & Filion, D. L. (2012). Publication recommendations for electrodermal measurements. Psychophysiology, 49(8), 1017-1034. https://doi.org/10.1111/j.1469-8986.2012.01384.x
Bradley, M. M., & Lang, P. J. (2007). Affective norms for English text (ANET): Affective ratings of text and instruction manual (Techical Report. D-1). Gainesville, FL: University of Florida.
Cacioppo, J. T., Berntson, G. G., Malarkey, W. B., Kiecolt-Glaser, J. K., Sheridan, J. F., Poehlmann, K. M., … Glaser, R. (1998). Autonomic, neuroendocrine, and immune responses to psychological stress: The reactivity hypothesis. Annals of the New York Academy of Sciences, 840(1), 664-673.
Charlot, K., Cornolo, J., Brugniaux, J. V., Richalet, J. P., & Pichon, A. (2009). Interchangeability between heart rate and photoplethysmography variabilities during sympathetic stimulations. Physiological Measurement, 30(12), 1357-1370. https://doi.org/10.1088/0967-3334/30/12/005
Chhapola, V., Kanwal, S. K., & Brar, R. (2015). Reporting standards for Bland-Altman agreement analysis in laboratory research: A cross-sectional survey of current practice. Annals of Clinical Biochemistry, 52(3), 382-386. https://doi.org/10.1177%2F0004563214553438
Chrisinger, B. W., & King, A. C. (2018). Stress experiences in neighborhood and social environments (SENSE): A pilot study to integrate the quantified self with citizen science to improve the built environment and health. International Journal of Health Geographics, 17(1), 17. https://doi.org/10.1186/s12942-018-0140-1
Dawson, M. E., Schell, A. M., & Filion, D. L. (2007). The electrodermal system. In J. T. Cacioppo, L. G. Tassinary, & G. G. Berntson (Eds.), Handbook of psychophysiology (3rd ed., pp. 159-181). New York, NY: Cambridge University Press.
de Geus, E. J., Gianaros, P. J., Brindle, R. C., Jennings, J. R., & Berntson, G. G. (2019). Should heart rate variability be “corrected” for heart rate? Biological, quantitative, and interpretive considerations. Psychophysiology, 56(2), e13287. https://doi.org/10.1111/psyp.13287
de Zambotti, M., Cellini, N., Goldstone, A., Colrain, I. M., & Baker, F. C. (2019). Wearable sleep technology in clinical and research settings. Medicine and Science in Sports and Exercise, 51(7), 1538-1557. https://doi.org/10.1249/MSS.0000000000001947
Elgendi, M. (2012). On the analysis of fingertip photoplethysmogram signals. Current Cardiology Reviews, 8(1), 14-25. https://doi.org/10.2174/157340312801215782
Euser, A. M., Dekker, F. W., & le Cessie, S. (2008). A practical approach to Bland-Altman plots and variation coefficients for log transformed variables. Journal of Clinical Epidemiology, 61(10), 978-982. https://doi.org/10.1016/j.jclinepi.2007.11.003
Fowles, D. C., Christie, M. J., Edelberg, R., Grings, W. W., Lykken, D. T., & Venables, P. H. (1981). Publication recommendations for electrodermal measurements. Psychophysiology, 18(3), 232-239. https://doi.org/10.1111/j.1469-8986.1981.tb03024.x
Freedman, L. W., Scerbo, A. S., Dawson, M. E., Raine, A., McClure, W. O., & Venables, P. H. (1994). The relationship of sweat gland count to electrodermal activity. Psychophysiology, 31(2), 196-200. https://doi.org/10.1111/j.1469-8986.1994.tb01040.x
Grant, C. C., van Rensburg, D. C., Strydom, N., & Viljoen, M. (2011). Importance of tachogram length and period of recording during noninvasive investigation of the autonomic nervous system. Annals of Noninvasive Electrocardiology, 16(2), 131-139. https://doi.org/10.1111/j.1542-474X.2011.00422.x
Kappeler-Setz, C., Gravenhorst, F., Schumm, J., Arnrich, B., & Tröster, G. (2013). Towards long term monitoring of electrodermal activity in daily life. Personal and Ubiquitous Computing, 17(2), 261-271. https://doi.org/10.1007/s00779-011-0463-4
Kaufmann, T., Sütterlin, S., Schulz, S., & Vögele, C. (2011). ARTiiFACT: A tool for heart rate artefact processing and heart rate variability analysis. Behavior Research Methods, 43, 1161-1170. https://doi.org/10.3758/s13428-011-0107-7
Kirschbaum, C., Pirke, K. M., & Hellhammer, D. H. (1993). The ‘Trier Social Stress Test’-A tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology, 28(1-2), 76-81. https://doi.org/10.1159/000119004
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155-163. https://doi.org/10.1016/j.jcm.2016.02.012
Laborde, S., Mosley, E., & Thayer, J. F. (2017). Heart rate variability and cardiac vagal tone in psychophysiological research-Recommendations for experiment planning, data analysis, and data reporting. Frontiers in Psychology, 8, 213. https://doi.org/10.3389/fpsyg.2017.00213
Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30, 261-273. https://doi.org/10.1111/j.1469-8986.1993.tb03352.x
Lobelo, F., Kelli, H. M., Tejedor, S. C., Pratt, M., McConnell, M. V., Martin, S. S., & Welk, G. J. (2016). The wild wild west: A framework to integrate mHealth software applications and wearables to support physical activity assessment, counseling and interventions for cardiovascular disease risk reduction. Progress in Cardiovascular Diseases, 58(6), 584-594.
Malik, M., Bigger, J. T., Camm, A. J., Kleiger, R. E., Malliani, A., Moss, A. J., & Schwartz, P. J. (1996). Heart rate variability: Standards of measurement, physiological interpretation, and clinical use. European Heart Journal, 17, 354-381. https://doi.org/10.1093/oxfordjournals.eurheartj.a014868
Mantha, S., Roizen, M. F., Fleisher, L. A., Thisted, R., & Foss, J. (2000). Comparing methods of clinical measurement: Reporting standards for Bland and Altman analysis. Anesthesia & Analgesia, 90(3), 593-602. https://doi.org/10.1097/00000539-200003000-00018
McCarthy, C., Pradhan, N., Redpath, C., & Adler, A. (2016, May). Validation of the Empatica E4 wristband. Paper presented at the IEEE EMBS International Student Conference, Ottawa, ON, Canada, 1-4. https://doi.org/10.1109/EMBSISC.2016.7508621
Naschitz, J. E., Bezobchuk, S., Mussafia-Priselac, R., Sundick, S., Dreyfuss, D., Khorshidi, I., … Gaitini, L. (2004). Pulse transit time by R-wave-gated infrared photoplethysmography: Review of the literature and personal experience. Journal of Clinical Monitoring and Computing, 18(5-6), 333-342. https://doi.org/10.1007/s10877-005-4300-z
Ollander, S., Godin, C., Campagne, A., & Charbonnier, S. (2016, October). A comparison of wearable and stationary sensors for stress detection. Paper presented at the IEEE International Conference on Systems, Man, and Cybernetics, Budapest, Hungary, 4362-4366. https://doi.org/10.1109/SMC.2016.7844917
Parra, F., Miljkovitch, R., Persiaux, G., Morales, M., & Scherer, S. (2017). The multimodal assessment of adult attachment security: Developing the biometric attachment test. Journal of Medical Internet Research, 19(4), e100. https://doi.org/10.2196/jmir.6898
Pevnick, J. M., Birkeland, K., Zimmer, R., Elad, Y., & Kedan, I. (2017). Wearable technology for cardiology: An update and framework for the future. Trends in Cardiovascular Medicine, 28(2), 144-150. https://doi.org/10.1016/j.tcm.2017.08.003
Pietilä, J., Mehrang, S., Tolonen, J., Helander, E., Jimison, H., Pavel, M., & Korhonen, I. (2017, June). Evaluation of the accuracy and reliability for photoplethysmography based heart rate and beat-to-beat detection during daily activities. Paper presented at the EMBEC & NBC 2017. Singapore: Springer, 145-148. https://doi.org/10.1007/978-981-10-5122-7_37
Quintana, D. S., Alvares, G. A., & Heathers, J. A. J. (2016). Guidelines for reporting articles on psychiatry and heart rate variability (GRAPH): Recommendations to advance research communication. Translational Psychiatry, 6(5), e803. https://doi.org/10.1038/tp.2016.73
Ragot, M., Martin, N., Em, S., Pallamin, N., & Diverrez, J. M. (2017, July). Emotion recognition using physiological signals: Laboratory vs. wearable sensors. Paper presented at the International Conference on Applied Human Factors and Ergonomics. Cham, Switzerland: Springer, 15-22.
Rahman, F., Pechnik, S., Gross, D., Sewell, L., & Goldstein, D. S. (2011). Low frequency power of heart rate variability reflects baroreflex function, not cardiac sympathetic innervation. Clinical Autonomic Research, 21(3), 133-141. https://doi.org/10.1007/s10286-010-0098-y
R Development Core and Team. (2008). R: A language and environment for statistical computing (Computer software). Vienna, Austria. Retrieved from http://www.R-project.org
Schäfer, A., & Vagedes, J. (2013). How accurate is pulse rate variability as an estimate of heart rate variability? International Journal of Cardiology, 166(1), 15-29. https://doi.org/10.1016/j.ijcard.2012.03.119
Shcherbina, A., Mattsson, C., Waggott, D., Salisbury, H., Christle, J., Hastie, T., … Ashley, E. (2017). Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. Journal of Personalized Medicine, 7(2), 3. https://doi.org/10.3390/jpm7020003
Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420-428. Retrieved from http://psycnet.apa.org/doi/10.1037/0033-2909.86.2.420
Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643-662. Retrieved from http://psycnet.apa.org/doi/10.1037/h0054651
van Dooren, Marieke, de Vries, J. J. G. ( Gert-Jan), & Janssen, Joris H. (2012). Emotional sweating across the body: Comparing 16 different skin conductance measurement locations. Physiology & Behavior, 106(2), 298-304. https://doi.org/10.1016/j.physbeh.2012.01.020
Vaschillo, E. G., Vaschillo, B., & Lehrer, P. M. (2006). Characteristics of resonance in heart rate variability stimulated by biofeedback. Applied Psychophysiology and Biofeedback, 31(2), 129-142. https://doi.org/10.1007/s10484-006-9009-3
Von Luschan, F. (1927). Voelker, Rassen, Sprachen: Anthropologische Betrachtungen [Populations, races, languages: Anthropological considerations]. Berlin, Germany: Deutsche Buchgemeinshaft.
Wagenmakers, E. J., & Farrell, S. (2004). AIC model selection using Akaike weights. Psychonomic Bulletin & Review, 11(1), 192-196. https://doi.org/10.3758/BF03206482
Wilhelm, F. H., & Grossman, P. (2010). Emotions beyond the laboratory: Theoretical fundaments, study design, and analytic strategies for advanced ambulatory assessment. Biological Psychology, 84(3), 552-569. https://doi.org/10.1016/j.biopsycho.2010.01.017
Zakopoulos, N. A., Kotsis, V. T., Pitiriga, V. C., Toumanidis, S. T., Lekakis, J. P., Nanas, S. N., … Moulopoulos, S. D. (2002). White-coat effect in normotension and hypertension. Blood Pressure Monitoring, 7(5), 271-276. https://doi.org/10.1097/00126097-200210000-00004
Zanstra, Y. J., & Johnston, D. W. (2011). Cardiovascular reactivity in real life settings: Measurement, mechanisms and meaning. Biological Psychology, 86(2), 98-105. https://doi.org/10.1016%2Fj.biopsycho.2010.05.002