Feasibility of force myography for the direct control of an assistive robotic hand orthosis in non-impaired individuals.
Force myography
Gesture recognition
Human–machine interfaces
Intention detection
Robotic hand orthosis
Journal
Journal of neuroengineering and rehabilitation
ISSN: 1743-0003
Titre abrégé: J Neuroeng Rehabil
Pays: England
ID NLM: 101232233
Informations de publication
Date de publication:
03 08 2023
03 08 2023
Historique:
received:
16
02
2023
accepted:
21
07
2023
medline:
7
8
2023
pubmed:
4
8
2023
entrez:
3
8
2023
Statut:
epublish
Résumé
Assistive robotic hand orthoses can support people with sensorimotor hand impairment in many activities of daily living and therefore help to regain independence. However, in order for the users to fully benefit from the functionalities of such devices, a safe and reliable way to detect their movement intention for device control is crucial. Gesture recognition based on force myography measuring volumetric changes in the muscles during contraction has been previously shown to be a viable and easy to implement strategy to control hand prostheses. Whether this approach could be efficiently applied to intuitively control an assistive robotic hand orthosis remains to be investigated. In this work, we assessed the feasibility of using force myography measured from the forearm to control a robotic hand orthosis worn on the hand ipsilateral to the measurement site. In ten neurologically-intact participants wearing a robotic hand orthosis, we collected data for four gestures trained in nine arm configurations, i.e., seven static positions and two dynamic movements, corresponding to typical activities of daily living conditions. In an offline analysis, we determined classification accuracies for two binary classifiers (one for opening and one for closing) and further assessed the impact of individual training arm configurations on the overall performance. We achieved an overall classification accuracy of 92.9% (averaged over two binary classifiers, individual accuracies 95.5% and 90.3%, respectively) but found a large variation in performance between participants, ranging from 75.4 up to 100%. Averaged inference times per sample were measured below 0.15 ms. Further, we found that the number of training arm configurations could be reduced from nine to six without notably decreasing classification performance. The results of this work support the general feasibility of using force myography as an intuitive intention detection strategy for a robotic hand orthosis. Further, the findings also generated valuable insights into challenges and potential ways to overcome them in view of applying such technologies for assisting people with sensorimotor hand impairment during activities of daily living.
Sections du résumé
BACKGROUND
Assistive robotic hand orthoses can support people with sensorimotor hand impairment in many activities of daily living and therefore help to regain independence. However, in order for the users to fully benefit from the functionalities of such devices, a safe and reliable way to detect their movement intention for device control is crucial. Gesture recognition based on force myography measuring volumetric changes in the muscles during contraction has been previously shown to be a viable and easy to implement strategy to control hand prostheses. Whether this approach could be efficiently applied to intuitively control an assistive robotic hand orthosis remains to be investigated.
METHODS
In this work, we assessed the feasibility of using force myography measured from the forearm to control a robotic hand orthosis worn on the hand ipsilateral to the measurement site. In ten neurologically-intact participants wearing a robotic hand orthosis, we collected data for four gestures trained in nine arm configurations, i.e., seven static positions and two dynamic movements, corresponding to typical activities of daily living conditions. In an offline analysis, we determined classification accuracies for two binary classifiers (one for opening and one for closing) and further assessed the impact of individual training arm configurations on the overall performance.
RESULTS
We achieved an overall classification accuracy of 92.9% (averaged over two binary classifiers, individual accuracies 95.5% and 90.3%, respectively) but found a large variation in performance between participants, ranging from 75.4 up to 100%. Averaged inference times per sample were measured below 0.15 ms. Further, we found that the number of training arm configurations could be reduced from nine to six without notably decreasing classification performance.
CONCLUSION
The results of this work support the general feasibility of using force myography as an intuitive intention detection strategy for a robotic hand orthosis. Further, the findings also generated valuable insights into challenges and potential ways to overcome them in view of applying such technologies for assisting people with sensorimotor hand impairment during activities of daily living.
Identifiants
pubmed: 37537602
doi: 10.1186/s12984-023-01222-8
pii: 10.1186/s12984-023-01222-8
pmc: PMC10399035
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
101Informations de copyright
© 2023. BioMed Central Ltd., part of Springer Nature.
Références
du Plessis T, Djouani K, Oosthuizen C. A review of active hand exoskeletons for rehabilitation and assistance. Robotics. 2021. https://doi.org/10.3390/robotics10010040 .
doi: 10.3390/robotics10010040
Gantenbein J, Meyer JT, Jäger L, Sigrist R, Gassert R, Lambercy O. An analysis of intention detection strategies to control advanced assistive technologies at the cybathlon. In: 2022 International Conference on Rehabilitation Robotics (ICORR), 2022; p. 1–6. IEEE
Gantenbein J, Dittli J, Meyer JT, Gassert R, Lambercy O. Intention detection strategies for robotic upper-limb orthoses: a scoping review considering usability, daily life application, and user evaluation. Front Neurorobot. 2022;16.
Zheng Z, Wu Z, Zhao R, Ni Y, Jing X, Gao S. A review of emg-, fmg-, and eit-based biosensors and relevant human-machine interactivities and biomedical applications. Biosensors. 2022;12(7):516.
doi: 10.3390/bios12070516
pubmed: 35884319
pmcid: 9313012
Hameed HK, Hassan WZW, Shafie S, Ahmad SA, Jaafar H. A review on surface electromyography-controlled hand robotic devices used for rehabilitation and assistance in activities of daily living. J Prosthet Orthot. 2020;32:3–13. https://doi.org/10.1097/JPO.0000000000000277 .
doi: 10.1097/JPO.0000000000000277
Parajuli N, Sreenivasan N, Bifulco P, Cesarelli M, Savino S, Niola V, Esposito D, Hamilton TJ, Naik GR, Gunawardana U, et al. Real-time emg based pattern recognition control for hand prostheses: a review on existing methods, challenges and future implementation. Sensors. 2019;19(20):4596.
doi: 10.3390/s19204596
pubmed: 31652616
pmcid: 6832440
Xiao ZG, Menon C. A review of force myography research and development. Sensors. 2019;19:4557. https://doi.org/10.3390/S19204557 .
doi: 10.3390/S19204557
pubmed: 31635167
pmcid: 6832981
Radmand A, Scheme E, Englehart K. High-density force myography: a possible alternative for upper-limb prosthetic control. J Rehabil Res Dev. 2016. https://doi.org/10.1682/JRRD.2015.03.0041 .
doi: 10.1682/JRRD.2015.03.0041
pubmed: 27532260
Belyea A, Englehart K, Scheme E. FMG versus EMG: a comparison of usability for real-time pattern recognition based control. IEEE Trans Biomed Eng. 2019. https://doi.org/10.1109/TBME.2019.2900415 .
doi: 10.1109/TBME.2019.2900415
pubmed: 30794502
Nowak M, Eiband T, Ramírez ER, Castellini C. Action interference in simultaneous and proportional myocontrol: comparing force- and electromyography. J Neural Eng. 2020;17. https://doi.org/10.1088/1741-2552/AB7B1E .
doi: 10.1088/1741-2552/AB7B1E
pubmed: 32109906
Ravindra V, Castellini C. A comparative analysis of three non-invasive human-machine interfaces for the disabled. Front Neurorobot. 2014. https://doi.org/10.3389/fnbot.2014.00024 .
doi: 10.3389/fnbot.2014.00024
pubmed: 25386135
pmcid: 4209885
Connan M, Ramírez ER, Vodermayer B, Castellini C. Assessment of a wearable forceand electromyography device and comparison of the related signals for myocontrol. Front Neurorobot. 2016;10:17. https://doi.org/10.3389/FNBOT.2016.00017/BIBTEX .
doi: 10.3389/FNBOT.2016.00017/BIBTEX
pubmed: 27909406
pmcid: 5112250
Ahmadizadeh C, Merhi LK, Pousett B, Sangha S, Menon C. Toward intuitive prosthetic control: Solving common issues using force myography, surface electromyography and pattern recognition in a pilot case study. IEEE Trans Robot Autom. 2017;24:102–11. https://doi.org/10.1109/mra.2017.2747899 .
doi: 10.1109/mra.2017.2747899
Prakash A, Sahi AK, Sharma N, Sharma S. Force myography controlled multifunctional hand prosthesis for upper-limb amputees. Biomed Signal Process Control. 2020. https://doi.org/10.1016/J.BSPC.2020.102122 .
doi: 10.1016/J.BSPC.2020.102122
Yap HK, Mao A, Goh JCH, Yeow CH. Design of a wearable fmg sensing system for user intent detection during hand rehabilitation with a soft robotic glove. Proceedings of the IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics 2016-July, 2016; p. 781–786. https://doi.org/10.1109/BIOROB.2016.7523722
Islam MRU, Bai S. Effective multi-mode grasping assistance control of a soft hand exoskeleton using force myography. Front Robot AI. 2020;7:139. https://doi.org/10.3389/FROBT.2020.567491/BIBTEX .
doi: 10.3389/FROBT.2020.567491/BIBTEX
Xiao ZG, Elnady AM, Menon C. Control an exoskeleton for forearm rotation using fmg. Proceedings of the IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics. 2014;591–6. https://doi.org/10.1109/BIOROB.2014.6913842 .
Esposito D, Centracchio J, Andreozzi E, Savino S, Gargiulo GD, Naik GR, Bifulco P. Design of a 3d-printed hand exoskeleton based on force-myography control for assistance and rehabilitation. Machines. 2022;10:57. https://doi.org/10.3390/MACHINES10010057 .
doi: 10.3390/MACHINES10010057
Xiao ZG, Menon C. Counting grasping action using force myography: an exploratory study with healthy individuals. JMIR Rehabil Assist Technol. 2017. https://doi.org/10.2196/rehab.6901 .
doi: 10.2196/rehab.6901
pubmed: 28582263
pmcid: 5460070
Chapman J, Dwivedi A, Liarokapis M. A wearable, open-source, lightweight forcemyography armband: on intuitive, robust muscle-machine interfaces. In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021; p. 4138–4143. IEEE
Delva ML, Lajoie K, Khoshnam M, Menon C. Wrist-worn wearables based on force myography: on the significance of user anthropometry. BioMed Eng OnLine. 2020. https://doi.org/10.1186/S12938-020-00789-W .
doi: 10.1186/S12938-020-00789-W
pubmed: 32532358
pmcid: 7291722
Chegani RS, Menon C. Regressing grasping using force myography: an exploratory study. Biomed Eng Online. 2018;17:1–22. https://doi.org/10.1186/S12938-018-0593-2/TABLES/6 .
doi: 10.1186/S12938-018-0593-2/TABLES/6
Lei G, Zhang S, Fang Y, Wang Y, Zhang X. Investigation on the sampling frequency and channel number for force myography based hand gesture recognition. Sensors. 2021;21:3872. https://doi.org/10.3390/S21113872 .
doi: 10.3390/S21113872
pubmed: 34205220
pmcid: 8200028
Bützer T, Lambercy O, Arata J, Gassert R. Fully wearable actuated soft exoskeleton for grasping assistance in everyday activities. Soft Rob. 2020;8:128–43. https://doi.org/10.1089/soro.2019.0135 .
doi: 10.1089/soro.2019.0135
Arata J, Ohmoto K, Gassert R, Lambercy O, Fujimoto H, Wada I. A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism. Proc IEEE Int Conf Robot Autom. 2013;3902–7. https://doi.org/10.1109/ICRA.2013.6631126 .
Dittli J, Hofmann UAT, Bützer T, Smit G, Lambercy O, Gassert R. Remote actuation systems for fully wearable assistive devices: Requirements, selection, and optimization for out-of-the-lab application of a hand exoskeleton. Front Robot AI. 2021;7.
Radmand A, Scheme E, Englehart K. A characterization of the effect of limb position on emg features to guide the development of effective prosthetic control schemes. Annu Int Conf IEEE Eng Med Biol Soc. 2014. https://doi.org/10.1109/EMBC.2014.6943678 .
doi: 10.1109/EMBC.2014.6943678
pubmed: 25570046
Boser QA, Dawson MR, Schofield JS, Dziwenko GY, Hebert JS. Defining the design requirements for an assistive powered hand exoskeleton: a pilot explorative interview study and case series. Prosthet Orthot Int. 2020. https://doi.org/10.1177/0309364620963943 .
doi: 10.1177/0309364620963943
pmcid: 8404210
Jiang X, Merhi L-K, Xiao ZG, Menon C. Exploration of force myography and surface electromyography in hand gesture classification. Med Eng Phys. 2017;41:63–73.
doi: 10.1016/j.medengphy.2017.01.015
pubmed: 28161107
Chandrashekar G, Sahin F. A survey on feature selection methods. Comput Electr Eng. 2014;40(1):16–28.
doi: 10.1016/j.compeleceng.2013.11.024
Scheme E, Englehart K. Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. J Rehabil Res Dev. 2011;48:643–60. https://doi.org/10.1682/JRRD.2010.09.0177 .
doi: 10.1682/JRRD.2010.09.0177
pubmed: 21938652
Tun NN, Sanuki F, Iramina K. Electroencephalogram-electromyogram functional coupling and delay time change based on motor task performance. Sensors. 2021;21(13):4380.
doi: 10.3390/s21134380
pubmed: 34206753
pmcid: 8271984
Cavanagh PR, Komi PV. Electromechanical delay in human skeletal muscle under concentric and eccentric contractions. Eur J Appl Physiol Occup Physiol. 1979;42:159–63.
doi: 10.1007/BF00431022
pubmed: 527577
Xiong Y, Quek F. Hand motion gesture frequency properties and multimodal discourse analysis. Int J Comput Vis. 2006;69:353–71.
doi: 10.1007/s11263-006-8112-5
Carson R. Neural pathways mediating bilateral interactions between the upper limbs. Brain Res Rev. 2005;49(3):641–62.
doi: 10.1016/j.brainresrev.2005.03.005
pubmed: 15904971
Germanotta M, Gower V, Papadopoulou D, Cruciani A, Pecchioli C, Mosca R, Speranza G, Falsini C, Cecchi F, Vannetti F, et al. Reliability, validity and discriminant ability of a robotic device for finger training in patients with subacute stroke. J Neuroeng Rehabil. 2020;17:1–10.
doi: 10.1186/s12984-019-0634-5
pubmed: 31900169
pmcid: 6942416
Chen J, Tsai C-A, Moon H, Ahn H, Young J, Chen C-H. Decision threshold adjustment in class prediction. SAR QSAR Environ Res. 2006;17(3):337–52.
doi: 10.1080/10659360600787700
pubmed: 16815772
Young AJ, Hargrove LJ, Kuiken TA. The effects of electrode size and orientation on the sensitivity of myoelectric pattern recognition systems to electrode shift. IEEE Trans Biomed Eng. 2011;58(9):2537–44.
doi: 10.1109/TBME.2011.2159216
pubmed: 21659017
pmcid: 4234036
Lu Z, Stampas A, Francisco GE, Zhou P. Offline and online myoelectric pattern recognition analysis and real-time control of a robotic hand after spinal cord injury. J Neural Eng. 2019;16(3).
Sadarangani GP, Jiang X, Simpson LA, Eng JJ, Menon C. Force myography for monitoring grasping in individuals with stroke with mild to moderate upper-extremity impairments: a preliminary investigation in a controlled environment. Front Bioeng Biotechnol. 2017;5:42. https://doi.org/10.3389/FBIOE.2017.00042/BIBTEX .
doi: 10.3389/FBIOE.2017.00042/BIBTEX
pubmed: 28798912
pmcid: 5529400
Jiang S, Gao Q, Liu H, Shull PB. A novel, co-located emg-fmg-sensing wearable armband for hand gesture recognition. Sens Actuators A: Phys. 2020;301.
Ferigo D, Merhi L-K, Pousett B, Xiao ZG, Menon C. A case study of a force-myography controlled bionic hand mitigating limb position effect. J Bionic Eng. 2017;14(4):692–705.
doi: 10.1016/S1672-6529(16)60435-3
Nizamis K, Voss S, Koopman HF. Towards the control of an active hand orthosis for people with duchenne muscular dystrophy: comparison of intuitive to non-intutive semg control. In: 6th Dutch Bio-Medical Engineering Conference 2017;2017
Zakia U, Jiang X, Menon C. Deep learning technique in recognizing hand grasps using fmg signals. In: 2020 11th IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), 2020; p. 0546–0552. IEEE