A compact solution for vibrotactile proprioceptive feedback of wrist rotation and hand aperture.
Closed-loop control
Gaussian interpolation
Hannes hand
Multichannel stimulation
Proprioceptive feedback
Spatial encoding
Vibromotors
Journal
Journal of neuroengineering and rehabilitation
ISSN: 1743-0003
Titre abrégé: J Neuroeng Rehabil
Pays: England
ID NLM: 101232233
Informations de publication
Date de publication:
13 Aug 2024
13 Aug 2024
Historique:
received:
08
02
2024
accepted:
10
07
2024
medline:
13
8
2024
pubmed:
13
8
2024
entrez:
12
8
2024
Statut:
epublish
Résumé
Closing the control loop between users and their prostheses by providing artificial sensory feedback is a fundamental step toward the full restoration of lost sensory-motor functions. We propose a novel approach to provide artificial proprioceptive feedback about two degrees of freedom using a single array of 8 vibration motors (compact solution). The performance afforded by the novel method during an online closed-loop control task was compared to that achieved using the conventional approach, in which the same information was conveyed using two arrays of 8 and 4 vibromotors (one array per degree of freedom), respectively. The new method employed Gaussian interpolation to modulate the intensity profile across a single array of vibration motors (compact feedback) to convey wrist rotation and hand aperture by adjusting the mean and standard deviation of the Gaussian, respectively. Ten able-bodied participants and four transradial amputees performed a target achievement control test by utilizing pattern recognition with compact and conventional vibrotactile feedback to control the Hannes prosthetic hand (test conditions). A second group of ten able-bodied participants performed the same experiment in control conditions with visual and auditory feedback as well as no-feedback. Conventional and compact approaches resulted in similar positioning accuracy, time and path efficiency, and total trial time. The comparison with control condition revealed that vibrational feedback was intuitive and useful, but also underlined the power of incidental feedback sources. Notably, amputee participants achieved similar performance to that of able-bodied participants. The study therefore shows that the novel feedback strategy conveys useful information about prosthesis movements while reducing the number of motors without compromising performance. This is an important step toward the full integration of such an interface into a prosthesis socket for clinical use.
Sections du résumé
BACKGROUND
BACKGROUND
Closing the control loop between users and their prostheses by providing artificial sensory feedback is a fundamental step toward the full restoration of lost sensory-motor functions.
METHODS
METHODS
We propose a novel approach to provide artificial proprioceptive feedback about two degrees of freedom using a single array of 8 vibration motors (compact solution). The performance afforded by the novel method during an online closed-loop control task was compared to that achieved using the conventional approach, in which the same information was conveyed using two arrays of 8 and 4 vibromotors (one array per degree of freedom), respectively. The new method employed Gaussian interpolation to modulate the intensity profile across a single array of vibration motors (compact feedback) to convey wrist rotation and hand aperture by adjusting the mean and standard deviation of the Gaussian, respectively. Ten able-bodied participants and four transradial amputees performed a target achievement control test by utilizing pattern recognition with compact and conventional vibrotactile feedback to control the Hannes prosthetic hand (test conditions). A second group of ten able-bodied participants performed the same experiment in control conditions with visual and auditory feedback as well as no-feedback.
RESULTS
RESULTS
Conventional and compact approaches resulted in similar positioning accuracy, time and path efficiency, and total trial time. The comparison with control condition revealed that vibrational feedback was intuitive and useful, but also underlined the power of incidental feedback sources. Notably, amputee participants achieved similar performance to that of able-bodied participants.
CONCLUSIONS
CONCLUSIONS
The study therefore shows that the novel feedback strategy conveys useful information about prosthesis movements while reducing the number of motors without compromising performance. This is an important step toward the full integration of such an interface into a prosthesis socket for clinical use.
Identifiants
pubmed: 39135110
doi: 10.1186/s12984-024-01420-y
pii: 10.1186/s12984-024-01420-y
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
142Subventions
Organisme : Istituto Nazionale Assicurazione Infortuni sul Lavoro
ID : iHannes (PR19-PAS-P1)
Organisme : Istituto Nazionale Assicurazione Infortuni sul Lavoro
ID : iHannes (PR19-PAS-P1)
Organisme : Istituto Nazionale Assicurazione Infortuni sul Lavoro
ID : Dexter Hand (PR23-PAS-P1)
Informations de copyright
© 2024. The Author(s).
Références
Marinelli A et al. Active upper limb prostheses: a review on current state and upcoming breakthroughs. Progress Biomedical Eng. 2022.
Shahsavari H, et al. Upper limb amputation; Care needs for reintegration to life: an integrative review. Int J Orthop Trauma Nurs. 2020;38:100773.
doi: 10.1016/j.ijotn.2020.100773
pubmed: 32362398
Brack R, Amalu EH. A review of technology, materials and R&D challenges of upper limb prosthesis for improved user suitability. J Orthop. Jan-Feb 2021;23:88–96. https://doi.org/10.1016/j.jor.2020.12.009 .
Bates TJ, Fergason JR, Pierrie SN. Technological advances in Prosthesis Design and Rehabilitation following Upper Extremity Limb loss. Curr Rev Musculoskelet Med. 2020;13:485–93.
doi: 10.1007/s12178-020-09656-6
pubmed: 32488625
pmcid: 7340716
Psyonic. Ability Hand. https://www.psyonic.io/ability-hand (accessed).
Systems V. Vincent hand. https://www.vincentsystems.de/ (accessed).
Scaliti E, Gruppioni E, Becchio C. And yet it moves: what we currently know about Phantom Arm movements. Neuroscientist. 2020;26(4):328–42.
doi: 10.1177/1073858420904326
pubmed: 32111136
Antfolk C, D’alonzo M, Rosén B, Lundborg G, Sebelius F, Cipriani C. Sensory feedback in upper limb prosthetics. Expert Rev Med Dev. 2013;10(1):45–54.
doi: 10.1586/erd.12.68
Sensinger JW, Dosen S. A review of sensory feedback in upper-limb prostheses from the perspective of human motor control. Front NeuroSci. 2020;14.
Yildiz KA, Shin AY, Kaufman KR. Interfaces with the peripheral nervous system for the control of a neuroprosthetic limb: a review. J Neuroeng Rehabil. 2020;17(1):1–19.
doi: 10.1186/s12984-020-00667-5
Bensmaia SJ, Tyler DJ, Micera S. Restoration of sensory information via bionic hands. Nat Biomedical Eng. 2023;7(4):443–55.
doi: 10.1038/s41551-020-00630-8
Oddo CM et al. Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans. elife. 2016;5:e09148.
Iskarous MM, Thakor NV. E-skins: biomimetic sensing and encoding for upper limb prostheses. Proc IEEE. 2019;107(10):2052–64.
D’Anna E, et al. A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback. Sci Rob. 2019;4(27):eaau8892.
doi: 10.1126/scirobotics.aau8892
Raspopovic S, Valle G, Petrini FM. Sensory feedback for limb prostheses in amputees. Nat Mater. 2021;20(7):925–39.
doi: 10.1038/s41563-021-00966-9
pubmed: 33859381
Schofield JS, Dawson MR, Carey JP, Hebert JS. Characterizing the effects of amplitude, frequency and limb position on vibration induced movement illusions: implications in sensory-motor rehabilitation. Technol Health Care. 2015;23(2):129–41.
doi: 10.3233/THC-140879
pubmed: 25425585
pmcid: 4620932
Patel GK, Dosen S, Castellini C, Farina D. Multichannel electrotactile feedback for simultaneous and proportional myoelectric control. J Neural Eng. 2016;13(5):056015.
doi: 10.1088/1741-2560/13/5/056015
pubmed: 27618968
Štrbac M, et al. Integrated and flexible multichannel interface for electrotactile stimulation. J Neural Eng. 2016;13(4):046014.
doi: 10.1088/1741-2560/13/4/046014
pubmed: 27296902
Dosen S, et al. Multichannel electrotactile feedback with spatial and mixed coding for closed-loop control of grasping force in hand prostheses. IEEE Trans Neural Syst Rehabil Eng. 2016;25(3):183–95.
doi: 10.1109/TNSRE.2016.2550864
pubmed: 27071179
Osborn LE et al. Prosthesis with neuromorphic multilayered e-dermis perceives touch and pain. Sci Rob. 2018:19(3).
Horch K, Meek S, Taylor TG, Hutchinson DT. Object discrimination with an artificial hand using electrical stimulation of peripheral tactile and proprioceptive pathways with intrafascicular electrodes. IEEE Trans Neural Syst Rehabil Eng. 2011;19(5):483–9.
doi: 10.1109/TNSRE.2011.2162635
pubmed: 21859607
Nemah MN, Aldulaymi OH, Low CY, Zakaria NAC, Mohamaddan S. A hybrid haptic feedback stimulation device to recover the missing sensation of the upper limb amputees, in IOP Conference Series: Materials Science and Engineering, 2020;834(1): IOP Publishing, p. 012013.
Mamidanna P, Dideriksen JL, Dosen S. The impact of objective functions on control policies in closed-loop control of grasping force with a myoelectric prosthesis. J Neural Eng. 2021;18(5):056036.
doi: 10.1088/1741-2552/ac23c1
Kayhan O, Nennioglu AK, Samur E. A skin stretch tactor for sensory substitution of wrist proprioception. In: 2018 IEEE haptics symposium (HAPTICS). IEEE; 2018. p. 26–31.
Battaglia E, Clark JP, Bianchi M, Catalano MG, Bicchi A, O’Malley MK. Skin stretch haptic feedback to convey closure information in anthropomorphic, under-actuated upper limb soft prostheses. IEEE Trans Haptics. 2019;12(4):508–20.
doi: 10.1109/TOH.2019.2915075
pubmed: 31071053
Vargas L, Huang H, Zhu Y, Hu X. Object recognition via evoked sensory feedback during control of a prosthetic hand. IEEE Rob Autom Lett. 2021;7(1):207–14.
doi: 10.1109/LRA.2021.3122897
Cha H, An S, Choi S, Yang S, Park S, Park S. Study on Intention Recognition and sensory feedback: Control of Robotic Prosthetic Hand through EMG classification and proprioceptive feedback using rule-based Haptic device. IEEE Trans Haptics. 2022.
Luces JVS, Okabe K, Murao Y, Hirata Y. A phantom-sensation based paradigm for continuous vibrotactile wrist guidance in two-dimensional space. IEEE Rob Autom Lett. 2017;3(1):163–70.
doi: 10.1109/LRA.2017.2737480
Chaubey P, Rosenbaum-Chou T, Daly W, Boone D. Closed-loop vibratory haptic feedback in upper-limb prosthetic users. JPO: J Prosthetics Orthot. 2014;26(3):120–7.
Shi P, Shen X. Sensation feedback and muscle response of electrical stimulation on the upper limb skin: a case study. In: 2015 Seventh international conference on measuring technology and mechatronics automation. IEEE; 2015. p. 969–72.
D’Alonzo M, Dosen S, Cipriani C, Farina D. HyVE—hybrid vibro-electrotactile stimulation—is an efficient approach to multi-channel sensory feedback. IEEE Trans Haptics. 2013;7(2):181–90.
doi: 10.1109/TOH.2013.52
Clemente F, Cipriani C. A novel device for multi-modal sensory feedback in hand prosthetics: Design and preliminary prototype. In: 2014 IEEE haptics symposium (HAPTICS). IEEE; 2014. p. 569–73.
Lee J, Choi MH, Jung JH, Hammond FL. Multimodal sensory feedback for virtual proprioception in powered upper-limb prostheses. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE; 2017. p. 277–83.
Huang H, et al. Multi-modal sensory feedback system for upper limb amputees. 2017 New Generation of CAS (NGCAS). IEEE; 2017. p. 193–6.
Garenfeld MA, et al. A compact system for simultaneous stimulation and recording for closed-loop myoelectric control. J Neuroeng Rehabil. 2021;18(1):1–17.
doi: 10.1186/s12984-021-00877-5
Merletti R, Aventaggiato M, Botter A, Holobar A, Marateb H, Vieira TM. Advances in surface EMG: recent progress in detection and processing techniques. Crit Rev Biomed Eng. 2010;38(4).
Mereu F, Leone F, Gentile C, Cordella F, Gruppioni E, Zollo L. Control strategies and performance assessment of upper-limb TMR prostheses: a review. Sensors. 2021;21(6):1953.
Zheng M, Crouch MS, Eggleston MS. Surface Electromyography as a Natural Human-Machine Interface: A Review, arXiv preprint arXiv:2101.04658. 2021.
Basu T. Facebook is making a bracelet that lets you control computers with your brain. https://www.technologyreview.com/2021/03/18/1021021/facebook-augmented-reality-wristband/?truid=6d1563793eef118b900759ed00bfef6f&utm_source=the_download&utm_medium=email&utm_campaign=the_download.unpaid.engagement&utm_term=&utm_content=03-19-2021&mc_cid=f1e3644b4e&mc_eid=de470f7d14 (accessed March 18, 2021).
Shehata AW, Scheme EJ, Sensinger JW. Audible feedback improves internal model strength and performance of myoelectric prosthesis control. Sci Rep. 2018;8(1):1–10.
doi: 10.1038/s41598-018-26810-w
Shehata AW, Engels LF, Controzzi M, Cipriani C, Scheme EJ, Sensinger JW. Improving internal model strength and performance of prosthetic hands using augmented feedback. J Neuroeng Rehabil. 2018;15(1):1–12.
doi: 10.1186/s12984-018-0417-4
Controzzi M, Clemente F, Pierotti N, Bacchereti M, Cipriani C, Superiore S. Evaluation of hand function trasporting fragile objects: the virtual eggs test. In Myoelectric control symposium. New Brunswick, CA: University of Salford; 2017.
Marinelli A, et al. A Novel Method for Vibrotactile proprioceptive feedback using spatial encoding and Gaussian Interpolation. IEEE Trans Biomed Eng. Dec 2023;70:3354–65. https://doi.org/10.1109/TBME.2023.3285850 .
Laffranchi M et al. The Hannes hand prosthesis replicates the key biological properties of the human hand. Sci Rob. 2020.
Marinelli A et al. Performance evaluation of pattern recognition algorithms for upper limb prosthetic applications. In: 8th IEEE RAS/EMBS international conference for biomedical robotics and biomechatronics (BioRob). IEEE; 2020.
Ortiz-Catalan M, Håkansson B, Brånemark R. Real-time and simultaneous control of artificial limbs based on pattern recognition algorithms. IEEE Trans Neural Syst Rehabil Eng. 2014;22(4):756–64.
doi: 10.1109/TNSRE.2014.2305097
pubmed: 24710833
Koelewijn T, Bronkhorst A, Theeuwes J. Attention and the multiple stages of multisensory integration: a review of audiovisual studies. Acta Psychol. 2010;134(3):372–84.
doi: 10.1016/j.actpsy.2010.03.010
Di Domenico D et al. Hannes Prosthesis Control Based on Regression Machine Learning Algorithms, presented at the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021), 2021.
Marinelli A et al. Miniature EMG sensors for prosthetic applications. In: 2021 10th International IEEE/EMBS conference on neural engineering (NER). IEEE; 2021. p. 1022–5.
Vybronics I. VC0625B001L. https://www.vybronics.com/wp-content/uploads/datasheet-files/Vybronics-VC0625B001L-datasheet.pdf (accessed).
Gilman S. Joint position sense and vibration sense: Anatomical organisation and assessment, Journal of neurology, neurosurgery, and psychiatry. 2002;73:473–7. https://doi.org/10.1136/jnnp.73.5.473 .
Prins N. Psychophysics: a practical introduction. Academic; 2016.
Smith A, Ward-Cherrier B, Etoundi A, Pearson MJ. Evaluating multi-channel vibrational feedback arrays in a digit discrimination task. In: 2022 International symposium on electrical, electronics and information engineering (ISEEIE). IEEE; 2022. p. 202–7.
Boljanić T et al. Design of multi-pad electrotactile system envisioned as a feedback channel for supernumerary robotic limbs. Artif Organs. 2022.
Wilke MA, Niethammer C, Meyer B, Farina D, Dosen S. Psychometric characterization of incidental feedback sources during grasping with a hand prosthesis. J Neuroeng Rehabil. 2019;16(1):1–13.
doi: 10.1186/s12984-019-0622-9
Wilke MA, Hartmann C, Schimpf F, Farina D, Dosen S. The interaction between feedback type and learning in routine grasping with myoelectric prostheses. IEEE Trans Haptics. 2019;13(3):645–54.
doi: 10.1109/TOH.2019.2961652
pubmed: 31870991
Hebert JS et al. Quantitative eye gaze and movement differences in visuomotor adaptations to varying task demands among upper-extremity prosthesis users. JAMA Netw open. 2019;2(9):e1911197.
Nguyen AT et al. A Portable, Self-Contained Neuroprosthetic Hand with Deep Learning-Based Finger Control, arXiv preprint arXiv:2103.13452, 2021.
Aboseria M, Clemente F, Engels LF, Cipriani C. Discrete vibro-tactile feedback prevents object slippage in hand prostheses more intuitively than other modalities. IEEE Trans Neural Syst Rehabil Eng. 2018;26(8):1577–84.
doi: 10.1109/TNSRE.2018.2851617
pubmed: 29994712
Gasparic F et al. A novel sensory feedback approach to facilitate both predictive and corrective control of grasping force in myoelectric prostheses. IEEE Trans Neural Syst Rehabil Eng. 2023.
Earley EJ, Johnson RE, Sensinger JW, Hargrove LJ. Wrist speed feedback improves elbow compensation and reaching accuracy for myoelectric transradial prosthesis users in hybrid virtual reaching task. J Neuroeng Rehabil. 2023;20(1):9.
doi: 10.1186/s12984-023-01138-3
pubmed: 36658605
pmcid: 9850536