Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel

The appropriate sensory information feedback is important for the success of an object grasping and manipulation task. In many scenarios, the need arises for multiple feedback information to be conveyed to a prosthetic hand user simultaneously. The multiple sets of information may either (1) directl...

Full description

Bibliographic Details
Main Authors: Raphael M. Mayer, Ricardo Garcia-Rosas, Alireza Mohammadi, Ying Tan, Gursel Alici, Peter Choong, Denny Oetomo
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-04-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fnins.2020.00348/full
id doaj-63ab3749809d45f3a01c5ba70534941b
record_format Article
spelling doaj-63ab3749809d45f3a01c5ba70534941b2020-11-25T03:27:51ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2020-04-011410.3389/fnins.2020.00348497004Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback ChannelRaphael M. Mayer0Ricardo Garcia-Rosas1Alireza Mohammadi2Ying Tan3Gursel Alici4Gursel Alici5Peter Choong6Peter Choong7Denny Oetomo8Denny Oetomo9Human Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaHuman Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaHuman Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaHuman Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaSchool of Mechanical, Materials, Mechatronic and Biomedical Engineering, University of Wollongong, Wollongong, NSW, AustraliaARC Centre of Excellence for Electromaterials Science, Wollongong, NSW, AustraliaARC Centre of Excellence for Electromaterials Science, Wollongong, NSW, AustraliaDepartment of Surgery, St. Vincent's Hospital, The University of Melbourne, Parkville, VIC, AustraliaHuman Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaARC Centre of Excellence for Electromaterials Science, Wollongong, NSW, AustraliaThe appropriate sensory information feedback is important for the success of an object grasping and manipulation task. In many scenarios, the need arises for multiple feedback information to be conveyed to a prosthetic hand user simultaneously. The multiple sets of information may either (1) directly contribute to the performance of the grasping or object manipulation task, such as the feedback of the grasping force, or (2) simply form additional independent set(s) of information. In this paper, the efficacy of simultaneously conveying two independent sets of sensor information (the grasp force and a secondary set of information) through a single channel of feedback stimulation (vibrotactile via bone conduction) to the human user in a prosthetic application is investigated. The performance of the grasping task is not dependent to the second set of information in this study. Subject performance in two tasks: regulating the grasp force and identifying the secondary information, were evaluated when provided with either one corresponding information or both sets of feedback information. Visual feedback is involved in the training stage. The proposed approach is validated on human-subject experiments using a vibrotactile transducer worn on the elbow bony landmark (to realize a non-invasive bone conduction interface) carried out in a virtual reality environment to perform a closed-loop object grasping task. The experimental results show that the performance of the human subjects on either task, whilst perceiving two sets of sensory information, is not inferior to that when receiving only one set of corresponding sensory information, demonstrating the potential of conveying a second set of information through a bone conduction interface in an upper limb prosthetic task.https://www.frontiersin.org/article/10.3389/fnins.2020.00348/fullneuroprosthesessensory feedback restorationhuman-robot interactiontactile feedbackbone conduction
collection DOAJ
language English
format Article
sources DOAJ
author Raphael M. Mayer
Ricardo Garcia-Rosas
Alireza Mohammadi
Ying Tan
Gursel Alici
Gursel Alici
Peter Choong
Peter Choong
Denny Oetomo
Denny Oetomo
spellingShingle Raphael M. Mayer
Ricardo Garcia-Rosas
Alireza Mohammadi
Ying Tan
Gursel Alici
Gursel Alici
Peter Choong
Peter Choong
Denny Oetomo
Denny Oetomo
Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel
Frontiers in Neuroscience
neuroprostheses
sensory feedback restoration
human-robot interaction
tactile feedback
bone conduction
author_facet Raphael M. Mayer
Ricardo Garcia-Rosas
Alireza Mohammadi
Ying Tan
Gursel Alici
Gursel Alici
Peter Choong
Peter Choong
Denny Oetomo
Denny Oetomo
author_sort Raphael M. Mayer
title Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel
title_short Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel
title_full Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel
title_fullStr Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel
title_full_unstemmed Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel
title_sort tactile feedback in closed-loop control of myoelectric hand grasping: conveying information of multiple sensors simultaneously via a single feedback channel
publisher Frontiers Media S.A.
series Frontiers in Neuroscience
issn 1662-453X
publishDate 2020-04-01
description The appropriate sensory information feedback is important for the success of an object grasping and manipulation task. In many scenarios, the need arises for multiple feedback information to be conveyed to a prosthetic hand user simultaneously. The multiple sets of information may either (1) directly contribute to the performance of the grasping or object manipulation task, such as the feedback of the grasping force, or (2) simply form additional independent set(s) of information. In this paper, the efficacy of simultaneously conveying two independent sets of sensor information (the grasp force and a secondary set of information) through a single channel of feedback stimulation (vibrotactile via bone conduction) to the human user in a prosthetic application is investigated. The performance of the grasping task is not dependent to the second set of information in this study. Subject performance in two tasks: regulating the grasp force and identifying the secondary information, were evaluated when provided with either one corresponding information or both sets of feedback information. Visual feedback is involved in the training stage. The proposed approach is validated on human-subject experiments using a vibrotactile transducer worn on the elbow bony landmark (to realize a non-invasive bone conduction interface) carried out in a virtual reality environment to perform a closed-loop object grasping task. The experimental results show that the performance of the human subjects on either task, whilst perceiving two sets of sensory information, is not inferior to that when receiving only one set of corresponding sensory information, demonstrating the potential of conveying a second set of information through a bone conduction interface in an upper limb prosthetic task.
topic neuroprostheses
sensory feedback restoration
human-robot interaction
tactile feedback
bone conduction
url https://www.frontiersin.org/article/10.3389/fnins.2020.00348/full
work_keys_str_mv AT raphaelmmayer tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT ricardogarciarosas tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT alirezamohammadi tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT yingtan tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT gurselalici tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT gurselalici tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT peterchoong tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT peterchoong tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT dennyoetomo tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
AT dennyoetomo tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel
_version_ 1724586749712138240