Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel
The appropriate sensory information feedback is important for the success of an object grasping and manipulation task. In many scenarios, the need arises for multiple feedback information to be conveyed to a prosthetic hand user simultaneously. The multiple sets of information may either (1) directl...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2020-04-01
|
Series: | Frontiers in Neuroscience |
Subjects: | |
Online Access: | https://www.frontiersin.org/article/10.3389/fnins.2020.00348/full |
id |
doaj-63ab3749809d45f3a01c5ba70534941b |
---|---|
record_format |
Article |
spelling |
doaj-63ab3749809d45f3a01c5ba70534941b2020-11-25T03:27:51ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2020-04-011410.3389/fnins.2020.00348497004Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback ChannelRaphael M. Mayer0Ricardo Garcia-Rosas1Alireza Mohammadi2Ying Tan3Gursel Alici4Gursel Alici5Peter Choong6Peter Choong7Denny Oetomo8Denny Oetomo9Human Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaHuman Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaHuman Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaHuman Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaSchool of Mechanical, Materials, Mechatronic and Biomedical Engineering, University of Wollongong, Wollongong, NSW, AustraliaARC Centre of Excellence for Electromaterials Science, Wollongong, NSW, AustraliaARC Centre of Excellence for Electromaterials Science, Wollongong, NSW, AustraliaDepartment of Surgery, St. Vincent's Hospital, The University of Melbourne, Parkville, VIC, AustraliaHuman Robotics Laboratory, Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, AustraliaARC Centre of Excellence for Electromaterials Science, Wollongong, NSW, AustraliaThe appropriate sensory information feedback is important for the success of an object grasping and manipulation task. In many scenarios, the need arises for multiple feedback information to be conveyed to a prosthetic hand user simultaneously. The multiple sets of information may either (1) directly contribute to the performance of the grasping or object manipulation task, such as the feedback of the grasping force, or (2) simply form additional independent set(s) of information. In this paper, the efficacy of simultaneously conveying two independent sets of sensor information (the grasp force and a secondary set of information) through a single channel of feedback stimulation (vibrotactile via bone conduction) to the human user in a prosthetic application is investigated. The performance of the grasping task is not dependent to the second set of information in this study. Subject performance in two tasks: regulating the grasp force and identifying the secondary information, were evaluated when provided with either one corresponding information or both sets of feedback information. Visual feedback is involved in the training stage. The proposed approach is validated on human-subject experiments using a vibrotactile transducer worn on the elbow bony landmark (to realize a non-invasive bone conduction interface) carried out in a virtual reality environment to perform a closed-loop object grasping task. The experimental results show that the performance of the human subjects on either task, whilst perceiving two sets of sensory information, is not inferior to that when receiving only one set of corresponding sensory information, demonstrating the potential of conveying a second set of information through a bone conduction interface in an upper limb prosthetic task.https://www.frontiersin.org/article/10.3389/fnins.2020.00348/fullneuroprosthesessensory feedback restorationhuman-robot interactiontactile feedbackbone conduction |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Raphael M. Mayer Ricardo Garcia-Rosas Alireza Mohammadi Ying Tan Gursel Alici Gursel Alici Peter Choong Peter Choong Denny Oetomo Denny Oetomo |
spellingShingle |
Raphael M. Mayer Ricardo Garcia-Rosas Alireza Mohammadi Ying Tan Gursel Alici Gursel Alici Peter Choong Peter Choong Denny Oetomo Denny Oetomo Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel Frontiers in Neuroscience neuroprostheses sensory feedback restoration human-robot interaction tactile feedback bone conduction |
author_facet |
Raphael M. Mayer Ricardo Garcia-Rosas Alireza Mohammadi Ying Tan Gursel Alici Gursel Alici Peter Choong Peter Choong Denny Oetomo Denny Oetomo |
author_sort |
Raphael M. Mayer |
title |
Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel |
title_short |
Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel |
title_full |
Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel |
title_fullStr |
Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel |
title_full_unstemmed |
Tactile Feedback in Closed-Loop Control of Myoelectric Hand Grasping: Conveying Information of Multiple Sensors Simultaneously via a Single Feedback Channel |
title_sort |
tactile feedback in closed-loop control of myoelectric hand grasping: conveying information of multiple sensors simultaneously via a single feedback channel |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Neuroscience |
issn |
1662-453X |
publishDate |
2020-04-01 |
description |
The appropriate sensory information feedback is important for the success of an object grasping and manipulation task. In many scenarios, the need arises for multiple feedback information to be conveyed to a prosthetic hand user simultaneously. The multiple sets of information may either (1) directly contribute to the performance of the grasping or object manipulation task, such as the feedback of the grasping force, or (2) simply form additional independent set(s) of information. In this paper, the efficacy of simultaneously conveying two independent sets of sensor information (the grasp force and a secondary set of information) through a single channel of feedback stimulation (vibrotactile via bone conduction) to the human user in a prosthetic application is investigated. The performance of the grasping task is not dependent to the second set of information in this study. Subject performance in two tasks: regulating the grasp force and identifying the secondary information, were evaluated when provided with either one corresponding information or both sets of feedback information. Visual feedback is involved in the training stage. The proposed approach is validated on human-subject experiments using a vibrotactile transducer worn on the elbow bony landmark (to realize a non-invasive bone conduction interface) carried out in a virtual reality environment to perform a closed-loop object grasping task. The experimental results show that the performance of the human subjects on either task, whilst perceiving two sets of sensory information, is not inferior to that when receiving only one set of corresponding sensory information, demonstrating the potential of conveying a second set of information through a bone conduction interface in an upper limb prosthetic task. |
topic |
neuroprostheses sensory feedback restoration human-robot interaction tactile feedback bone conduction |
url |
https://www.frontiersin.org/article/10.3389/fnins.2020.00348/full |
work_keys_str_mv |
AT raphaelmmayer tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT ricardogarciarosas tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT alirezamohammadi tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT yingtan tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT gurselalici tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT gurselalici tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT peterchoong tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT peterchoong tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT dennyoetomo tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel AT dennyoetomo tactilefeedbackinclosedloopcontrolofmyoelectrichandgraspingconveyinginformationofmultiplesensorssimultaneouslyviaasinglefeedbackchannel |
_version_ |
1724586749712138240 |