Vision-Guided Hand–Eye Coordination for Robotic Grasping and Its Application in Tangram Puzzles

In this study we present an autonomous grasping system that uses a vision-guided hand–eye coordination policy with closed-loop vision-based control to ensure a sufficient task success rate while maintaining acceptable manipulation precision. When facing a diversity of tasks with complex environments...

وصف كامل

التفاصيل البيبلوغرافية
الحاوية / القاعدة:AI
المؤلفون الرئيسيون: Hui Wei, Sicong Pan, Gang Ma, Xiao Duan
التنسيق: مقال
اللغة:الإنجليزية
منشور في: MDPI AG 2021-05-01
الموضوعات:
الوصول للمادة أونلاين:https://www.mdpi.com/2673-2688/2/2/13
_version_ 1850330410423156736
author Hui Wei
Sicong Pan
Gang Ma
Xiao Duan
author_facet Hui Wei
Sicong Pan
Gang Ma
Xiao Duan
author_sort Hui Wei
collection DOAJ
container_title AI
description In this study we present an autonomous grasping system that uses a vision-guided hand–eye coordination policy with closed-loop vision-based control to ensure a sufficient task success rate while maintaining acceptable manipulation precision. When facing a diversity of tasks with complex environments, an autonomous robot should use the concept of task precision, including the accuracy of perception and precision of manipulation, as opposed to just the grasping success rate typically used in previous works. Task precision combines the advantages of grasping behaviors observed in humans and a grasping method applied in existing works. A visual servoing approach and a subtask decomposition strategy are proposed here to obtain the desired level of task precision. Our system performs satisfactorily on a tangram puzzle task. The experiments highlight the accuracy of perception, precision of manipulation, and robustness of the system. Moreover, the system is of great significance for improving the adaptability and flexibility of autonomous robots.
format Article
id doaj-art-bb3dd3d5c50c4b5d8a5bc69e199fca1b
institution Directory of Open Access Journals
issn 2673-2688
language English
publishDate 2021-05-01
publisher MDPI AG
record_format Article
spelling doaj-art-bb3dd3d5c50c4b5d8a5bc69e199fca1b2025-08-19T23:18:25ZengMDPI AGAI2673-26882021-05-012220922810.3390/ai2020013Vision-Guided Hand–Eye Coordination for Robotic Grasping and Its Application in Tangram PuzzlesHui Wei0Sicong Pan1Gang Ma2Xiao Duan3Laboratory of Algorithms for Cognitive Models, School of Computer Science and Technology, Fudan University, Shanghai 200433, ChinaLaboratory of Algorithms for Cognitive Models, School of Computer Science and Technology, Fudan University, Shanghai 200433, ChinaLaboratory of Algorithms for Cognitive Models, School of Computer Science and Technology, Fudan University, Shanghai 200433, ChinaLaboratory of Algorithms for Cognitive Models, School of Computer Science and Technology, Fudan University, Shanghai 200433, ChinaIn this study we present an autonomous grasping system that uses a vision-guided hand–eye coordination policy with closed-loop vision-based control to ensure a sufficient task success rate while maintaining acceptable manipulation precision. When facing a diversity of tasks with complex environments, an autonomous robot should use the concept of task precision, including the accuracy of perception and precision of manipulation, as opposed to just the grasping success rate typically used in previous works. Task precision combines the advantages of grasping behaviors observed in humans and a grasping method applied in existing works. A visual servoing approach and a subtask decomposition strategy are proposed here to obtain the desired level of task precision. Our system performs satisfactorily on a tangram puzzle task. The experiments highlight the accuracy of perception, precision of manipulation, and robustness of the system. Moreover, the system is of great significance for improving the adaptability and flexibility of autonomous robots.https://www.mdpi.com/2673-2688/2/2/13robotic graspingvision-guidedhand–eye coordination
spellingShingle Hui Wei
Sicong Pan
Gang Ma
Xiao Duan
Vision-Guided Hand–Eye Coordination for Robotic Grasping and Its Application in Tangram Puzzles
robotic grasping
vision-guided
hand–eye coordination
title Vision-Guided Hand–Eye Coordination for Robotic Grasping and Its Application in Tangram Puzzles
title_full Vision-Guided Hand–Eye Coordination for Robotic Grasping and Its Application in Tangram Puzzles
title_fullStr Vision-Guided Hand–Eye Coordination for Robotic Grasping and Its Application in Tangram Puzzles
title_full_unstemmed Vision-Guided Hand–Eye Coordination for Robotic Grasping and Its Application in Tangram Puzzles
title_short Vision-Guided Hand–Eye Coordination for Robotic Grasping and Its Application in Tangram Puzzles
title_sort vision guided hand eye coordination for robotic grasping and its application in tangram puzzles
topic robotic grasping
vision-guided
hand–eye coordination
url https://www.mdpi.com/2673-2688/2/2/13
work_keys_str_mv AT huiwei visionguidedhandeyecoordinationforroboticgraspinganditsapplicationintangrampuzzles
AT sicongpan visionguidedhandeyecoordinationforroboticgraspinganditsapplicationintangrampuzzles
AT gangma visionguidedhandeyecoordinationforroboticgraspinganditsapplicationintangrampuzzles
AT xiaoduan visionguidedhandeyecoordinationforroboticgraspinganditsapplicationintangrampuzzles