Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection

Various types of numerical control (NC) machine tools can be standardly operated and controlled based on NC data that can be easily generated using widespread CAD/CAM systems. On the other hand, the operation environments of industrial robots still depend on conventional teaching and playback system...

وصف كامل

التفاصيل البيبلوغرافية
الحاوية / القاعدة:Machines
المؤلفون الرئيسيون: Fusaomi Nagata, Ryoma Abe, Shingo Sakata, Keigo Watanabe, Maki K. Habib
التنسيق: مقال
اللغة:الإنجليزية
منشور في: MDPI AG 2024-10-01
الموضوعات:
الوصول للمادة أونلاين:https://www.mdpi.com/2075-1702/12/11/757
_version_ 1849717941752299520
author Fusaomi Nagata
Ryoma Abe
Shingo Sakata
Keigo Watanabe
Maki K. Habib
author_facet Fusaomi Nagata
Ryoma Abe
Shingo Sakata
Keigo Watanabe
Maki K. Habib
author_sort Fusaomi Nagata
collection DOAJ
container_title Machines
description Various types of numerical control (NC) machine tools can be standardly operated and controlled based on NC data that can be easily generated using widespread CAD/CAM systems. On the other hand, the operation environments of industrial robots still depend on conventional teaching and playback systems provided by the makers, so it seems that they have not been standardized and unified like NC machine tools yet. Additionally, robotic functional extensions, e.g., the easy implementation of a machine learning model, such as a convolutional neural network (CNN), a visual feedback controller, cooperative control for multiple robots, and so on, has not been sufficiently realized yet. In this paper, a hyper cutter location source (HCLS)-data-based robotic interface is proposed to cope with the issues. Due to the HCLS-data-based robot interface, the robotic control sequence can be visually and unifiedly described as NC codes. In addition, a VGG19-based CNN model for defect detection, whose classification accuracy is over 99% and average time for forward calculation is 70 ms, can be systematically incorporated into a robotic control application that handles multiple robots. The effectiveness and validity of the proposed system are demonstrated through a cooperative pick and place task using three small-sized industrial robot MG400s and a peg-in-hole task while checking undesirable defects in workpieces with a CNN model without using any programmable logic controller (PLC). The specifications of the PC used for the experiments are CPU: Intel(R) Core(TM) i9-10850K CPU 3.60 GHz, GPU: NVIDIA GeForce RTX 3090, Main memory: 64 GB.
format Article
id doaj-art-e22339881dd44b00a572669af7a0da70
institution Directory of Open Access Journals
issn 2075-1702
language English
publishDate 2024-10-01
publisher MDPI AG
record_format Article
spelling doaj-art-e22339881dd44b00a572669af7a0da702025-08-20T01:54:02ZengMDPI AGMachines2075-17022024-10-01121175710.3390/machines12110757Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect DetectionFusaomi Nagata0Ryoma Abe1Shingo Sakata2Keigo Watanabe3Maki K. Habib4Graduate School of Engineering, Sanyo-Onoda City University, Sanyo-Onoda 756-0884, JapanGraduate School of Engineering, Sanyo-Onoda City University, Sanyo-Onoda 756-0884, JapanGraduate School of Engineering, Sanyo-Onoda City University, Sanyo-Onoda 756-0884, JapanGraduate School of Environmental, Life, Natural Science and Technology, Okayama University, Okayama 700-8530, JapanMechanical Engineering Department, SSE, The American University in Cairo, New Cairo 11835, EgyptVarious types of numerical control (NC) machine tools can be standardly operated and controlled based on NC data that can be easily generated using widespread CAD/CAM systems. On the other hand, the operation environments of industrial robots still depend on conventional teaching and playback systems provided by the makers, so it seems that they have not been standardized and unified like NC machine tools yet. Additionally, robotic functional extensions, e.g., the easy implementation of a machine learning model, such as a convolutional neural network (CNN), a visual feedback controller, cooperative control for multiple robots, and so on, has not been sufficiently realized yet. In this paper, a hyper cutter location source (HCLS)-data-based robotic interface is proposed to cope with the issues. Due to the HCLS-data-based robot interface, the robotic control sequence can be visually and unifiedly described as NC codes. In addition, a VGG19-based CNN model for defect detection, whose classification accuracy is over 99% and average time for forward calculation is 70 ms, can be systematically incorporated into a robotic control application that handles multiple robots. The effectiveness and validity of the proposed system are demonstrated through a cooperative pick and place task using three small-sized industrial robot MG400s and a peg-in-hole task while checking undesirable defects in workpieces with a CNN model without using any programmable logic controller (PLC). The specifications of the PC used for the experiments are CPU: Intel(R) Core(TM) i9-10850K CPU 3.60 GHz, GPU: NVIDIA GeForce RTX 3090, Main memory: 64 GB.https://www.mdpi.com/2075-1702/12/11/757industrial robotHCLS datasequence controlcooperative controlwithout PLCpeg-in-hole task
spellingShingle Fusaomi Nagata
Ryoma Abe
Shingo Sakata
Keigo Watanabe
Maki K. Habib
Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection
industrial robot
HCLS data
sequence control
cooperative control
without PLC
peg-in-hole task
title Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection
title_full Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection
title_fullStr Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection
title_full_unstemmed Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection
title_short Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection
title_sort hyper cls data based robotic interface and its application to intelligent peg in hole task robot incorporating a cnn model for defect detection
topic industrial robot
HCLS data
sequence control
cooperative control
without PLC
peg-in-hole task
url https://www.mdpi.com/2075-1702/12/11/757
work_keys_str_mv AT fusaominagata hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection
AT ryomaabe hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection
AT shingosakata hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection
AT keigowatanabe hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection
AT makikhabib hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection