Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection
Various types of numerical control (NC) machine tools can be standardly operated and controlled based on NC data that can be easily generated using widespread CAD/CAM systems. On the other hand, the operation environments of industrial robots still depend on conventional teaching and playback system...
| الحاوية / القاعدة: | Machines |
|---|---|
| المؤلفون الرئيسيون: | , , , , |
| التنسيق: | مقال |
| اللغة: | الإنجليزية |
| منشور في: |
MDPI AG
2024-10-01
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | https://www.mdpi.com/2075-1702/12/11/757 |
| _version_ | 1849717941752299520 |
|---|---|
| author | Fusaomi Nagata Ryoma Abe Shingo Sakata Keigo Watanabe Maki K. Habib |
| author_facet | Fusaomi Nagata Ryoma Abe Shingo Sakata Keigo Watanabe Maki K. Habib |
| author_sort | Fusaomi Nagata |
| collection | DOAJ |
| container_title | Machines |
| description | Various types of numerical control (NC) machine tools can be standardly operated and controlled based on NC data that can be easily generated using widespread CAD/CAM systems. On the other hand, the operation environments of industrial robots still depend on conventional teaching and playback systems provided by the makers, so it seems that they have not been standardized and unified like NC machine tools yet. Additionally, robotic functional extensions, e.g., the easy implementation of a machine learning model, such as a convolutional neural network (CNN), a visual feedback controller, cooperative control for multiple robots, and so on, has not been sufficiently realized yet. In this paper, a hyper cutter location source (HCLS)-data-based robotic interface is proposed to cope with the issues. Due to the HCLS-data-based robot interface, the robotic control sequence can be visually and unifiedly described as NC codes. In addition, a VGG19-based CNN model for defect detection, whose classification accuracy is over 99% and average time for forward calculation is 70 ms, can be systematically incorporated into a robotic control application that handles multiple robots. The effectiveness and validity of the proposed system are demonstrated through a cooperative pick and place task using three small-sized industrial robot MG400s and a peg-in-hole task while checking undesirable defects in workpieces with a CNN model without using any programmable logic controller (PLC). The specifications of the PC used for the experiments are CPU: Intel(R) Core(TM) i9-10850K CPU 3.60 GHz, GPU: NVIDIA GeForce RTX 3090, Main memory: 64 GB. |
| format | Article |
| id | doaj-art-e22339881dd44b00a572669af7a0da70 |
| institution | Directory of Open Access Journals |
| issn | 2075-1702 |
| language | English |
| publishDate | 2024-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| spelling | doaj-art-e22339881dd44b00a572669af7a0da702025-08-20T01:54:02ZengMDPI AGMachines2075-17022024-10-01121175710.3390/machines12110757Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect DetectionFusaomi Nagata0Ryoma Abe1Shingo Sakata2Keigo Watanabe3Maki K. Habib4Graduate School of Engineering, Sanyo-Onoda City University, Sanyo-Onoda 756-0884, JapanGraduate School of Engineering, Sanyo-Onoda City University, Sanyo-Onoda 756-0884, JapanGraduate School of Engineering, Sanyo-Onoda City University, Sanyo-Onoda 756-0884, JapanGraduate School of Environmental, Life, Natural Science and Technology, Okayama University, Okayama 700-8530, JapanMechanical Engineering Department, SSE, The American University in Cairo, New Cairo 11835, EgyptVarious types of numerical control (NC) machine tools can be standardly operated and controlled based on NC data that can be easily generated using widespread CAD/CAM systems. On the other hand, the operation environments of industrial robots still depend on conventional teaching and playback systems provided by the makers, so it seems that they have not been standardized and unified like NC machine tools yet. Additionally, robotic functional extensions, e.g., the easy implementation of a machine learning model, such as a convolutional neural network (CNN), a visual feedback controller, cooperative control for multiple robots, and so on, has not been sufficiently realized yet. In this paper, a hyper cutter location source (HCLS)-data-based robotic interface is proposed to cope with the issues. Due to the HCLS-data-based robot interface, the robotic control sequence can be visually and unifiedly described as NC codes. In addition, a VGG19-based CNN model for defect detection, whose classification accuracy is over 99% and average time for forward calculation is 70 ms, can be systematically incorporated into a robotic control application that handles multiple robots. The effectiveness and validity of the proposed system are demonstrated through a cooperative pick and place task using three small-sized industrial robot MG400s and a peg-in-hole task while checking undesirable defects in workpieces with a CNN model without using any programmable logic controller (PLC). The specifications of the PC used for the experiments are CPU: Intel(R) Core(TM) i9-10850K CPU 3.60 GHz, GPU: NVIDIA GeForce RTX 3090, Main memory: 64 GB.https://www.mdpi.com/2075-1702/12/11/757industrial robotHCLS datasequence controlcooperative controlwithout PLCpeg-in-hole task |
| spellingShingle | Fusaomi Nagata Ryoma Abe Shingo Sakata Keigo Watanabe Maki K. Habib Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection industrial robot HCLS data sequence control cooperative control without PLC peg-in-hole task |
| title | Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection |
| title_full | Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection |
| title_fullStr | Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection |
| title_full_unstemmed | Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection |
| title_short | Hyper CLS-Data-Based Robotic Interface and Its Application to Intelligent Peg-in-Hole Task Robot Incorporating a CNN Model for Defect Detection |
| title_sort | hyper cls data based robotic interface and its application to intelligent peg in hole task robot incorporating a cnn model for defect detection |
| topic | industrial robot HCLS data sequence control cooperative control without PLC peg-in-hole task |
| url | https://www.mdpi.com/2075-1702/12/11/757 |
| work_keys_str_mv | AT fusaominagata hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection AT ryomaabe hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection AT shingosakata hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection AT keigowatanabe hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection AT makikhabib hyperclsdatabasedroboticinterfaceanditsapplicationtointelligentpeginholetaskrobotincorporatingacnnmodelfordefectdetection |
