Study on Comprehensive Calibration and Image Sieving for Coal-Gangue Separation Parallel Robot

Online sorting robots based on image recognition are key pieces of equipment for the intelligent washing of coal mines. In this paper, a Delta-type, coal gangue sorting, parallel robot is designed to automatically identify and sort scattered coal and gangue on conveyor belts by configuring the image...

Full description

Bibliographic Details
Main Authors: Deyong Shang, Yuwei Wang, Zhiyuan Yang, Junjie Wang, Yue Liu
Format: Article
Language:English
Published: MDPI AG 2020-10-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/10/20/7059
id doaj-6351ef185e764db2941649b91db99b95
record_format Article
spelling doaj-6351ef185e764db2941649b91db99b952020-11-25T04:00:24ZengMDPI AGApplied Sciences2076-34172020-10-01107059705910.3390/app10207059Study on Comprehensive Calibration and Image Sieving for Coal-Gangue Separation Parallel RobotDeyong Shang0Yuwei Wang1Zhiyuan Yang2Junjie Wang3Yue Liu4School of Mechanical Electronic and Information Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaSchool of Mechanical Electronic and Information Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaSchool of Mechanical Electronic and Information Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaSchool of Mechanical Electronic and Information Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaDepartment of Mechanical Engineering, Tsinghua University, Beijing 100084, ChinaOnline sorting robots based on image recognition are key pieces of equipment for the intelligent washing of coal mines. In this paper, a Delta-type, coal gangue sorting, parallel robot is designed to automatically identify and sort scattered coal and gangue on conveyor belts by configuring the image recognition system. Robot calibration technology can reduce the influence of installation error on system accuracy and provides the basis for the robot to accurately track and grab gangue. Due to the fact that the angle deflection error between the conveyor belt coordinate system and the robot coordinate system is not considered in the traditional conveyor belt calibration method, an improved comprehensive calibration method is put forward in this paper. Firstly, the working principle and image recognition and positioning process of the Delta coal gangue sorting robot are introduced. The scale factor parameter <i>Factor</i><sub>c</sub> of the conveyor encoder is adopted to characterize the relationship between the moving distance of the conveyor and the encoder. The conveyor belt calibration experiment is described in detail. The transformation matrix between the camera, the conveyor belt, and the robot are obtained after establishment of the three respective coordinate systems. The experimental results show that the maximum cumulative deviation of traditional calibration method is 13.841 mm and the comprehensive calibration method is 3.839 mm. The main innovation of the comprehensive calibration is such that the accurate position of each coordinate in the robot coordinate system can be determined. This comprehensive calibration method is simple and feasible, and can effectively improve system calibration accuracy and reduce robot installation error on the grasping accuracy. Moreover, a calculation method to eliminate duplicate images is put forward, with the frame rate of the vision system set at seven frames per second to avoid image repetition acquisition and missing images. The experimental results show that this calculation method effectively improves the processing efficiency of the recognition system, thereby meeting the demands of the grab precision of coal gangue separation engineering. The goal revolving around “safety with few people and safety with none” can therefore be achieved in coal gangue sorting using robots.https://www.mdpi.com/2076-3417/10/20/7059coal and gangue separationparallel robotcomprehensive calibrationimage sieving
collection DOAJ
language English
format Article
sources DOAJ
author Deyong Shang
Yuwei Wang
Zhiyuan Yang
Junjie Wang
Yue Liu
spellingShingle Deyong Shang
Yuwei Wang
Zhiyuan Yang
Junjie Wang
Yue Liu
Study on Comprehensive Calibration and Image Sieving for Coal-Gangue Separation Parallel Robot
Applied Sciences
coal and gangue separation
parallel robot
comprehensive calibration
image sieving
author_facet Deyong Shang
Yuwei Wang
Zhiyuan Yang
Junjie Wang
Yue Liu
author_sort Deyong Shang
title Study on Comprehensive Calibration and Image Sieving for Coal-Gangue Separation Parallel Robot
title_short Study on Comprehensive Calibration and Image Sieving for Coal-Gangue Separation Parallel Robot
title_full Study on Comprehensive Calibration and Image Sieving for Coal-Gangue Separation Parallel Robot
title_fullStr Study on Comprehensive Calibration and Image Sieving for Coal-Gangue Separation Parallel Robot
title_full_unstemmed Study on Comprehensive Calibration and Image Sieving for Coal-Gangue Separation Parallel Robot
title_sort study on comprehensive calibration and image sieving for coal-gangue separation parallel robot
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2020-10-01
description Online sorting robots based on image recognition are key pieces of equipment for the intelligent washing of coal mines. In this paper, a Delta-type, coal gangue sorting, parallel robot is designed to automatically identify and sort scattered coal and gangue on conveyor belts by configuring the image recognition system. Robot calibration technology can reduce the influence of installation error on system accuracy and provides the basis for the robot to accurately track and grab gangue. Due to the fact that the angle deflection error between the conveyor belt coordinate system and the robot coordinate system is not considered in the traditional conveyor belt calibration method, an improved comprehensive calibration method is put forward in this paper. Firstly, the working principle and image recognition and positioning process of the Delta coal gangue sorting robot are introduced. The scale factor parameter <i>Factor</i><sub>c</sub> of the conveyor encoder is adopted to characterize the relationship between the moving distance of the conveyor and the encoder. The conveyor belt calibration experiment is described in detail. The transformation matrix between the camera, the conveyor belt, and the robot are obtained after establishment of the three respective coordinate systems. The experimental results show that the maximum cumulative deviation of traditional calibration method is 13.841 mm and the comprehensive calibration method is 3.839 mm. The main innovation of the comprehensive calibration is such that the accurate position of each coordinate in the robot coordinate system can be determined. This comprehensive calibration method is simple and feasible, and can effectively improve system calibration accuracy and reduce robot installation error on the grasping accuracy. Moreover, a calculation method to eliminate duplicate images is put forward, with the frame rate of the vision system set at seven frames per second to avoid image repetition acquisition and missing images. The experimental results show that this calculation method effectively improves the processing efficiency of the recognition system, thereby meeting the demands of the grab precision of coal gangue separation engineering. The goal revolving around “safety with few people and safety with none” can therefore be achieved in coal gangue sorting using robots.
topic coal and gangue separation
parallel robot
comprehensive calibration
image sieving
url https://www.mdpi.com/2076-3417/10/20/7059
work_keys_str_mv AT deyongshang studyoncomprehensivecalibrationandimagesievingforcoalgangueseparationparallelrobot
AT yuweiwang studyoncomprehensivecalibrationandimagesievingforcoalgangueseparationparallelrobot
AT zhiyuanyang studyoncomprehensivecalibrationandimagesievingforcoalgangueseparationparallelrobot
AT junjiewang studyoncomprehensivecalibrationandimagesievingforcoalgangueseparationparallelrobot
AT yueliu studyoncomprehensivecalibrationandimagesievingforcoalgangueseparationparallelrobot
_version_ 1724450770404769792