TY - JOUR
T1 - Automation of SME production with a Cobot system powered by learning-based vision
AU - Yang, Xingyu
AU - Zhou, Zhengxue
AU - Sørensen, Jonas H.
AU - Christensen, Christoffer B.
AU - Ünalan, Mikail
AU - Zhang, Xuping
N1 - Publisher Copyright:
© 2023 The Author(s)
PY - 2023/10
Y1 - 2023/10
N2 - The features of collaborative robots (cobots), like lightweight, easy programming, and flexibility, meet the production automation requirements in SMEs. However, SME productions are usually in semi-structured or cluttered environments, which raises major challenges in implementing cobot systems in SME production, for instance, increasing the visual perception of cobots, handling diverse tasks, and fast deploying cobot systems, etc. Therefore, we propose an automation framework for SME production by addressing these challenges with cobots to facilitate their production. First, the learning-based vision system is developed and implemented with the You Only Look Once (YOLOv5) for object detection, and with the Convolutional Neural Network cascaded with a Support Vector Machine (CNN-SVM) for quality control of products. Then, the multi-functional gripper system is designed and fabricated to be capable of performing multiple operations and tasks without tool changing, and be able to tolerate a certain level of changes in the environment. After that, a digital twin of the robotic system is developed, which enables the system developer to save time in troubleshooting and debugging, and the customers to have a customized model with all the elements and functions required before system deployment. Finally, the onsite testing of the integrated system is conducted in collaboration with our SME industrial partner, and the test results show that the cobot system can perform the automated production process well and accurately. It is feasible to extend the application of such a cobot system to other SME productions.
AB - The features of collaborative robots (cobots), like lightweight, easy programming, and flexibility, meet the production automation requirements in SMEs. However, SME productions are usually in semi-structured or cluttered environments, which raises major challenges in implementing cobot systems in SME production, for instance, increasing the visual perception of cobots, handling diverse tasks, and fast deploying cobot systems, etc. Therefore, we propose an automation framework for SME production by addressing these challenges with cobots to facilitate their production. First, the learning-based vision system is developed and implemented with the You Only Look Once (YOLOv5) for object detection, and with the Convolutional Neural Network cascaded with a Support Vector Machine (CNN-SVM) for quality control of products. Then, the multi-functional gripper system is designed and fabricated to be capable of performing multiple operations and tasks without tool changing, and be able to tolerate a certain level of changes in the environment. After that, a digital twin of the robotic system is developed, which enables the system developer to save time in troubleshooting and debugging, and the customers to have a customized model with all the elements and functions required before system deployment. Finally, the onsite testing of the integrated system is conducted in collaboration with our SME industrial partner, and the test results show that the cobot system can perform the automated production process well and accurately. It is feasible to extend the application of such a cobot system to other SME productions.
KW - Collaborative robot
KW - Digital twin
KW - Learning-based vision
KW - Multi-functional gripper
KW - SME production
UR - http://www.scopus.com/inward/record.url?scp=85150070274&partnerID=8YFLogxK
U2 - 10.1016/j.rcim.2023.102564
DO - 10.1016/j.rcim.2023.102564
M3 - Journal article
AN - SCOPUS:85150070274
SN - 0736-5845
VL - 83
JO - Robotics and Computer-Integrated Manufacturing
JF - Robotics and Computer-Integrated Manufacturing
M1 - 102564
ER -