RESEARCH ON 3D MEASUREMENT TECHNOLOGY BASED ON MACHINE VISION

Liu Dongmei; Vladyslav Gerasymenko

doi:10.32782/msnau.2023.4.1

Liu Dongmei https://orcid.org/0000-0002-5303-0727
Vladyslav Gerasymenko https://orcid.org/0000-0001-5875-8517

DOI: https://doi.org/10.32782/msnau.2023.4.1

Keywords: digital twin, machine vision, 3D scanning and reconstruction, 3D point cloud registration.

Abstract

Measurement is an important means for humans to understand and transform the world, and it is the technological foundation for breaking through the forefront of science and solving major problems in economic and social development. The three-dimensional measurement system serves primary national needs, leads national economic development, and ensures national defense security. With the arrival of a new industrial revolution, major industrial countries worldwide have begun to accelerate the strategic deployment of intelligent manufacturing. As an essential component of the construction of smart factories and lighthouse factories, the 3D measurement system will play a vital role in deepening the implementation of the manufacturing power strategy and promoting the high-end, intelligent, and green manufacturing process. In recent years, optical 3D measurement technology represented by surface structured light has developed rapidly and has been widely applied in multiple material processing fields such as forging, casting, and sheet metal. To analyze the manufacturing accuracy of complex parts using surface structured light 3D measurement technology, it is necessary to first scan and reconstruct the overall 3D surface of the part. The reconstructed 3D point cloud data of the part surface should be roughly and precisely matched with the design model. Finally, based on this, data comparison and accuracy analysis should be carried out according to the actual detection requirements of different types of parts. In this process, the accuracy of 3D reconstruction of complex parts and the alignment accuracy between the reconstruction results and the design model directly determine the reliability and accuracy of the final part manufacturing and machining accuracy analysis. This article uses cases to illustrate the application of machine vision in 3D online measurement. The application of three-dimensional measurement technology in online quality inspection and grinding of blades can not only improve the measurement accuracy of online quality inspection of blades but also maintain the relative stability of robot grinding force and improve the grinding effect in robot grinding of aircraft engine blades. Applied to online quality inspection of train wheel hubs, three-dimensional measurement of train wheel adapters and high-speed train wheel size online inspection has been achieved.

References

1. Ahmad Mohamad Mezher; Andrew E. Marble; A Novel Strategy for Improving Robustness in Computer Vision Manufacturing Defect Detection, Arxiv-Cs.Cv, 2023.
2. Aiger D, Mitra N J, Cohen-Or D. 4-points congruent sets for robust pairwise surface registration. ACM Transactions on Graphics, 2008, 27(3): 85.
3. André Luiz Buarque Vieira e Silva; Heitor de Castro Felix; Franscisco Paulo Magalhães Simões; Veronica Teichrieb; Michel Mozinho dos Santos; Hemir Santiago; Virginia Sgotti; Henrique Lott Neto; InsPLAD: A Dataset and Benchmark for Power Line Asset Inspection in UAV Images, Arxiv-Cs.Cv, 2023.
4. Cai Yunbin, Research on Key Technologies of Computer Vision Recognition and Its Application in Passenger Flow Detection Sichuan Province, Chengdu Staring Technology Co., Ltd., May 26, 2020
5. Chen Xu. Research on Complex Part 3D Reconstruction and Point Cloud Registration Technology [D]. Huazhong University of Science and Technology, 2019
6. Cheng X, Liu X, Li Z, et al. High-accuracy globally consistent surface reconstruction using fringe projection profilometry. Sensors, 2019, 19(3): 668.
7. Curless B, Levoy M. A volumetric method for building complex models from range images. Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. ACM, 1996: 303–312.
8. Cuypers W, Van Gestel N, Voet A, et al. Optical measurement techniques for mobile and large-scale dimensional metrology. Optics and Lasers in Engineering, 2009, 47(3): 292–300.
9. Design and application of a traffic scene detection platform based on computer vision technology [J] Western Transportation Technology, 2023, (06): 163-165 DOI: 10.13282/j.cnki.wccst.2023.06.047
10. Elmira Faraji Zonouz; Xiao Pan; Yu-Cheng Hsu; Tony Yang; 3D Vision-based Structural Masonry Damage Detection, Arxiv-Cs.Cv, 2023.
11. Gelfand N, Mitra N J, Guibas L J, et al. Robust global registration. Proceedings of the Third Eurographics Symposium on Geometry Processing. Aire-la-Ville, Switzerland, Switzerland: Eurographics Association, 2005.
12. Ghorbani H, Khameneifar F. Accurate registration of point clouds of damaged aeroengine blades. Journal of Manufacturing Science and Engineering, 2021, 143(3): Article No. 031012
13. GOM Inspect is now ZEISS INSPECT Optical 3D. GOM Metrology [2019-03-07], URL: https://www.gom.com/3dsoftware/gom-system-software/atos-professional.html.
14. Han L, Cheng X, Li Z, et al. A robot-driven 3d shape measurement system for automatic quality inspection of thermal objects on a forging production line. Sensors, 2018, 18(12): 4368.
15. Han L, Cheng X, Li Z, et al. A robot-driven 3d shape measurement system for automatic quality inspection of thermal objects on a forging production line. Sensors, 2018, 18(12): 4368.
16. HandySCAN 3d – professional portable 3d laser scanner. Creaform. [2019-03-07]. https://www.creaform3d.com/en/metrology-solutions/portable-3d-scanner-handyscan-3d.
17. He W, Zhong K, Li Z, et al. Accurate calibration method for blade 3d shape metrology system integrated by fringe projection profilometry and conoscopic holography. Optics and Lasers in Engineering, 2018, 110: 253–261.
18. Huang Ziliang Research on non-destructive detection algorithm for soybean damage based on computer vision [D] University of Science and Technology of China, 2023
19. João Peixoto; João Sousa; Ricardo Carvalho; Gonçalo Santos; Ricardo Cardoso; Ana Reis; End-to-End Solution for Analog Gauge Monitoring Using Computer Vision in An IoT Platform, Sensors (Basel, Switzerland), 2023.
20. Kui Luo; Xuan Kong; Jie Zhang; Jiexuan Hu; Jinzhao Li; Hao Tang; Computer Vision-Based Bridge Inspection and Monitoring: A Review, Sensors (Basel, Switzerland), 2023.
21. Levoy M, Pulli K, Curless B, et al. The digital michelangelo project: 3d scanning of large statues. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. New York, NY, USA: ACM Press/Addison-
Wesley Publishing Co., 2000: 131–144.
22. Li W L, Xie H, Zhang G, Yan S J, Yin Z P. 3-D shape matching of a blade surface in robotic grinding applications. IEEE/ASME Transactions on Mechatronics, 2016, 21(5): 2294−2306
23. Li Xianzheng, Zhao Zhenbin, Liu Yang, etc Commercial Homogeneity Space Measurement of Ancient Town Tourism Destinations Based on Street View Image – Taking Dali Old City as an Example [J] Progress in Geographic Science, 2023, 42 (01): 104-115
24. Li Y, Gu P. Free-form surface inspection techniques state of the art review. Computer-Aided Design, 2004, 36(13): 1395–1417.
25. Li Z, Zhong K, Li Y F, et al. Multiview phase shifting: a full-resolution and high-speed 3d measurement framework for arbitrary shape dynamic objects. Optics Letters, 2013, 38(9): 1389–1391.
26. Liming Xue; Junping Qin; Tong Gao; Chao Wang; Automatic Inspection and Reading System of Pointer Instrument Based on Computer Vision, International Symposium on Computer Engineering, 2023. https://doi.org/10.1117/12.2660824
27. Mengran Fang; Jingya Li; Li Cai; Zheng Wang; Research on Autonomous Intelligent Inspection Technology of Substation Based on Image Recognition and Computer Vision, Other Conferences, 2023.
28. Nazanin Safavian; Simon K C Toh; Martino Pani; Raymond Lee; Endoscopic Measurement of The Size of Gastrointestinal Polyps Using An Electromagnetic Tracking System and Computer Vision-based Algorithm, International Journal Of Computer Assisted Radiology And, 2023.
29. Obinna Nwosu; Krish Suresh; Renata Knoll; Daniel J Lee; Matthew G Crowson; A Proof-of-Concept Computer Vision Approach for Measurement of Tympanic Membrane Perforations, The Laryngoscope, 2024.
30. Ouellet J N, Hébert P. Precise ellipse estimation without contour point extraction. Machine Vision and Applications, 2008, 21(1): 59.
31. Rusu R B, Blodow N, Beetz M. Fast point feature histograms (fpfh) for 3d registration. 2009 IEEE International Conference on Robotics and Automation. 2009: 3212–3217.
32. Su Xianyu, Zhang Qican, Chen Wenjing Structured light 3D imaging technology China Laser, 2014 (02): 9–18.
33. Wei Yi Computer vision based detection of foreign objects and insulator defects in power lines [D] University of Electronic Science and Technology, 2023
34. Wu Shaoji, Hu Yike Analysis of Spatial Hyperlinks in Commercial Complex Based on Deep Learning: Taking Sanlitun Taikoo Village and Beijing APM as Examples [J] Southern Architecture, 2022, (01): 61-68
35. Wu Xiaoqiang, Zeng Chaoyang The impact of battlefield environmental factors on machine vision object detection [J] Development and Innovation of Mechanical and Electrical Products, 2021, 34 (05): 92-95
36. Wu Xiaoqiang, Zeng Chaoyang The impact of battlefield environmental factors on machine vision object detection [J] Development and Innovation of Mechanical and Electrical Products, 2021, 34 (05): 92-95
37. Yajie Sun; Ali Zia; Vivien Rolland; Charissa Yu; Jun Zhou; Spectral 3D Computer Vision – A Review, Arxiv-Cs. Cv, 2023. https://doi.org/10.48550/arXiv.2302.08054
38. Yang Jiahe Data collection and analysis of hand tremors in Parkinson’s patients based on computer vision [D] Harbin University of Commerce, 2023 DOI: 10.27787/dcnki.ghrbs.2023.000593
39. Zhang S. Recent progresses on real-time 3d shape measurement using digital fringe projection techniques. Optics and Lasers in Engineering, 2010, 48(2): 149–158.
40. Zhong K, Li Z W, Zhou X H, Li Y F, Shi Y S, Wang C J. Enhanced phase measurement profilometry for industrial 3D inspection automation. The International Journal of Advanced Manufacturing Technology, 2015, 76(9−12): 1563−1574
41. Zhong K, Li Z, Zhou X, et al. Enhanced phase measurement profilometry for industrial 3d inspection automation. The International Journal of Advanced Manufacturing Technology, 2015, 76(9): 1563–1574.
42. Zhou Q Y, Park J, Koltun V. Fast global registration. European Conference on Computer Vision. Springer, 2016: 766–782.
43. Zuo C, Feng S, Huang L, et al. Phase shifting algorithms for fringe projection profilometry: a review. Optics and Lasers in Engineering, 2018, 109: 23–59.