Semantic segmentation of 3D point cloud data acquired from robot dog for scaffold monitoring

Many of the fatalities and injuries in the construction industry occur in scaffolding accidents, and monitoring the scaffolding process and checking compliance are critical. However, monitoring scaffolds is labor-intensive and inefficient because it is done manually. To address this issue, we propose an advanced 3D reconstruction method for detecting and monitoring scaffolds. Deep learning-based RandLA-Net architecture is used to perform scene segmentation. RandLA-Net is trained based on transfer learning, using the knowledge of the model learned with the Semantic3D dataset. RandLA-Net uses 3D point cloud data that are matched and registered by LIO-SAM, a laser slam algorithm. By attaching a LiDAR to a quadruped robot, it is possible to obtain data frequently in a manner suitable for construction sites. The proposed methodology has demonstrated good performance in monitoring scaffolds.