Jung, Jan ThomasJan ThomasJungReiterer, AlexanderAlexanderReiterer2024-12-062024-12-062024-12-05https://publica.fraunhofer.de/handle/publica/47975110.3390/s24237786The maintenance and inspection of sewer pipes are essential to urban infrastructure but remain predominantly manual, resource-intensive, and prone to human error. Advancements in artificial intelligence (AI) and computer vision offer significant potential to automate sewer inspections, improving reliability and reducing costs. However, the existing vision-based inspection robots fail to provide data quality sufficient for training reliable deep learning (DL) models. To address these limitations, we propose a novel multi-sensor robotic system coupled with a DL integration concept. Following a comprehensive review of the current 2D (image) and 3D (point cloud) sewage pipe inspection methods, we identify key limitations and propose a system incorporating a camera array, front camera, and LiDAR sensor to optimise surface capture and enhance data quality. Damage types are assigned to the sensor best suited for their detection and quantification, while tailored DL models are proposed for each sensor type to maximise performance. This approach enables the optimal detection and processing of relevant damage types, achieving higher accuracy for each compared to single-sensor systems.enAutomated inspectionDamage detectionSewer pipesArtificial intelligenceRobotic inspectionComputer visionUrban infrastructure3D visionPoint cloudLiDARjournal article