We introduce a 3D convolutional neural network (CNN)-based method to segment point clouds obtained by mobile laser scanning (MLS) sensors into nine different semantic classes, which can be used for high definition city map generation. The main purpose of semantic point labeling is to provide a detailed and reliable background map for self-driving vehicles (SDV), which indicates the roads and various landmark objects for navigation and decision support of SDVs. Our approach considers several practical aspects of raw MLS sensor data processing, including the presence of diverse urban objects, varying point density, and strong measurement noise of phantom effects caused by objects moving concurrently with the scanning platform. We also provide a new manually annotated MLS benchmark set called SZTAKI CityMLS, which is used to evaluate the proposed approach, and to compare our solution to various reference techniques proposed for semantic point cloud segmentation. Apart from point level validation we also present a case study on Lidar-based accurate self-localization of SDVs in the segmented MLS map.
Demo for the detection results with [1]:
The Benchmark dataset prepared for this project is available here.
[1]B. Nagy and Cs. Benedek: ”3D CNN Based Semantic Labeling Approach for Mobile Laser Scanning Data,” IEEE Sensors Journal, vol. 19, no. 21, pp. 10034 - 10045, 2019, Open Access
Geo-Information Computing @ Machine Perception Lab.
GeoComp Demos:
GeoComp Group leader: Dr. Csaba Benedek benedek.csaba@sztaki.hu
i4D project manager: Dr. Zsolt Jankó janko.zsolt@sztaki.hu
Head of MPLab: Prof. Tamás Szirányi
MPLab administration: Anikó Vágvölgyi
Address:
SZTAKI