Semantic Labeling for Mobile Laser Scanning Data

We introduce a 3D convolutional neural network (CNN)-based method to segment point clouds obtained by mobile laser scanning (MLS) sensors into nine different semantic classes, which can be used for high definition city map generation. The main purpose of semantic point labeling is to provide a detailed and reliable background map for self-driving vehicles (SDV), which indicates the roads and various landmark objects for navigation and decision support of SDVs. Our approach considers several practical aspects of raw MLS sensor data processing, including the presence of diverse urban objects, varying point density, and strong measurement noise of phantom effects caused by objects moving concurrently with the scanning platform. We also provide a new manually annotated MLS benchmark set called SZTAKI CityMLS, which is used to evaluate the proposed approach, and to compare our solution to various reference techniques proposed for semantic point cloud segmentation. Apart from point level validation we also present a case study on Lidar-based accurate self-localization of SDVs in the segmented MLS map.

Demo for the detection results with [1]:


Benchmark dataset

The Benchmark dataset prepared for this project is available here.


[1]B. Nagy and Cs. Benedek: ”3D CNN Based Semantic Labeling Approach for Mobile Laser Scanning Data,” IEEE Sensors Journal, vol. 19, no. 21, pp. 10034 - 10045, 2019, Open Access


Geo-Information Computing @ Machine Perception Lab.

GeoComp Research Group

Machine Perception Laboratory

SZTAKI main page

GeoComp Demos:

Demo page



GeoComp Group leader: Dr. Csaba Benedek

i4D project manager: Dr. Zsolt Jankó

Head of MPLab: Prof. Tamás Szirányi

MPLab administration: Anikó Vágvölgyi


Kende utca 13-17
H-1111 Budapest, Hungary
Tel: +36 1 279 6194
Fax: +36 1 279 6292

Flag Counter