Building image classification

Urban building characterization is a complex problem with many involved parts whose solution can benefit the development of smart autonomous driving systems, the digital archiving of cultural artifacts, as well as the automation of real estate valuation. To contribute to this research area, this work focuses on a specifc part of the problem: the classiffcation of urban buildings from photographs of their facades into 10 categories: Church, Mosque, Synagogue, Buddhist Temple, House, Apartment Building, Mall, Store, Restaurant, and Oce Building. For this purpose, a novel hierarchical multi-label CNN-based model is proposed. Based on the coarse-to-fine paradigm, a label tree is set up, and the model provides outputs corresponding to each level of the resulting hierarchy.
Feedback from the coarser level to the finer one runs through the model using simple probabilistic notions encoded through a multiplicative layer connecting the parent coarse branch of the model to the child ne branch. The resulting model solves the urban building classification task while performing better than both classical convolutional neural networks, as well as existing hierarchical modes.


S. Taoufiq: "Urban Building Classification Using CNN-based Hierarchical Models", Master Thesis, 2020 (supervisors: Csaba Benedek, Balázs Nagy, SZTAKI)

S. Taoufiq, B. Nagy and Cs. Benedek: ”HierarchyNet: Hierarchical CNN-based Urban Building Classification,” Remote Sensing, vol. 12, no. 22, article 3794, 2020, IF: 4.848 Open Acces


Geo-Information Computing @ Machine Perception Lab.

GeoComp Research Group

Machine Perception Laboratory

SZTAKI main page

GeoComp Demos:

Demo page



GeoComp Group leader: Dr. Csaba Benedek

i4D project manager: Dr. Zsolt Jankó

Head of MPLab: Prof. Tamás Szirányi

MPLab administration: Anikó Vágvölgyi


Kende utca 13-17
H-1111 Budapest, Hungary
Tel: +36 1 279 6097

Flag Counter