Mahyoub, M, Natalia, F, Sudirman, S, Al-Jumaily, AHJ and Liatsis, P (2023) Semantic Segmentation and Depth Estimation of Urban Road Scene Images Using Multi-Task Networks. In: Proceedings - 2023 15th International Conference on Developments in eSystems Engineering (DESE) , 2023-J. pp. 469-474. (2023 15th International Conference on Developments in eSystems Engineering (DESE), 9-12 Jan. 2023, Baghdad & Anbar, Iraq).

Preview

Text 3. Semantic Segmentation and Depth Estimation of.pdf - Accepted Version Download (586kB) | Preview

Abstract

In autonomous driving, environment perception is an important step in understanding the driving scene. Objects in images captured through a vehicle camera can be detected and classified using semantic segmentation and depth estimation methods. Both these tasks are closely related to each other and this association helps in building a multi-Task neural network where a single network is used to generate both views from a given monocular image. This approach gives the flexibility to include multiple related tasks in a single network. It helps reduce multiple independent networks and improve the performance of all related tasks. The main aim of our research presented in this paper is to build a multi-Task deep learning network for simultaneous semantic segmentation and depth estimation from monocular images. Two decoder-focused U-N et-based multi-Task networks that use a pre-Trained Resnet-50 and DenseNet-121 which shared encoder and task-specific decoder networks with Attention Mechanisms are considered. We also employed multi-Task optimization strategies such as equal weighting and dynamic weight averaging during the training of the models. The corresponding models' performance is evaluated using mean IoU for semantic segmentation and Root Mean Square Error for depth estimation. From our experiments, we found that the performance of these multi-Task networks is on par with the corresponding single-Task networks.

Item Type:	Conference or Workshop Item (Paper)
Additional Information:	© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > TA Engineering (General). Civil engineering (General) T Technology > TL Motor vehicles. Aeronautics. Astronautics
Divisions:	Computer Science & Mathematics
Publisher:	IEEE
SWORD Depositor:	A Symplectic
Date Deposited:	12 Jun 2023 16:21
Last Modified:	12 Jun 2023 16:21
DOI or ID number:	10.1109/DeSE58274.2023.10099504
URI:	https://researchonline.ljmu.ac.uk/id/eprint/19755

View Item