Facial reconstruction

Search LJMU Research Online

Browse Repository | Browse E-Theses

Outdoor mobility aid for People with visual impairment: Obstacle detection and responsive framework for the scene perception during the outdoor mobility of people with visual impairment

Khan, W, Hussain, A, Muhammad Khan, B and Crockett, K (2023) Outdoor mobility aid for People with visual impairment: Obstacle detection and responsive framework for the scene perception during the outdoor mobility of people with visual impairment. Expert Systems with Applications, 228. ISSN 0957-4174

[img]
Preview
Text
Outdoor Mobility Aid for People with Visual Impairment Obstacle Detection and Responsive Framework for the Scene Perception during the Outdoor Mobility of People with Visual Impairment.pdf - Published Version
Available under License Creative Commons Attribution.

Download (7MB) | Preview

Abstract

Outdoor mobility of individuals with visual impairment is challenging particularly where collision with obstacles can have significant impact on both physical and mental health. A variety of technological mobility aids for visually impaired people (VIP) have been studied and proposed in the literature which mainly utilise machine intelligence and deep learning (DL) approaches for object detection. However, object detection via the existing approaches suffers from reliability challenge due to real-time dynamics or the lack of available domain knowledge for specific obstacles identified by the VIP as potential hazards. In the present study, an object detection model (ObDtM) based on deep transfer learning techniques was developed for a custom-built dataset comprising of specific obstacles identified by the VIP as potential hazards. A custom dataset was compiled and manually annotated from various publicly available sources to train the ObDtM. Experiments were conducted to evaluate the proposed ObDtM for unseen obstacles kept as the test set. Results showed that ObDtM outperformed the state-of-the-art with 97% mean Average Precision (mAP), indicating a robust and generalizable DL approach. The compiled dataset and the ObDtM is useful for several potential use cases, particularly highlighting the use of DL in IoT and smart city applications. Additionally, a smart synergetic outdoor mobility framework was proposed for VIP (SOMAVIP) allowing comprehensive and accurate semantic representation of the surroundings by utilising the proposed ObDtM, cloud services, internet of things (IoT), and digital environment in the context of emerging smart city infrastructure. The proposed SOMAVIP can be highly impactful for improving VIPs’ quality of life mainly for safer, cost-effective, and reliable independent outdoor mobility enriched with real-time perception and interpretations of the surroundings.

Item Type: Article
Uncontrolled Keywords: 01 Mathematical Sciences; 08 Information and Computing Sciences; 09 Engineering; Artificial Intelligence & Image Processing
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Divisions: Computer Science & Mathematics
Publisher: Elsevier BV
SWORD Depositor: A Symplectic
Date Deposited: 17 May 2023 09:14
Last Modified: 06 Jun 2023 14:00
DOI or ID number: 10.1016/j.eswa.2023.120464
URI: https://researchonline.ljmu.ac.uk/id/eprint/19508
View Item View Item