Wang, C, Zhang, X, Gao, H, Bashir, M, Li, H and Yang, Z (2024) Optimizing anti-collision strategy for MASS: A safe reinforcement learning approach to improve maritime traffic safety. Ocean and Coastal Management, 253. ISSN 0964-5691

Text Optimizing Anti-collision Strategy for MASS A Safe Reinforcement Learning Approach to Improve Marit - OCMA.pdf - Accepted Version Restricted to Repository staff only until 29 April 2025. Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (21MB)

Abstract

Maritime autonomous surface ships (MASS) promise enhanced efficiency, reduced human errors, and to improve maritime traffic safety. However, MASS navigation in complex maritime traffic presents challenges, especially in collision avoidance strategy optimization (CASO). This paper proposes a novel risk-based CASO approach based on safe reinforcement learning (SRL) with a reliability and risk hierarchical critic network (SRL-R2HCN) approach. Key steps in developing the approach start with the formulation of collision risk assessment. This is followed by the construction of a hierarchical network structure, supplemented by the supporting reward function, multi-objective function, and reliability measurement to realize the SRL-R2HCN. Finally, simulation experiments are conducted in mixed obstacle scenarios, and the results are compared with traditional algorithms to showcase the advancement and fidelity of the new SRL-R2HCN method. The results demonstrate that the proposed method can accurately assess collision risks in mixed obstacle scenarios and generate safe, efficient, and reliable collision avoidance strategies. The outcomes of this research provide a sound theoretical basis for the future development of MASS navigation safety and significant potential to improve the safe and efficient operations of MASS. Furthermore, the methodology could also benefit maritime transportation and shipping management.

Item Type:	Article
Uncontrolled Keywords:	04 Earth Sciences; 05 Environmental Sciences; 16 Studies in Human Society; Fisheries
Subjects:	V Naval Science > VM Naval architecture. Shipbuilding. Marine engineering
Divisions:	Engineering
Publisher:	Elsevier BV
SWORD Depositor:	A Symplectic
Date Deposited:	19 Aug 2024 10:18
Last Modified:	19 Aug 2024 10:18
DOI or ID number:	10.1016/j.ocecoaman.2024.107161
URI:	https://researchonline.ljmu.ac.uk/id/eprint/23971

View Item