Ali, IR and Kolivand, H (2024) Expressive Sign Language System for Deaf Kids with MPEG-4 Approach of Virtual Human Character. Journal of Ambient Intelligence and Humanized Computing. ISSN 1868-5137

Text Expressive Sign Language System for Deaf Kids with MPEG-4 Approach of Virtual Human Character.pdf - Accepted Version Restricted to Repository staff only until 14 September 2025. Download (1MB)

Abstract

Children with language impairments during their significant developmental periods within ‎childhood are exposed to cognitive risk, social impairments, along with language. This is difficult ‎with children born deaf from hearing parents who own little or no experience of communicating ‎in sign language. This system presents the sign language in the context of British ‎Sign Language (BSL) for producing utterances through virtual characters. In capturing, Kinect ‎sensors use a motion capture sensor for motion actors. The connection uses sensors to read data, ‎connect to high-quality 3D scans, and then use these high-quality scans of the animated MPEG-4 ‎face and hand models. The main challenges of this system are the simultaneous capture of data ‎for the whole hand and the development of the MPEG-4 approach considering the animation ‎engines with descriptive sign language features. After synchronizing motion data from motion ‎capture results with Kinect, the combined hand character adjusts points, frames, and time with ‎virtual characters based on the motion of character actors. This study demonstrates the skills of ‎this sign language system instrumental in presenting an assessment by users, highlighting the ‎importance of the hand part in creating new accents and signs in BSL. We have validated this ‎system by testing the reliability and functionality of the virtual characters.‎

Item Type:	Article
Additional Information:	This version of the article has been accepted for publication, after peer review (when applicable) and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: http://doi.org/10.1007/s12652-024-04842-7
Uncontrolled Keywords:	0801 Artificial Intelligence and Image Processing; 0805 Distributed Computing
Subjects:	P Language and Literature > P Philology. Linguistics Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:	Computer Science & Mathematics
Publisher:	Springer
SWORD Depositor:	A Symplectic
Date Deposited:	16 Sep 2024 14:16
Last Modified:	16 Sep 2024 14:16
DOI or ID number:	10.1007/s12652-024-04842-7
URI:	https://researchonline.ljmu.ac.uk/id/eprint/24148

View Item