Ali, I and Kolivand, H Expressive Sign Language System for Deaf Kids with MPEG-4 Approach of Virtual Human Character. Journal of Ambient Intelligence and Humanized Computing. ISSN 1868-5137 (Accepted)

Text Expressive Sign Language System for Deaf Kids with MPEG-4 Approach of Virtual Human Character.pdf - Accepted Version Restricted to Repository staff only Download (1MB)

Abstract

Children with language impairments during their significant developmental periods within childhood are exposed to cognitive risk, social impairments, along with language. This is difficult with children born deaf from hearing parents who own little or no experience of communicating in sign language. This system presents the sign language in the context of British Sign Language (BSL) for producing utterances through virtual characters. In capturing, Kinect sensors use a motion capture sensor for motion actors. The connection uses sensors to read data, connect to high-quality 3D scans, and then use these high-quality scans of the animated MPEG-4 face and hand models. The main challenges of this system are the simultaneous capture of data for the whole hand and the development of the MPEG-4 approach considering the animation engines with descriptive sign language features. After synchronizing motion data from motion capture results with Kinect, the combined hand character adjusts points, frames, and time with virtual characters based on the motion of character actors. This study demonstrates the skills of this sign language system instrumental in presenting an assessment by users, highlighting the importance of the hand part in creating new accents and signs in BSL. We have validated this system by testing the reliability and functionality of the virtual characters.

Item Type:	Article
Uncontrolled Keywords:	0801 Artificial Intelligence and Image Processing, 0805 Distributed Computing
Subjects:	Q Science > QA Mathematics > QA76 Computer software H Social Sciences > HV Social pathology. Social and public welfare. Criminology > HV697 Protection, assistance and relief > HV888 Children with disabilities
Divisions:	Computer Science & Mathematics
Publisher:	Springer
Date Deposited:	31 Mar 2021 08:43
Last Modified:	04 Sep 2021 05:39
URI:	https://researchonline.ljmu.ac.uk/id/eprint/14729

Actions (login required)

View Item