Ali, IR, Kolivand, H and Alkawaz, MH (2017) Lip syncing method for realistic expressive 3D face model. Multimedia Tools and Applications. ISSN 1380-7501

Preview

Text Lip syncing method for realistic expressive 3D face model.pdf - Accepted Version Download (3MB) | Preview

Abstract

Lip synchronization of 3D face model is now being used in a multitude of important fields. It brings a more human, social and dramatic reality to computer games, films and interactive multimedia, and is growing in use and importance. High level of realism can be used in demanding applications such as computer games and cinema. Authoring lip syncing with complex and subtle expressions is still difficult and fraught with problems in terms of realism. This research proposed a lip syncing method of realistic expressive 3D face model. Animated lips requires a 3D face model capable of representing the myriad shapes the human face experiences during speech and a method to produce the correct lip shape at the correct time. The paper presented a 3D face model designed to support lip syncing that align with input audio file. It deforms using Raised Cosine Deformation (RCD) function that is grafted onto the input facial geometry. The face model was based on MPEG-4 Facial Animation (FA) Standard. This paper proposed a method to animate the 3D face model over time to create animated lip syncing using a canonical set of visemes for all pairwise combinations of a reduced phoneme set called ProPhone. The proposed research integrated emotions by the consideration of Ekman model and Plutchik’s wheel with emotive eye movements by implementing Emotional Eye Movements Markup Language (EEMML) to produce realistic 3D face model. © 2017 Springer Science+Business Media New York

Item Type:	Article
Additional Information:	This is a post-peer-review, pre-copyedit version of an article published in Multimedia Tools and Applications. The final authenticated version is available online at: http://dx.doi.org/10.1007/s11042-017-4437-z
Uncontrolled Keywords:	0803 Computer Software, 0805 Distributed Computing, 0806 Information Systems, 0801 Artificial Intelligence And Image Processing
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software
Divisions:	Computer Science & Mathematics
Publisher:	Springer Verlag
Date Deposited:	01 Mar 2018 10:10
Last Modified:	04 Sep 2021 03:10
DOI or ID number:	10.1007/s11042-017-4437-z
URI:	https://researchonline.ljmu.ac.uk/id/eprint/8065

View Item