Model for predicting perception of facial action unit activation using virtual humans
Citation:
McDonnell, Rachel and Zibrek, Katja and Carrigan, Emma and Dahyot, Rozenn (2021) Model for predicting perception of facial action unit activation using virtual humans. Computers & Graphics, 100. pp. 81-92Download Item:
Abstract:
Blendshape facial rigs are used extensively in the industry for facial animation of virtual humans. However, storing and manipulating large numbers of facial meshes (blendshapes) is costly in terms of memory and computation for gaming applications. Blendshape rigs are comprised of sets of semantically-meaningful expressions, which govern how expressive the character will be, often based on Action Units from the Facial Action Coding System (FACS). However, the relative perceptual importance of blendshapes has not yet been investigated. Research in Psychology and Neuroscience has shown that our brains process faces differently than other objects so we postulate that the perception of facial expressions will be feature-dependent rather than based purely on the amount of movement required to make the expression. Therefore, we believe that perception of blendshape visibility will not be reliably predicted by numerical calculations of the difference between the expression and the neutral mesh. In this paper, we explore the noticeability of blendshapes under different activation levels, and present new perceptually-based models to predict perceptual importance of blendshapes. The models predict visibility based on commonly-used geometry and image-based metrics.
Sponsor
Grant Number
Science Foundation Ireland
Model for predicting perception of facial action unit activation using virtual humans
Author's Homepage:
http://people.tcd.ie/ramcdonnDescription:
PUBLISHED
Author: Mc Donnell, Rachel
Sponsor:
Science Foundation IrelandType of material:
Journal ArticleCollections
Series/Report no:
Computers and Graphics;100;
Availability:
Full text availableKeywords:
Blendshape facial rigs, virtual humans, Facial Action Coding System (FACS), Computers and graphics, Formatting, GuidelinesDOI:
http://dx.doi.org/10.1016/j.cag.2021.07.022ISSN:
00978493Metadata
Show full item recordLicences: