Which Phoneme-to-Viseme Maps Best Improve Visual-Only Computer Lip-Reading?

Bear, Helen L., Harvey, Richard ORCID: https://orcid.org/0000-0001-9925-8316, Theobald, Barry and Lan, Yuxuan (2014) Which Phoneme-to-Viseme Maps Best Improve Visual-Only Computer Lip-Reading? In: International Symposium on Visual Computing, 2014-12-08 - 2014-12-10, Nevada.

Full text not available from this repository. (Request a copy)

Abstract

A critical assumption of all current visual speech recognition systems is that there are visual speech units called visemes which can be mapped to units of acoustic speech, the phonemes. Despite there being a number of published maps it is infrequent to see the effectiveness of these tested, particularly on visual-only lip-reading (many works use audio-visual speech). Here we examine 120 mappings and consider if any are stable across talkers. We show a method for devising maps based on phoneme confusions from an automated lip-reading system, and we present new mappings that show improvements for individual talkers.

Item Type:	Conference or Workshop Item (Paper)
Faculty \ School:	Faculty of Science Faculty of Science > School of Computing Sciences
UEA Research Groups:	Faculty of Science > Research Groups > Interactive Graphics and Audio Faculty of Science > Research Groups > Smart Emerging Technologies
Depositing User:	Pure Connector
Date Deposited:	02 Jan 2015 12:38
Last Modified:	19 Apr 2023 01:31
URI:	https://ueaeprints.uea.ac.uk/id/eprint/51584
DOI:

Actions (login required)

View Item