AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation

While considerable progress has been made in achieving accurate lip synchronization for 3D speech-driven talking face generation, the task of incorporating expressive facial detail synthesis aligned with the speaker’s speaking status remains challenging. Existing efforts either focus on l...

Full description

Bibliographic Details

Published in:	IEEE Access
Main Authors:	Yasheng Sun, Wenqing Chu, Hang Zhou, Kaisiyuan Wang, Hideki Koike
Format:	Article
Language:	English
Published:	IEEE 2024-01-01
Subjects:	Large language models audio-visual instruction diffusion model expressive talking face generation contrastive learning
Online Access:	https://ieeexplore.ieee.org/document/10504116/