AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation

While considerable progress has been made in achieving accurate lip synchronization for 3D speech-driven talking face generation, the task of incorporating expressive facial detail synthesis aligned with the speaker’s speaking status remains challenging. Existing efforts either focus on l...

Full description

Bibliographic Details
Published in:	IEEE Access
Main Authors:	Yasheng Sun, Wenqing Chu, Hang Zhou, Kaisiyuan Wang, Hideki Koike
Format:	Article
Language:	English
Published:	IEEE 2024-01-01
Subjects:	Large language models audio-visual instruction diffusion model expressive talking face generation contrastive learning
Online Access:	https://ieeexplore.ieee.org/document/10504116/

Similar Items

Survey of audio-driven talking face generation technology
by: ZHANG Bingyuan, et al.
Published: (2024-09-01)

Pengaruh Metode Talking Stick Berbantuan Audio Visual terhadap Maharah Kalam
by: Nurriyatul Masrifah, et al.
Published: (2025-01-01)

EGENEFACE: HIGH QUALITY GENERALIZED TALKING FACE SYNTHESIZING ENABLED BY AUDIO
by: Nilam Thakkar, et al.
Published: (2025-09-01)

SeamsTalk: Seamless Talking Face Generation via Flow-Guided Inpainting
by: Yeongho Jeong, et al.
Published: (2024-01-01)

Emotion recognition in talking-face videos using persistent entropy and neural networks
by: Eduardo Paluzo-Hidalgo, et al.
Published: (2022-02-01)

The Effects of Different Methods of Self-Talk (Motivational, Instructional, and Combined) on Physical Efficacy, Acquisition and Learning of Dart Throw Task
by: Ahmadreza Movahedi, et al.
Published: (2016-03-01)

Continuous Talking Face Generation Based on Gaussian Blur and Dynamic Convolution
by: Ying Tang, et al.
Published: (2025-03-01)

Emotionally Controllable Talking Face Generation from an Arbitrary Emotional Portrait
by: Zikang Zhao, et al.
Published: (2022-12-01)

Audio-Driven Facial Animation with Deep Learning: A Survey
by: Diqiong Jiang, et al.
Published: (2024-10-01)

The Effect of Different Kinds of Self–Talk on Balance Function of the Healthy Elderly
by: Amir Shariati, et al.
Published: (2013-10-01)

Multi-Level Feature Dynamic Fusion Neural Radiance Fields for Audio-Driven Talking Head Generation
by: Wenchao Song, et al.
Published: (2025-01-01)

The Effect of Self-Talk and Feedback on Acquisition and Retention of Basketball Chest Pass
by: Mina Emami Arandi, et al.
Published: (2018-05-01)

Fat talk, old talk, or both? Association of negative body talk with mental health, body dissatisfaction, and quality of life in men and women
by: Savannah C. Hooper, et al.
Published: (2023-05-01)

Talking/Reading/Writing
by: Pelayo Pérez García, et al.
Published: (2025-10-01)

‘Talk talk talk …’ Virginia Woolf, Ireland and Maria Edgeworth
by: Paul E. H. Davis
Published: (2006-03-01)

The effect of attentional focus types as the self-talk form on static and dynamic balance in elderly women
by: Mansoure Mokaberyan, et al.
Published: (2018-02-01)

Translation and validation of a Chinese version of the body talk scale for women and men
by: Jinbo He, et al.
Published: (2023-09-01)

Model Pembelajaran Talking Stick Berbantuan Media Audio Visual Terhadap Kompetensi Pengetahuan IPS Siswa Kelas V SD
by: Ni Putu Leny Purwani, et al.
Published: (2023-12-01)

Socioeconomic Variations in the Frequency of Parent Number Talk: A Meta-Analysis
by: Eric Dearing, et al.
Published: (2022-04-01)

Audio-as-Data Tools: Replicating Computational Data Processing
by: Josephine Lukito, et al.
Published: (2024-05-01)

Teacher talk of praises in English classroom interaction
by: Aulia Rahmani, et al.
Published: (2021-01-01)

TEACHERSâ€™ WAYS IN MAXIMIZING STUDENT TALKING TIME (STT) IN EFL CLASSROOM
by: DESI WIJAYANTI MAâ€™RUFAH
Published: (2018-10-01)

PENINGKATAN KARAKTER DAN HASIL BELAJAR BIOLOGI SISWA SMP MELALUI MODEL PEMBELAJARAN THINK TALK WRITE DIPADU TALKING STICK
by: Lidya Yanuarta
Published: (2017-01-01)

Talking about God or Talking about Faith
by: Mari Jože Osredkar
Published: (2024-01-01)

Talking Portrait Synthesis Method Based on Regional Saliency and Spatial Feature Extraction
by: WANG Xingbo, ZHANG Hao, GAO Hao, ZHAI Mingliang, XIE Jiucheng
Published: (2025-03-01)

The Role of Talking Faces in Infant Language Learning: Mind the Gap between Screen-Based Settings and Real-Life Communicative Interactions
by: Joan Birulés, et al.
Published: (2023-08-01)

The Effect of Organic Self-Talk on Metacognition and Performance in Exhausting Task
by: Jahangir Khorshidi, et al.
Published: (2025-03-01)

Small talk
by: Ryszard Przybylski
Published: (2016-12-01)

Pengaruh Model Pembelajaran Talking Stick Dalam Meningkatkan Keterampilan Berbicara Siswa
by: Nidaul Fitri Hamdani, et al.
Published: (2022-06-01)

Self-talk content and performance indicators for young tennis players in competitions
by: Kristine Dzene-Lekse, et al.
Published: (2025-06-01)

The Effect of Instructing Teacher Talk and Classroom Language on EFL Student-Teachers’ Linguistic Performance
by: Suhad Qais Ahmed, et al.
Published: (2025-03-01)

Differences between a teacher educator’s and prospective classroom teacher’s talk-based strategies for fostering academically productive classroom talk
by: Yilmaz Soysal, et al.
Published: (2024-04-01)

Review of Talking Face Generation
by: SONG Xinyang, YAN Zhiyuan, SUN Muyi, DAI Linlin, LI Qi, SUN Zhenan
Published: (2023-08-01)

AN ANALYSIS OF TEACHER AND STUDENT TALK IN THE CLASSROOM INTERACTION OF THE EIGHTH GRADE OF SMP NEGERI 18 PURWOREJO
by: Semi Sukarni, et al.
Published: (2015-10-01)

KEEFEKTIFAN MODEL KOOPERATIF TIPE THINK-TALK-WRITE DALAM MENULIS EKSPOSISI DI PERGURUAN TINGGI
by: Yeni Rahmawati, et al.
Published: (2020-07-01)

Upaya meningkatkan hasil belajar Pendidikan Kewarganegaraan melalui model pembelajaran talking stick
by: Boinah Boinah
Published: (2017-05-01)

Penerapan Model Talking Stick untuk Meningkatkan Hasil Belajar Materi Pola Irama
by: Rantamsih Rantamsih, et al.
Published: (2021-09-01)

PENGEMBANGAN MODEL TALKING STICKS DALAM KETERAMPILAN BERBICARA BAHASA INGGRIS PADA SISWA KELAS X (IPA 1) DI SMAN 4 BANGKALAN- MADURA
by: Moh. Arief Wahyudi
Published: (2017-02-01)

The Impact of a New Specialized Learning Platform on Enhancing Students’ Skills in Designing and Producing Online Educational Talking Books
by: Mohamed Elsayed Ahmed, et al.
Published: (2024-11-01)

Psychometric Properties and Normalization of Persian Version of Self Talk Questionnaire
by: Valiollah Kashani, et al.
Published: (2017-01-01)