Portfolio item number 1
Short description of portfolio item number 1
Posts by Collection
portfolio
Portfolio item number 2
Short description of portfolio item number 2
publications
Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads Generation
Published in International Conference on Image Analisys and Processing (ICIAP)(Oral), 2023
A novel approach for generating 3D talking heads from raw audio inputs. This method grounds on the idea that speech related movements can be comprehensively and efficiently described by the motion of a few control points located on the movable parts of the face, i.e., landmarks.
ScanTalk: 3D Talking Heads from Unregistered Scans
Published in European Conference on Computer Vision (ECCV), 2024
In this work, we present ScanTalk, a novel framework capable of animating 3D faces in arbitrary topologies including scanned data.
Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Heads
Published in Arxiv, 2024
We explore two training settings: a supervised one, in which training sequences share a fixed topology within a sequence but any mesh can be animated at test time, and an unsupervised one, which allows effective training with varying mesh structures. Additionally, we highlight the limitations of current evaluation metrics and propose new metrics for better lip-syncing evaluation between speech and facial movements.
EmoVOCA: Speech-Driven Emotional 3D Talking Heads
Published in IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025
We present EmoVOCA, a novel dataset that can be used to train a model to generate emotional 3D talking heads. The proposed method is capable of generating emotional 3D talking heads based on a speech track, an intensity label, an emotion label, and an actor to animate
talks
Talk 1 on Relevant Topic in Your Field
Published:
This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!
Conference Proceeding talk 3 on Relevant Topic in Your Field
Published:
This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.
teaching
Teaching experience 1
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Teaching experience 2
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.