GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
Vložit
- čas přidán 9. 09. 2024
- Project: shenhanqian.gi...
We introduce GaussianAvatars, a new method to create photorealistic head avatars that are fully controllable in terms of expression, pose, and viewpoint. The core idea is a dynamic 3D representation based on 3D Gaussian splats that are rigged to a parametric morphable face model. This combination facilitates photorealistic rendering while allowing for precise animation control via the underlying parametric model, e.g., through expression transfer from a driving sequence or by manually changing the morphable model parameters. We parameterize each splat by a local coordinate frame of a triangle and optimize for explicit displacement offset to obtain a more accurate geometric representation. During avatar reconstruction, we jointly optimize for the morphable model parameters and Gaussian splat parameters in an end-to-end fashion. We demonstrate the animation capabilities of our photorealistic avatar in several challenging scenarios. For instance, we show reenactments from a driving video, where our method outperforms existing works by a significant margin.
This is incredible. Very smart to combine the different rendering pipelines to get the best of both worlds, bravo!
Ah man this won't go public anytime soon, but just another crazy mic drop from Prof. Niessner 👌🏽
dis is amazing thanks! looking forward to the source code release 😍
The space is heating up! arxiv 2312.03029 (Gaussian Head Avatars) published at around same time, shows similar results and approach
has the gaussian head avatar code been published yet? It`s marked as public on their git but the code only consists of a readme file as of yet
Amazing, can’t wait to play with this!
Amazing project. Is there a github code to try pls?
Amazing ! Game changer for avatars
When you guys release code ?
Revolutionary.
Wow! Quite amazing!
Impressive
Great job
Incredible ! !
Wow; excellent work!
When will the code be made available?
I literally just saw another gaussian video and I thought "couldn't you combine polygons with gaussians?" and then I saw this lol xD
wow love it
Great!
what is the software you used , control joints and expressions
I'd like to try this 👍🏻
Great 👍🏻 😊
I want an avatar like this of myself, how do I become part of this program?
Awwwesome mate! 🔥🔥🔥
So.. LA Noire 2? 😁
What’s happening anymore
Why do I feel an impending sense of doom for our society?
The end is just the beginning