HeadStudio: Text to Animatable Head Avatars
with 3D Gaussian Splatting


ECCV 2024

Zhenglin Zhou, Fan Ma, Hehe Fan, Zongxin Yang, Yi Yang✉

ReLER, CCAI, Zhejiang University


Video


Method Overview


Framework of HeadStudio, which integrates animatable head prior model into 3D Gaussian splatting and score distillation sampling. 1) Animatable Head Gaussian: each 3D point is rigged to a mesh, and then rotated, scaled, and translated by the mesh deformation. 2) Text to Avatar Optimization: enhance the optimization from initialization, distillation and regularization, including: super-dense Gaussian initialization, animation-based text-to-3D distillation, and adaptive geometry regularization.

Text to Static Avatar Generation

Comparison with the text to static avatar generation methods. HeadStudio excels at producing high-fidelity head avatars, yielding superior results.

Text to Dynamic Avatar Generation

Comparison with the text to dynamic avatar generation methods. HeadStudio provides effective semantic alignment, smooth expression deformation, and real-time rendering.

Easter Egg


Citation


  @inproceedings{zhou2024headstudio,
  title = {HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting},
  author = {Zhenglin Zhou and Fan Ma and Hehe Fan and Zongxin Yang and Yi Yang},
  booktitle = {ECCV},
  year={2024},
}