Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
Paper page - HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors
[go: Go Back, main page]

https://headgap.github.io/

\n","updatedAt":"2024-08-13T03:06:16.467Z","author":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","fullname":"AK","name":"akhaliq","type":"user","isPro":false,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":9179,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.2665840983390808},"editors":["akhaliq"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg"],"reactions":[{"reaction":"๐Ÿค","users":["zhaohu2","walsvid"],"count":2}],"isReport":false}},{"id":"66bc0927bfdf2873fc5d3bbd","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false},"createdAt":"2024-08-14T01:32:23.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"This is an automated message from the [Librarian Bot](https://huggingface.co/librarian-bots). I found the following papers similar to this paper. \n\nThe following papers were recommended by the Semantic Scholar API \n\n* [FAGhead: Fully Animate Gaussian Head from Monocular Videos](https://huggingface.co/papers/2406.19070) (2024)\n* [PAV: Personalized Head Avatar from Unstructured Video Collection](https://huggingface.co/papers/2407.21047) (2024)\n* [3D Gaussian Parametric Head Model](https://huggingface.co/papers/2407.15070) (2024)\n* [Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360{\\deg}](https://huggingface.co/papers/2408.00296) (2024)\n* [Portrait3D: 3D Head Generation from Single In-the-wild Portrait Image](https://huggingface.co/papers/2406.16710) (2024)\n\n\n Please give a thumbs up to this comment if you found it helpful!\n\n If you want recommendations for any Paper on Hugging Face checkout [this](https://huggingface.co/spaces/librarian-bots/recommend_similar_papers) Space\n\n You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: `@librarian-bot recommend`","html":"

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

\n

The following papers were recommended by the Semantic Scholar API

\n\n

Please give a thumbs up to this comment if you found it helpful!

\n

If you want recommendations for any Paper on Hugging Face checkout this Space

\n

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot\n\t recommend

\n","updatedAt":"2024-08-14T01:32:23.790Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7520151138305664},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[{"reaction":"๐Ÿ‘","users":["zhaohu2"],"count":1}],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2408.06019","authors":[{"_id":"66bacd9ec9b2ab14b3988f49","user":{"_id":"66bb2f13a0ebe4b8a598956e","avatarUrl":"/avatars/fbc429db27443fb47769167f0eb3fd9e.svg","isPro":false,"fullname":"Xiaozheng Zheng","user":"zxz267","type":"user"},"name":"Xiaozheng Zheng","status":"claimed_verified","statusLastChangedAt":"2024-08-13T10:04:14.062Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4a","user":{"_id":"650d0c442a602ba349183fca","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/650d0c442a602ba349183fca/-UId-lPK64nRXjGxPJE9k.png","isPro":false,"fullname":"Chao Wen","user":"walsvid","type":"user"},"name":"Chao Wen","status":"claimed_verified","statusLastChangedAt":"2024-08-13T07:38:14.286Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4b","user":{"_id":"66a31d9e9b39142573bfbb55","avatarUrl":"/avatars/2835e50156b9ae5cdfdc8514e6a102d0.svg","isPro":false,"fullname":"zhaohu li","user":"zhaohu2","type":"user"},"name":"Zhaohu Li","status":"admin_assigned","statusLastChangedAt":"2024-08-13T09:16:03.604Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4c","name":"Weiyi Zhang","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4d","user":{"_id":"655238b2957bf8a398eca2a1","avatarUrl":"/avatars/f0e5af3de113b998bcf84953ecd8b930.svg","isPro":false,"fullname":"Zhuo Su","user":"hellozhuo","type":"user"},"name":"Zhuo Su","status":"admin_assigned","statusLastChangedAt":"2024-08-13T09:16:26.838Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4e","name":"Xu Chang","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4f","name":"Yang Zhao","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f50","name":"Zheng Lv","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f51","name":"Xiaoyuan Zhang","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f52","user":{"_id":"64c62590ed521f27a41f9338","avatarUrl":"/avatars/0e849359c0acac44d2513775cb6d3300.svg","isPro":false,"fullname":"Zhang Yongjie","user":"yongjie-zhang-mail","type":"user"},"name":"Yongjie Zhang","status":"admin_assigned","statusLastChangedAt":"2024-08-13T09:17:34.434Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f53","name":"Guidong Wang","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f54","name":"Lan Xu","hidden":false}],"publishedAt":"2024-08-12T09:19:38.000Z","submittedOnDailyAt":"2024-08-13T01:36:16.455Z","title":"HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"In this paper, we present a novel 3D head avatar creation approach capable of\ngeneralizing from few-shot in-the-wild data with high-fidelity and animatable\nrobustness. Given the underconstrained nature of this problem, incorporating\nprior knowledge is essential. Therefore, we propose a framework comprising\nprior learning and avatar creation phases. The prior learning phase leverages\n3D head priors derived from a large-scale multi-view dynamic dataset, and the\navatar creation phase applies these priors for few-shot personalization. Our\napproach effectively captures these priors by utilizing a Gaussian\nSplatting-based auto-decoder network with part-based dynamic modeling. Our\nmethod employs identity-shared encoding with personalized latent codes for\nindividual identities to learn the attributes of Gaussian primitives. During\nthe avatar creation phase, we achieve fast head avatar personalization by\nleveraging inversion and fine-tuning strategies. Extensive experiments\ndemonstrate that our model effectively exploits head priors and successfully\ngeneralizes them to few-shot personalization, achieving photo-realistic\nrendering quality, multi-view consistency, and stable animation.","upvotes":15,"discussionId":"66bacda2c9b2ab14b398905b","ai_summary":"A framework for creating 3D photorealistic and animatable head avatars using prior learning and few-shot personalization with Gaussian Splatting and dynamic modeling.","ai_keywords":["Gaussian Splatting","auto-decoder network","part-based dynamic modeling","personalized latent codes","prior learning","inversion","fine-tuning","multi-view consistency","photo-realistic rendering","stable animation"]},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"650d0c442a602ba349183fca","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/650d0c442a602ba349183fca/-UId-lPK64nRXjGxPJE9k.png","isPro":false,"fullname":"Chao Wen","user":"walsvid","type":"user"},{"_id":"66bb2f13a0ebe4b8a598956e","avatarUrl":"/avatars/fbc429db27443fb47769167f0eb3fd9e.svg","isPro":false,"fullname":"Xiaozheng Zheng","user":"zxz267","type":"user"},{"_id":"66bb69126e27180d30734a8f","avatarUrl":"/avatars/42ab451b71010545a470f545bbe4694b.svg","isPro":false,"fullname":"hooded strider","user":"hoodedstrider","type":"user"},{"_id":"641b754d1911d3be6745cce9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/641b754d1911d3be6745cce9/Ydjcjd4VuNUGj5Cd4QHdB.png","isPro":false,"fullname":"atayloraerospace","user":"Taylor658","type":"user"},{"_id":"64f15d2662a7109a6e72be2a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64f15d2662a7109a6e72be2a/NDM5sKZ4eN3FSeOIW3U1I.jpeg","isPro":false,"fullname":"luokai","user":"iamluokai","type":"user"},{"_id":"61e7c06064d3c6c929057bee","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61e7c06064d3c6c929057bee/QxULx1EA1bgmjXxupQX4B.jpeg","isPro":false,"fullname":"่“‹็‘ž็Ž‹","user":"gary109","type":"user"},{"_id":"62716952bcef985363db8485","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62716952bcef985363db8485/zJPPo5xlwZRJdEuwYsYKp.jpeg","isPro":true,"fullname":"JB D.","user":"IAMJB","type":"user"},{"_id":"63a7422854f1d0225b075bfc","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63a7422854f1d0225b075bfc/XGYAcDPZG5ZEsNBWG6guw.jpeg","isPro":true,"fullname":"lhl","user":"leonardlin","type":"user"},{"_id":"65676a0a461af93fca9f2329","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65676a0a461af93fca9f2329/-CB4C1C6yLM4gRU2K5gsS.jpeg","isPro":false,"fullname":"Juan Delgadillo","user":"juandelgadillo","type":"user"},{"_id":"64316678dec2a70d8130aa9d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/EAS7OJwvyInle8J7IIBbw.jpeg","isPro":false,"fullname":"Levi Sverdlov","user":"Sverd","type":"user"},{"_id":"6538119803519fddb4a17e10","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg","isPro":false,"fullname":"samusenps","user":"samusenps","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":0}">
Papers
arxiv:2408.06019

HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors

Published on Aug 12, 2024
ยท Submitted by
AK
on Aug 13, 2024
Authors:
,
,
,
,
,
,

Abstract

A framework for creating 3D photorealistic and animatable head avatars using prior learning and few-shot personalization with Gaussian Splatting and dynamic modeling.

AI-generated summary

In this paper, we present a novel 3D head avatar creation approach capable of generalizing from few-shot in-the-wild data with high-fidelity and animatable robustness. Given the underconstrained nature of this problem, incorporating prior knowledge is essential. Therefore, we propose a framework comprising prior learning and avatar creation phases. The prior learning phase leverages 3D head priors derived from a large-scale multi-view dynamic dataset, and the avatar creation phase applies these priors for few-shot personalization. Our approach effectively captures these priors by utilizing a Gaussian Splatting-based auto-decoder network with part-based dynamic modeling. Our method employs identity-shared encoding with personalized latent codes for individual identities to learn the attributes of Gaussian primitives. During the avatar creation phase, we achieve fast head avatar personalization by leveraging inversion and fine-tuning strategies. Extensive experiments demonstrate that our model effectively exploits head priors and successfully generalizes them to few-shot personalization, achieving photo-realistic rendering quality, multi-view consistency, and stable animation.

Community

Paper submitter

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2408.06019 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2408.06019 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2408.06019 in a Space README.md to link it from this page.

Collections including this paper 5