Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456 Paper page - HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors
https://headgap.github.io/\n","updatedAt":"2024-08-13T03:06:16.467Z","author":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","fullname":"AK","name":"akhaliq","type":"user","isPro":false,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":9179,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.2665840983390808},"editors":["akhaliq"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg"],"reactions":[{"reaction":"๐ค","users":["zhaohu2","walsvid"],"count":2}],"isReport":false}},{"id":"66bc0927bfdf2873fc5d3bbd","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false},"createdAt":"2024-08-14T01:32:23.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"This is an automated message from the [Librarian Bot](https://huggingface.co/librarian-bots). I found the following papers similar to this paper. \n\nThe following papers were recommended by the Semantic Scholar API \n\n* [FAGhead: Fully Animate Gaussian Head from Monocular Videos](https://huggingface.co/papers/2406.19070) (2024)\n* [PAV: Personalized Head Avatar from Unstructured Video Collection](https://huggingface.co/papers/2407.21047) (2024)\n* [3D Gaussian Parametric Head Model](https://huggingface.co/papers/2407.15070) (2024)\n* [Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360{\\deg}](https://huggingface.co/papers/2408.00296) (2024)\n* [Portrait3D: 3D Head Generation from Single In-the-wild Portrait Image](https://huggingface.co/papers/2406.16710) (2024)\n\n\n Please give a thumbs up to this comment if you found it helpful!\n\n If you want recommendations for any Paper on Hugging Face checkout [this](https://huggingface.co/spaces/librarian-bots/recommend_similar_papers) Space\n\n You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: `@librarian-bot recommend`","html":"
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
\n
The following papers were recommended by the Semantic Scholar API
Please give a thumbs up to this comment if you found it helpful!
\n
If you want recommendations for any Paper on Hugging Face checkout this Space
\n
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot\n\t recommend
\n","updatedAt":"2024-08-14T01:32:23.790Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7520151138305664},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[{"reaction":"๐","users":["zhaohu2"],"count":1}],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2408.06019","authors":[{"_id":"66bacd9ec9b2ab14b3988f49","user":{"_id":"66bb2f13a0ebe4b8a598956e","avatarUrl":"/avatars/fbc429db27443fb47769167f0eb3fd9e.svg","isPro":false,"fullname":"Xiaozheng Zheng","user":"zxz267","type":"user"},"name":"Xiaozheng Zheng","status":"claimed_verified","statusLastChangedAt":"2024-08-13T10:04:14.062Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4a","user":{"_id":"650d0c442a602ba349183fca","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/650d0c442a602ba349183fca/-UId-lPK64nRXjGxPJE9k.png","isPro":false,"fullname":"Chao Wen","user":"walsvid","type":"user"},"name":"Chao Wen","status":"claimed_verified","statusLastChangedAt":"2024-08-13T07:38:14.286Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4b","user":{"_id":"66a31d9e9b39142573bfbb55","avatarUrl":"/avatars/2835e50156b9ae5cdfdc8514e6a102d0.svg","isPro":false,"fullname":"zhaohu li","user":"zhaohu2","type":"user"},"name":"Zhaohu Li","status":"admin_assigned","statusLastChangedAt":"2024-08-13T09:16:03.604Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4c","name":"Weiyi Zhang","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4d","user":{"_id":"655238b2957bf8a398eca2a1","avatarUrl":"/avatars/f0e5af3de113b998bcf84953ecd8b930.svg","isPro":false,"fullname":"Zhuo Su","user":"hellozhuo","type":"user"},"name":"Zhuo Su","status":"admin_assigned","statusLastChangedAt":"2024-08-13T09:16:26.838Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4e","name":"Xu Chang","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f4f","name":"Yang Zhao","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f50","name":"Zheng Lv","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f51","name":"Xiaoyuan Zhang","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f52","user":{"_id":"64c62590ed521f27a41f9338","avatarUrl":"/avatars/0e849359c0acac44d2513775cb6d3300.svg","isPro":false,"fullname":"Zhang Yongjie","user":"yongjie-zhang-mail","type":"user"},"name":"Yongjie Zhang","status":"admin_assigned","statusLastChangedAt":"2024-08-13T09:17:34.434Z","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f53","name":"Guidong Wang","hidden":false},{"_id":"66bacd9ec9b2ab14b3988f54","name":"Lan Xu","hidden":false}],"publishedAt":"2024-08-12T09:19:38.000Z","submittedOnDailyAt":"2024-08-13T01:36:16.455Z","title":"HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"In this paper, we present a novel 3D head avatar creation approach capable of\ngeneralizing from few-shot in-the-wild data with high-fidelity and animatable\nrobustness. Given the underconstrained nature of this problem, incorporating\nprior knowledge is essential. Therefore, we propose a framework comprising\nprior learning and avatar creation phases. The prior learning phase leverages\n3D head priors derived from a large-scale multi-view dynamic dataset, and the\navatar creation phase applies these priors for few-shot personalization. Our\napproach effectively captures these priors by utilizing a Gaussian\nSplatting-based auto-decoder network with part-based dynamic modeling. Our\nmethod employs identity-shared encoding with personalized latent codes for\nindividual identities to learn the attributes of Gaussian primitives. During\nthe avatar creation phase, we achieve fast head avatar personalization by\nleveraging inversion and fine-tuning strategies. Extensive experiments\ndemonstrate that our model effectively exploits head priors and successfully\ngeneralizes them to few-shot personalization, achieving photo-realistic\nrendering quality, multi-view consistency, and stable animation.","upvotes":15,"discussionId":"66bacda2c9b2ab14b398905b","ai_summary":"A framework for creating 3D photorealistic and animatable head avatars using prior learning and few-shot personalization with Gaussian Splatting and dynamic modeling.","ai_keywords":["Gaussian Splatting","auto-decoder network","part-based dynamic modeling","personalized latent codes","prior learning","inversion","fine-tuning","multi-view consistency","photo-realistic rendering","stable animation"]},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"650d0c442a602ba349183fca","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/650d0c442a602ba349183fca/-UId-lPK64nRXjGxPJE9k.png","isPro":false,"fullname":"Chao Wen","user":"walsvid","type":"user"},{"_id":"66bb2f13a0ebe4b8a598956e","avatarUrl":"/avatars/fbc429db27443fb47769167f0eb3fd9e.svg","isPro":false,"fullname":"Xiaozheng Zheng","user":"zxz267","type":"user"},{"_id":"66bb69126e27180d30734a8f","avatarUrl":"/avatars/42ab451b71010545a470f545bbe4694b.svg","isPro":false,"fullname":"hooded strider","user":"hoodedstrider","type":"user"},{"_id":"641b754d1911d3be6745cce9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/641b754d1911d3be6745cce9/Ydjcjd4VuNUGj5Cd4QHdB.png","isPro":false,"fullname":"atayloraerospace","user":"Taylor658","type":"user"},{"_id":"64f15d2662a7109a6e72be2a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64f15d2662a7109a6e72be2a/NDM5sKZ4eN3FSeOIW3U1I.jpeg","isPro":false,"fullname":"luokai","user":"iamluokai","type":"user"},{"_id":"61e7c06064d3c6c929057bee","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61e7c06064d3c6c929057bee/QxULx1EA1bgmjXxupQX4B.jpeg","isPro":false,"fullname":"่็็","user":"gary109","type":"user"},{"_id":"62716952bcef985363db8485","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62716952bcef985363db8485/zJPPo5xlwZRJdEuwYsYKp.jpeg","isPro":true,"fullname":"JB D.","user":"IAMJB","type":"user"},{"_id":"63a7422854f1d0225b075bfc","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63a7422854f1d0225b075bfc/XGYAcDPZG5ZEsNBWG6guw.jpeg","isPro":true,"fullname":"lhl","user":"leonardlin","type":"user"},{"_id":"65676a0a461af93fca9f2329","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65676a0a461af93fca9f2329/-CB4C1C6yLM4gRU2K5gsS.jpeg","isPro":false,"fullname":"Juan Delgadillo","user":"juandelgadillo","type":"user"},{"_id":"64316678dec2a70d8130aa9d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/EAS7OJwvyInle8J7IIBbw.jpeg","isPro":false,"fullname":"Levi Sverdlov","user":"Sverd","type":"user"},{"_id":"6538119803519fddb4a17e10","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg","isPro":false,"fullname":"samusenps","user":"samusenps","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":0}">
A framework for creating 3D photorealistic and animatable head avatars using prior learning and few-shot personalization with Gaussian Splatting and dynamic modeling.
AI-generated summary
In this paper, we present a novel 3D head avatar creation approach capable of
generalizing from few-shot in-the-wild data with high-fidelity and animatable
robustness. Given the underconstrained nature of this problem, incorporating
prior knowledge is essential. Therefore, we propose a framework comprising
prior learning and avatar creation phases. The prior learning phase leverages
3D head priors derived from a large-scale multi-view dynamic dataset, and the
avatar creation phase applies these priors for few-shot personalization. Our
approach effectively captures these priors by utilizing a Gaussian
Splatting-based auto-decoder network with part-based dynamic modeling. Our
method employs identity-shared encoding with personalized latent codes for
individual identities to learn the attributes of Gaussian primitives. During
the avatar creation phase, we achieve fast head avatar personalization by
leveraging inversion and fine-tuning strategies. Extensive experiments
demonstrate that our model effectively exploits head priors and successfully
generalizes them to few-shot personalization, achieving photo-realistic
rendering quality, multi-view consistency, and stable animation.