https://github.com/open-mmlab/Amphion
Also we are working hard on HF demos, checkout this week: https://huggingface.co/amphion

\n","updatedAt":"2023-12-18T05:08:36.356Z","author":{"_id":"63b4dcefa50cfcefdaa121f3","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg","fullname":"Dr Wuz","name":"drwuz","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":14,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.673149585723877},"editors":["drwuz"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg"],"reactions":[{"reaction":"👍","users":["RMSnow","viewfinder-annn","zyingt","AdinaY","HarryHe","julien-c","HDiffusion","lmxue","sdtana","huggingmyAPI","osanseviero","cornelliusyudhawijaya","Chunte"],"count":13}],"isReport":false}},{"id":"658056fc7c71acb646471af1","author":{"_id":"5dd96eb166059660ed1ee413","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/NQtzmrDdbG0H8qkZvRyGk.jpeg","fullname":"Julien Chaumond","name":"julien-c","type":"user","isPro":true,"isHf":true,"isHfAdmin":true,"isMod":false,"followerCount":3839,"isUserFollowing":false},"createdAt":"2023-12-18T14:28:12.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"@drwuz looking forward 🔥","html":"

\n\n@drwuz\n\t looking forward 🔥

\n","updatedAt":"2023-12-18T14:28:12.164Z","author":{"_id":"5dd96eb166059660ed1ee413","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/NQtzmrDdbG0H8qkZvRyGk.jpeg","fullname":"Julien Chaumond","name":"julien-c","type":"user","isPro":true,"isHf":true,"isHfAdmin":true,"isMod":false,"followerCount":3839,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.47246992588043213},"editors":["julien-c"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/NQtzmrDdbG0H8qkZvRyGk.jpeg"],"reactions":[],"isReport":false}},{"id":"658450062ae9280873b369f0","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false},"createdAt":"2023-12-21T14:47:34.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"This is an automated message from the [Librarian Bot](https://huggingface.co/librarian-bots). I found the following papers similar to this paper. \n\nThe following papers were recommended by the Semantic Scholar API \n\n* [Improved Child Text-to-Speech Synthesis through Fastpitch-based Transfer Learning](https://huggingface.co/papers/2311.04313) (2023)\n* [HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesis](https://huggingface.co/papers/2311.12454) (2023)\n* [Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realism](https://huggingface.co/papers/2312.06613) (2023)\n* [SELM: Speech Enhancement Using Discrete Tokens and Language Models](https://huggingface.co/papers/2312.09747) (2023)\n* [MM-TTS: Multi-modal Prompt based Style Transfer for Expressive Text-to-Speech Synthesis](https://huggingface.co/papers/2312.10687) (2023)\n\n Please give a thumbs up to this comment if you found it helpful!\n\n If you want recommendations for any Paper on Hugging Face checkout [this](https://huggingface.co/spaces/librarian-bots/recommend_similar_papers) Space","html":"

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

\n

The following papers were recommended by the Semantic Scholar API

\n

\n
• Improved Child Text-to-Speech Synthesis through Fastpitch-based Transfer Learning (2023)
\n
• HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesis (2023)
\n
• Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realism (2023)
\n
• SELM: Speech Enhancement Using Discrete Tokens and Language Models (2023)
\n
• MM-TTS: Multi-modal Prompt based Style Transfer for Expressive Text-to-Speech Synthesis (2023)
\n

\n

Please give a thumbs up to this comment if you found it helpful!

\n

If you want recommendations for any Paper on Hugging Face checkout this Space

\n","updatedAt":"2023-12-21T14:47:34.706Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7757169008255005},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[],"isReport":false}},{"id":"658e1fa30f4519bfc222a643","author":{"_id":"63b4dcefa50cfcefdaa121f3","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg","fullname":"Dr Wuz","name":"drwuz","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":14,"isUserFollowing":false},"createdAt":"2023-12-29T01:23:47.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"> @drwuz looking forward 🔥\n\nThanks Julien for following our work. We are working hard on it, and updated demos will come in Jan.","html":"

\n

\n\n@drwuz\n\t looking forward 🔥

\n

\n

Thanks Julien for following our work. We are working hard on it, and updated demos will come in Jan.

\n","updatedAt":"2023-12-29T01:23:47.303Z","author":{"_id":"63b4dcefa50cfcefdaa121f3","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg","fullname":"Dr Wuz","name":"drwuz","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":14,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.900365948677063},"editors":["drwuz"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg"],"reactions":[],"isReport":false}},{"id":"67a6e1c1b4fa67845b74d2fb","author":{"_id":"623e19ff8972a8c030af5277","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/623e19ff8972a8c030af5277/jq9jfT_Sl5B1ZSMHGmBFX.jpeg","fullname":"Jeremy Howard","name":"jph00","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":317,"isUserFollowing":false},"createdAt":"2025-02-08T04:46:57.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"@drwuz any updates on this very exciting project?","html":"

\n\n@drwuz\n\t any updates on this very exciting project?

\n","updatedAt":"2025-02-08T04:46:57.120Z","author":{"_id":"623e19ff8972a8c030af5277","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/623e19ff8972a8c030af5277/jq9jfT_Sl5B1ZSMHGmBFX.jpeg","fullname":"Jeremy Howard","name":"jph00","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":317,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8197328448295593},"editors":["jph00"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/623e19ff8972a8c030af5277/jq9jfT_Sl5B1ZSMHGmBFX.jpeg"],"reactions":[{"reaction":"🔥","users":["julien-c"],"count":1}],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2312.09911","authors":[{"_id":"657fd182c7cb69069abc3748","user":{"_id":"60486b2cec955c4994bb6249","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60486b2cec955c4994bb6249/qNHSGbTA7svVWEO3BI3M7.jpeg","isPro":false,"fullname":"Xueyao Zhang","user":"RMSnow","type":"user"},"name":"Xueyao Zhang","status":"admin_assigned","statusLastChangedAt":"2023-12-18T08:47:33.064Z","hidden":false},{"_id":"657fd182c7cb69069abc3749","user":{"_id":"6290e961473e457463a53248","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6290e961473e457463a53248/-58Dp5uHvdjs9yOupAMs0.jpeg","isPro":true,"fullname":"Liumeng Xue","user":"lmxue","type":"user"},"name":"Liumeng Xue","status":"admin_assigned","statusLastChangedAt":"2023-12-18T08:49:52.539Z","hidden":false},{"_id":"657fd182c7cb69069abc374a","user":{"_id":"6539cc2d48b006575d3f5da2","avatarUrl":"/avatars/a2ac1973800e8bb6a72e35fefb436a27.svg","isPro":false,"fullname":"wangyuancheng","user":"CXKyyds199","type":"user"},"name":"Yuancheng Wang","status":"admin_assigned","statusLastChangedAt":"2023-12-18T08:50:12.902Z","hidden":false},{"_id":"657fd182c7cb69069abc374b","user":{"_id":"656eb03d228bbe9eb46f163d","avatarUrl":"/avatars/47b75f913a40e22f178b62eaea5272d4.svg","isPro":false,"fullname":"YichengGu","user":"Setsugesuka","type":"user"},"name":"Yicheng Gu","status":"claimed_verified","statusLastChangedAt":"2024-02-16T08:36:27.660Z","hidden":false},{"_id":"657fd182c7cb69069abc374c","name":"Xi Chen","hidden":false},{"_id":"657fd182c7cb69069abc374d","user":{"_id":"6580349d9aee950d4a8aa134","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/cMXAUckwqGm01K28Oxb1w.png","isPro":false,"fullname":"Zihao Fang","user":"WelkinFang","type":"user"},"name":"Zihao Fang","status":"claimed_verified","statusLastChangedAt":"2023-12-20T09:54:27.004Z","hidden":false},{"_id":"657fd182c7cb69069abc374e","name":"Haopeng Chen","hidden":false},{"_id":"657fd182c7cb69069abc374f","user":{"_id":"656558f04914c4787126edf6","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/656558f04914c4787126edf6/EEO8t_qbTtvDymuAx8NFe.jpeg","isPro":false,"fullname":"Zou Lexiao","user":"Lokshaw","type":"user"},"name":"Lexiao Zou","status":"admin_assigned","statusLastChangedAt":"2023-12-18T08:51:08.410Z","hidden":false},{"_id":"657fd182c7cb69069abc3750","user":{"_id":"649934bebe8a8211291ac9b5","avatarUrl":"/avatars/7df445dee65329b3569c818381c388d9.svg","isPro":false,"fullname":"wang","user":"chaoren1937","type":"user"},"name":"Chaoren Wang","status":"admin_assigned","statusLastChangedAt":"2023-12-18T08:51:18.827Z","hidden":false},{"_id":"657fd182c7cb69069abc3751","user":{"_id":"6580149b9248a35061fb6f96","avatarUrl":"/avatars/48d8dda9b32c3e07834b293f7d914654.svg","isPro":false,"fullname":"Jun Han","user":"junhan91","type":"user"},"name":"Jun Han","status":"claimed_verified","statusLastChangedAt":"2023-12-18T10:21:37.675Z","hidden":false},{"_id":"657fd182c7cb69069abc3752","name":"Kai Chen","hidden":false},{"_id":"657fd182c7cb69069abc3753","name":"Haizhou Li","hidden":false},{"_id":"657fd182c7cb69069abc3754","user":{"_id":"63b4dcefa50cfcefdaa121f3","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg","isPro":false,"fullname":"Dr Wuz","user":"drwuz","type":"user"},"name":"Zhizheng Wu","status":"claimed_verified","statusLastChangedAt":"2023-12-18T14:30:45.755Z","hidden":false}],"publishedAt":"2023-12-15T16:23:21.000Z","submittedOnDailyAt":"2023-12-18T02:28:43.733Z","title":"Amphion: An Open-Source Audio, Music and Speech Generation Toolkit","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"Amphion is a toolkit for Audio, Music, and Speech Generation. Its purpose is\nto support reproducible research and help junior researchers and engineers get\nstarted in the field of audio, music, and speech generation research and\ndevelopment. Amphion offers a unique feature: visualizations of classic models\nor architectures. We believe that these visualizations are beneficial for\njunior researchers and engineers who wish to gain a better understanding of the\nmodel. The North-Star objective of Amphion is to offer a platform for studying\nthe conversion of any inputs into general audio. Amphion is designed to support\nindividual generation tasks. In addition to the specific generation tasks,\nAmphion also includes several vocoders and evaluation metrics. A vocoder is an\nimportant module for producing high-quality audio signals, while evaluation\nmetrics are critical for ensuring consistent metrics in generation tasks. In\nthis paper, we provide a high-level overview of Amphion.","upvotes":55,"discussionId":"657fd183c7cb69069abc377d","githubRepo":"https://github.com/open-mmlab/amphion","githubRepoAddedBy":"auto","ai_summary":"Amphion is a toolkit for audio, music, and speech generation that includes model visualizations, vocoders, and evaluation metrics to support reproducible research and training for researchers.","ai_keywords":["vocoder","evaluation metrics"],"githubStars":9690},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"6419d25a9a27800807c43069","avatarUrl":"/avatars/1035e8823946227fe7410c2473bc0690.svg","isPro":false,"fullname":"Shivam Kumar","user":"shivamkumar","type":"user"},{"_id":"6457c906c64b3643842eba71","avatarUrl":"/avatars/960b4028f15b6f694e4aded609ac5b79.svg","isPro":false,"fullname":"Mohammad Ahmed","user":"Almothana74","type":"user"},{"_id":"64cc87e471b435a75de026f1","avatarUrl":"/avatars/6fc1a2505d18576a1933633c4b13d805.svg","isPro":false,"fullname":"xuyangcao","user":"newxuyangcao","type":"user"},{"_id":"62d21af0857da6165f9ab3aa","avatarUrl":"/avatars/1b1b1af69702064dbfb5fe066f06f040.svg","isPro":false,"fullname":"Jichen Wen","user":"AI-Biobot","type":"user"},{"_id":"63fb6e0c0aab060792f865c9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1677422075109-noauth.jpeg","isPro":false,"fullname":"RockyChan","user":"cloki0610","type":"user"},{"_id":"62e54f0eae9d3f10acb95cb9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62e54f0eae9d3f10acb95cb9/VAyk05hqB3OZWXEZW-B0q.png","isPro":true,"fullname":"mrfakename","user":"mrfakename","type":"user"},{"_id":"657fdd6b42fc53e18b89b856","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/657fdd6b42fc53e18b89b856/kAPLFmH7Bq8WwE3hhDb9H.jpeg","isPro":false,"fullname":"Chaoren Wang","user":"yuantuo666","type":"user"},{"_id":"61e7c06064d3c6c929057bee","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61e7c06064d3c6c929057bee/QxULx1EA1bgmjXxupQX4B.jpeg","isPro":false,"fullname":"蓋瑞王","user":"gary109","type":"user"},{"_id":"63b4dcefa50cfcefdaa121f3","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63b4dcefa50cfcefdaa121f3/MlIxOaTSCbZARVyo8Ly7r.jpeg","isPro":false,"fullname":"Dr Wuz","user":"drwuz","type":"user"},{"_id":"61a7569eaf0333e76eb428a8","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61a7569eaf0333e76eb428a8/zwseNheR4Hx0DtCmf_v5H.jpeg","isPro":false,"fullname":"HarryHe11","user":"HarryHe","type":"user"},{"_id":"6290e961473e457463a53248","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6290e961473e457463a53248/-58Dp5uHvdjs9yOupAMs0.jpeg","isPro":true,"fullname":"Liumeng Xue","user":"lmxue","type":"user"},{"_id":"63072d60cd148dbc5e49f4dd","avatarUrl":"/avatars/ffa61038c0ff20848fbcde7c1c34570e.svg","isPro":false,"fullname":"Yuancheng Wang","user":"Hecheng0625","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":1}">