https://github.com/NVIDIA/Cosmos

\n","updatedAt":"2025-01-08T05:45:09.160Z","author":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","fullname":"AK","name":"akhaliq","type":"user","isPro":false,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":9179,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.5187156200408936},"editors":["akhaliq"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg"],"reactions":[{"reaction":"👍","users":["Addox"],"count":1}],"isReport":false}},{"id":"677f2c16eeb0c87ca70c99f0","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false},"createdAt":"2025-01-09T01:53:26.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"This is an automated message from the [Librarian Bot](https://huggingface.co/librarian-bots). I found the following papers similar to this paper. \n\nThe following papers were recommended by the Semantic Scholar API \n\n* [Synthetic Vision: Training Vision-Language Models to Understand Physics](https://huggingface.co/papers/2412.08619) (2024)\n* [Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation](https://huggingface.co/papers/2412.15109) (2024)\n* [OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Driving](https://huggingface.co/papers/2412.15208) (2024)\n* [DeepSeek-V3 Technical Report](https://huggingface.co/papers/2412.19437) (2024)\n* [DroidCall: A Dataset for LLM-powered Android Intent Invocation](https://huggingface.co/papers/2412.00402) (2024)\n* [Local deployment of large-scale music AI models on commodity hardware](https://huggingface.co/papers/2411.09625) (2024)\n* [Large Action Models: From Inception to Implementation](https://huggingface.co/papers/2412.10047) (2024)\n\n\n Please give a thumbs up to this comment if you found it helpful!\n\n If you want recommendations for any Paper on Hugging Face checkout [this](https://huggingface.co/spaces/librarian-bots/recommend_similar_papers) Space\n\n You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: `@librarian-bot recommend`","html":"

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

\n

The following papers were recommended by the Semantic Scholar API

\n

\n
• Synthetic Vision: Training Vision-Language Models to Understand Physics (2024)
\n
• Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation (2024)
\n
• OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Driving (2024)
\n
• DeepSeek-V3 Technical Report (2024)
\n
• DroidCall: A Dataset for LLM-powered Android Intent Invocation (2024)
\n
• Local deployment of large-scale music AI models on commodity hardware (2024)
\n
• Large Action Models: From Inception to Implementation (2024)
\n

\n

Please give a thumbs up to this comment if you found it helpful!

\n

If you want recommendations for any Paper on Hugging Face checkout this Space

\n

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot\n\t recommend

\n","updatedAt":"2025-01-09T01:53:26.095Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7315129041671753},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2501.03575","authors":[{"_id":"677dfaa14bf7f0d4734088a4","name":"NVIDIA","hidden":false},{"_id":"677dfaa14bf7f0d4734088a6","user":{"_id":"667b2e7f0ae3fef85fe33eb9","avatarUrl":"/avatars/033f74277bf934d8d9703e9a8c5a6716.svg","isPro":false,"fullname":"Niket Agarwal","user":"niketa12","type":"user"},"name":"Niket Agarwal","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:41:16.772Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088a7","user":{"_id":"6517ec608a6d58d1d7ec8ec1","avatarUrl":"/avatars/4aac7fa6643f7f2d32e95cc991130ee9.svg","isPro":false,"fullname":"Arslan Ali","user":"arslanali","type":"user"},"name":"Arslan Ali","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:41:24.513Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088a8","user":{"_id":"675304737c4876b7a1475695","avatarUrl":"/avatars/7ee3c443f6a143b4a79d679fb7f60fe5.svg","isPro":false,"fullname":"Maciej Bala","user":"mbalaNV","type":"user"},"name":"Maciej Bala","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:41:34.024Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088a9","user":{"_id":"66cd4e2564a8631d7328a637","avatarUrl":"/avatars/024592abd427a8109f85c49e52e3bb7e.svg","isPro":false,"fullname":"Yogesh Balaji","user":"yogeshbalaji","type":"user"},"name":"Yogesh Balaji","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:41:53.307Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088aa","name":"Erik Barker","hidden":false},{"_id":"677dfaa14bf7f0d4734088ab","name":"Tiffany Cai","hidden":false},{"_id":"677dfaa14bf7f0d4734088ac","user":{"_id":"628d451386d23ad1560882c4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/628d451386d23ad1560882c4/UMxez0DEvX5qdP5ddqi-8.png","isPro":false,"fullname":"Prithvijit Chattopadhyay","user":"prithv1","type":"user"},"name":"Prithvijit Chattopadhyay","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:43:22.176Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088ad","user":{"_id":"66f4cf1a03b5ba8a7f1f6522","avatarUrl":"/avatars/2768d6e37d3f280194cfb8ed274f6015.svg","isPro":false,"fullname":"Yongxin Chen","user":"Ema11","type":"user"},"name":"Yongxin Chen","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:43:31.201Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088ae","user":{"_id":"649f05367b57fab3a5b27c8b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/649f05367b57fab3a5b27c8b/UDJB4yqF2NmaRwCyTOfcl.jpeg","isPro":false,"fullname":"Yin Cui","user":"richardaecn","type":"user"},"name":"Yin Cui","status":"claimed_verified","statusLastChangedAt":"2025-04-11T07:26:11.516Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088af","name":"Yifan Ding","hidden":false},{"_id":"677dfaa14bf7f0d4734088b0","name":"Daniel Dworakowski","hidden":false},{"_id":"677dfaa14bf7f0d4734088b1","user":{"_id":"67227b67dfa07920c2985d22","avatarUrl":"/avatars/98f09002722950eadffe5c199d22bb4f.svg","isPro":false,"fullname":"Jiaojiao Fan","user":"jjf233","type":"user"},"name":"Jiaojiao Fan","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:44:52.955Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088b2","name":"Michele Fenzi","hidden":false},{"_id":"677dfaa14bf7f0d4734088b3","user":{"_id":"6353d3e95eac2d2efa7501f9","avatarUrl":"/avatars/4b063f54000bed4bfb1bfcc3cde1a09e.svg","isPro":false,"fullname":"Francesco Ferroni","user":"fferroni","type":"user"},"name":"Francesco Ferroni","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:45:05.039Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088b4","name":"Sanja Fidler","hidden":false},{"_id":"677dfaa14bf7f0d4734088b5","name":"Dieter Fox","hidden":false},{"_id":"677dfaa14bf7f0d4734088b6","user":{"_id":"67291c1a027e12eb38dc8a0c","avatarUrl":"/avatars/00a0ca6da11d2ffd14a83d28e57c01b4.svg","isPro":false,"fullname":"Songwei Ge","user":"SongweiGe","type":"user"},"name":"Songwei Ge","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:45:28.342Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088b7","user":{"_id":"6520e493b80dc49ba0f1e262","avatarUrl":"/avatars/af21c1ee154b2c9a0d56e69a07508ccb.svg","isPro":false,"fullname":"Yunhao Ge","user":"yunhaog","type":"user"},"name":"Yunhao Ge","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:45:53.639Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088b8","user":{"_id":"647e8118770c299e56fc2bc8","avatarUrl":"/avatars/adf80f3473dda42450148789ae5c208f.svg","isPro":false,"fullname":"Jinwei Gu","user":"jwgu","type":"user"},"name":"Jinwei Gu","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:46:02.830Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088b9","name":"Siddharth Gururani","hidden":false},{"_id":"677dfaa14bf7f0d4734088ba","user":{"_id":"62b20f6df4a72794189248fc","avatarUrl":"/avatars/87e1125868616d4f7d6ee1e5ec4499b4.svg","isPro":false,"fullname":"Ethan He","user":"ethanhe","type":"user"},"name":"Ethan He","status":"admin_assigned","statusLastChangedAt":"2025-01-08T13:46:14.910Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088bb","user":{"_id":"644a717e75fce8ebef4e4955","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/zLga4NZBohFPlv50dcAo9.png","isPro":false,"fullname":"Jiahui Huang","user":"heiwang1997","type":"user"},"name":"Jiahui Huang","status":"claimed_verified","statusLastChangedAt":"2025-02-08T13:56:27.734Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088bc","name":"Jacob Huffman","hidden":false},{"_id":"677dfaa14bf7f0d4734088bd","name":"Pooya Jannaty","hidden":false},{"_id":"677dfaa14bf7f0d4734088be","name":"Jingyi Jin","hidden":false},{"_id":"677dfaa14bf7f0d4734088bf","name":"Seung Wook Kim","hidden":false},{"_id":"677dfaa14bf7f0d4734088c0","name":"Gergely Klár","hidden":false},{"_id":"677dfaa14bf7f0d4734088c1","name":"Grace Lam","hidden":false},{"_id":"677dfaa14bf7f0d4734088c2","name":"Shiyi Lan","hidden":false},{"_id":"677dfaa14bf7f0d4734088c3","name":"Laura Leal-Taixe","hidden":false},{"_id":"677dfaa14bf7f0d4734088c4","name":"Anqi Li","hidden":false},{"_id":"677dfaa14bf7f0d4734088c5","name":"Zhaoshuo Li","hidden":false},{"_id":"677dfaa14bf7f0d4734088c6","name":"Chen-Hsuan Lin","hidden":false},{"_id":"677dfaa14bf7f0d4734088c7","name":"Tsung-Yi Lin","hidden":false},{"_id":"677dfaa14bf7f0d4734088c8","name":"Huan Ling","hidden":false},{"_id":"677dfaa14bf7f0d4734088c9","name":"Ming-Yu Liu","hidden":false},{"_id":"677dfaa14bf7f0d4734088ca","name":"Xian Liu","hidden":false},{"_id":"677dfaa14bf7f0d4734088cb","name":"Alice Luo","hidden":false},{"_id":"677dfaa14bf7f0d4734088cc","name":"Qianli Ma","hidden":false},{"_id":"677dfaa14bf7f0d4734088cd","name":"Hanzi Mao","hidden":false},{"_id":"677dfaa14bf7f0d4734088ce","user":{"_id":"633a0e55ddf7f9c46d6697ec","avatarUrl":"/avatars/aff6df6a6b9d9e415b7f1931dd270a38.svg","isPro":false,"fullname":"Kaichun Mo","user":"daerduomkch","type":"user"},"name":"Kaichun Mo","status":"claimed_verified","statusLastChangedAt":"2025-11-04T20:29:41.219Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088cf","name":"Arsalan Mousavian","hidden":false},{"_id":"677dfaa14bf7f0d4734088d0","name":"Seungjun Nah","hidden":false},{"_id":"677dfaa14bf7f0d4734088d1","name":"Sriharsha Niverty","hidden":false},{"_id":"677dfaa14bf7f0d4734088d2","name":"David Page","hidden":false},{"_id":"677dfaa14bf7f0d4734088d3","name":"Despoina Paschalidou","hidden":false},{"_id":"677dfaa14bf7f0d4734088d4","user":{"_id":"638ee4df6251c8bd7abd246e","avatarUrl":"/avatars/8d8c4dac7d82cba6dcf884460bdc5328.svg","isPro":false,"fullname":"Zeeshan Patel","user":"zeeshanp","type":"user"},"name":"Zeeshan Patel","status":"claimed_verified","statusLastChangedAt":"2025-01-09T10:07:14.790Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088d5","name":"Lindsey Pavao","hidden":false},{"_id":"677dfaa14bf7f0d4734088d6","name":"Morteza Ramezanali","hidden":false},{"_id":"677dfaa14bf7f0d4734088d7","name":"Fitsum Reda","hidden":false},{"_id":"677dfaa14bf7f0d4734088d8","name":"Xiaowei Ren","hidden":false},{"_id":"677dfaa14bf7f0d4734088d9","name":"Vasanth Rao Naik Sabavat","hidden":false},{"_id":"677dfaa14bf7f0d4734088da","name":"Ed Schmerling","hidden":false},{"_id":"677dfaa14bf7f0d4734088db","name":"Stella Shi","hidden":false},{"_id":"677dfaa14bf7f0d4734088dc","name":"Bartosz Stefaniak","hidden":false},{"_id":"677dfaa14bf7f0d4734088dd","name":"Shitao Tang","hidden":false},{"_id":"677dfaa14bf7f0d4734088de","name":"Lyne Tchapmi","hidden":false},{"_id":"677dfaa14bf7f0d4734088df","name":"Przemek Tredak","hidden":false},{"_id":"677dfaa14bf7f0d4734088e0","name":"Wei-Cheng Tseng","hidden":false},{"_id":"677dfaa14bf7f0d4734088e1","user":{"_id":"66d76b37483bbfc9e43eba4b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/66d76b37483bbfc9e43eba4b/61G28x94O2MYzD2u_wnsD.png","isPro":false,"fullname":"Jibin Rajan Varghese","user":"jibinv","type":"user"},"name":"Jibin Varghese","status":"claimed_verified","statusLastChangedAt":"2025-01-22T20:49:55.440Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088e2","name":"Hao Wang","hidden":false},{"_id":"677dfaa14bf7f0d4734088e3","name":"Haoxiang Wang","hidden":false},{"_id":"677dfaa14bf7f0d4734088e4","name":"Heng Wang","hidden":false},{"_id":"677dfaa14bf7f0d4734088e5","name":"Ting-Chun Wang","hidden":false},{"_id":"677dfaa14bf7f0d4734088e6","name":"Fangyin Wei","hidden":false},{"_id":"677dfaa14bf7f0d4734088e7","name":"Xinyue Wei","hidden":false},{"_id":"677dfaa14bf7f0d4734088e8","user":{"_id":"633aaf695df91da9cea92960","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/633aaf695df91da9cea92960/h1oOWUudbdlsd63Q5w0hM.png","isPro":false,"fullname":"Jay Wu","user":"jayw","type":"user"},"name":"Jay Zhangjie Wu","status":"claimed_verified","statusLastChangedAt":"2025-03-04T08:52:46.920Z","hidden":false},{"_id":"677dfaa14bf7f0d4734088e9","name":"Jiashu Xu","hidden":false},{"_id":"677dfaa14bf7f0d4734088ea","name":"Wei Yang","hidden":false},{"_id":"677dfaa14bf7f0d4734088eb","name":"Lin Yen-Chen","hidden":false},{"_id":"677dfaa14bf7f0d4734088ec","name":"Xiaohui Zeng","hidden":false},{"_id":"677dfaa14bf7f0d4734088ed","name":"Yu Zeng","hidden":false},{"_id":"677dfaa14bf7f0d4734088ee","name":"Jing Zhang","hidden":false},{"_id":"677dfaa14bf7f0d4734088ef","name":"Qinsheng Zhang","hidden":false},{"_id":"677dfaa14bf7f0d4734088f0","name":"Yuxuan Zhang","hidden":false},{"_id":"677dfaa14bf7f0d4734088f1","name":"Qingqing Zhao","hidden":false},{"_id":"677dfaa14bf7f0d4734088f2","name":"Artur Zolkowski","hidden":false}],"publishedAt":"2025-01-07T06:55:50.000Z","submittedOnDailyAt":"2025-01-08T03:15:09.139Z","title":"Cosmos World Foundation Model Platform for Physical AI","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"Physical AI needs to be trained digitally first. It needs a digital twin of\nitself, the policy model, and a digital twin of the world, the world model. In\nthis paper, we present the Cosmos World Foundation Model Platform to help\ndevelopers build customized world models for their Physical AI setups. We\nposition a world foundation model as a general-purpose world model that can be\nfine-tuned into customized world models for downstream applications. Our\nplatform covers a video curation pipeline, pre-trained world foundation models,\nexamples of post-training of pre-trained world foundation models, and video\ntokenizers. To help Physical AI builders solve the most critical problems of\nour society, we make our platform open-source and our models open-weight with\npermissive licenses available via https://github.com/NVIDIA/Cosmos.","upvotes":82,"discussionId":"677dfaa84bf7f0d473408be8","projectPage":"https://research.nvidia.com/labs/dir/cosmos1/","githubRepo":"https://github.com/nvidia-cosmos/cosmos-predict1","githubRepoAddedBy":"auto","ai_summary":"The Cosmos World Foundation Model Platform provides a framework for developing customized world models for Physical AI by leveraging video curation, pre-trained models, and tokenizers.","ai_keywords":["digital twin","policy model","world model","world foundation model","video curation","pre-trained world foundation models","post-training","video tokenizers"],"githubStars":411},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"6418554a0956be7233a1023e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6418554a0956be7233a1023e/9EKN0GoOpcDbvBDmAQEJf.png","isPro":false,"fullname":"zhang yuechen","user":"julianjuaner","type":"user"},{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"63044b2e1dd5d3c624882d19","avatarUrl":"/avatars/ba4d387547d1d0baeca918caea680f89.svg","isPro":false,"fullname":"Patrick Kwon","user":"yj7082126","type":"user"},{"_id":"63c5d43ae2804cb2407e4d43","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1673909278097-noauth.png","isPro":false,"fullname":"xziayro","user":"xziayro","type":"user"},{"_id":"637f0eb22438d7485b8ef5d7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/637f0eb22438d7485b8ef5d7/70h7dekqj7LuBobOXckmJ.jpeg","isPro":false,"fullname":"Ming Li","user":"limingcv","type":"user"},{"_id":"6033c55f60e3dd96631c908d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6033c55f60e3dd96631c908d/jy7cHHCBhnlzHKGbXIbj0.jpeg","isPro":false,"fullname":"Shyam Sunder Kumar","user":"theainerd","type":"user"},{"_id":"631c386bc73939ffc0716a37","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1662793811119-noauth.jpeg","isPro":false,"fullname":"SeongWan Kim","user":"idgmatrix","type":"user"},{"_id":"64747f7e33192631bacd8831","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64747f7e33192631bacd8831/dstkZJ4sHJSeqLesV5cOC.jpeg","isPro":false,"fullname":"Taufiq Dwi Purnomo","user":"taufiqdp","type":"user"},{"_id":"6426616ea5ec4a5cbc535634","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6426616ea5ec4a5cbc535634/5IfSFYd9QOxz8K9QmBCst.png","isPro":false,"fullname":"JeffWang","user":"Jeff-Wang","type":"user"},{"_id":"648eb1eb59c4e5c87dc116e0","avatarUrl":"/avatars/c636cea39c2c0937f01398c94ead5dad.svg","isPro":false,"fullname":"fdsqefsgergd","user":"T-representer","type":"user"},{"_id":"643b19f8a856622f978df30f","avatarUrl":"/avatars/c82779fdf94f80cdb5020504f83c818b.svg","isPro":false,"fullname":"Yatharth Sharma","user":"YaTharThShaRma999","type":"user"},{"_id":"64097dd1b6a334f53e2b3e4c","avatarUrl":"/avatars/18d036aab5e096054a8706bc78027126.svg","isPro":false,"fullname":"Junying Chen","user":"jymcc","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":2}">