\n\n\n\n

\n \n \n Online Demo\n |\n \n \n GitHub\n |\n \n \n Paper\n |\n \n \n Discord\n \n

\n\n OpenChat is dedicated to advancing and releasing **open-source language models**, fine-tuned with our [**C-RLFT**](https://arxiv.org/pdf/2309.11235.pdf) technique, which is inspired by offline reinforcement learning. Our models learn from mixed-quality data without preference labels, delivering exceptional performance on par with `ChatGPT`, which we were the first to beat with only `7B` parameter LLMs which can be run on a **consumer GPU (e.g. RTX 3090)**.\n\n# 💌Contact\n\n**Project Lead:**\n- Guan Wang [imonenext@gmail.com]\n- [Alpay Ariyak](https://github.com/alpayariyak) [alpay@ariyak.ai]\n\n**Sponsors:**\n- [Sen Song](https://scholar.google.com/citations?user=cYgtRP4AAAAJ) (Tsinghua University)\n- [Yang Liu](https://nlp.csai.tsinghua.edu.cn/~ly/) (Tsinghua University)\n- [01.AI Company](https://www.lingyiwanwu.com/en)\n- [RunPod](https://www.runpod.io/)","html":"\n\n

\n \n \n Online Demo\n |\n \n \n GitHub\n |\n \n \n Paper\n |\n \n \n Discord\n \n

\n\n

OpenChat is dedicated to advancing and releasing open-source language models, fine-tuned with our C-RLFT technique, which is inspired by offline reinforcement learning. Our models learn from mixed-quality data without preference labels, delivering exceptional performance on par with ChatGPT, which we were the first to beat with only 7B parameter LLMs which can be run on a consumer GPU (e.g. RTX 3090).

\n\n

💌Contact

\n

Project Lead:

\n

\n
• Guan Wang [imonenext@gmail.com]
\n
• Alpay Ariyak [alpay@ariyak.ai]
\n

\n

Sponsors:

\n

\n
• Sen Song (Tsinghua University)
\n
• Yang Liu (Tsinghua University)
\n
• 01.AI Company
\n
• RunPod
\n

\n","classNames":"hf-sanitized hf-sanitized-esqKmUkiJ2h1Dkw9shZ_Z"},"users":[{"_id":"61b6cbbdbfb266841ec0f24a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/PHUVNOOMEw_R2CF3u-sMS.png","isPro":false,"fullname":"One","user":"imone","type":"user"},{"_id":"6341375be5071b0c5cc946a3","avatarUrl":"/avatars/c26a32b54a3f7731854059d247b5c523.svg","isPro":false,"fullname":"Qiying Yu","user":"qiying","type":"user"},{"_id":"649ef99c37bfb5202be368e3","avatarUrl":"/avatars/055325aeed8521f8bc5fa52ddc775383.svg","isPro":false,"fullname":"hexmage","user":"hexmage","type":"user"},{"_id":"635567189c72a7e742f1419c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/635567189c72a7e742f1419c/tbfBz0furS-y4ISgoe6j0.jpeg","isPro":false,"fullname":"Alpin","user":"alpindale","type":"user"},{"_id":"62a3aaca367f957bde2aaed6","avatarUrl":"/avatars/9daae70f3463a06a119c5142183a0431.svg","isPro":false,"fullname":"Eugene Pentland","user":"eugenepentland","type":"user"},{"_id":"623e19ff8972a8c030af5277","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/623e19ff8972a8c030af5277/jq9jfT_Sl5B1ZSMHGmBFX.jpeg","isPro":true,"fullname":"Jeremy Howard","user":"jph00","type":"user"},{"_id":"6317aade83d8d2fd903192d9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6317aade83d8d2fd903192d9/erOwgMXc_CZih3uMoyTAp.jpeg","isPro":false,"fullname":"Teknium","user":"teknium","type":"user"},{"_id":"63972e77157559113eb8396d","avatarUrl":"/avatars/9441d895e3308a15a50c5dab942454ff.svg","isPro":true,"fullname":"Bleys","user":"bleysg","type":"user"},{"_id":"641dfddf3bae5a77636817c5","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/641dfddf3bae5a77636817c5/2IwNwh9kK98eCHUmOGoWD.png","isPro":true,"fullname":"wing lian","user":"winglian","type":"user"},{"_id":"6482c942a5fce44ee4b0be7e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/2GjRE8z9lYNeelnBTz5ym.png","isPro":false,"fullname":"Luigi D","user":"LDJnr","type":"user"},{"_id":"6436279eaaef013d1af225c9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6436279eaaef013d1af225c9/31yjIFpqfdvn_n9igumIU.png","isPro":false,"fullname":"Alignment Lab AI","user":"Alignment-Lab-AI","type":"user"},{"_id":"63972847b3e2256c9ce1307b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63972847b3e2256c9ce1307b/Zt-O-F_gl0dDefbkOORfY.png","isPro":false,"fullname":"Alpay Ariyak","user":"alpayariyak","type":"user"},{"_id":"6408c495b6a334f53e22b612","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6408c495b6a334f53e22b612/s6mOBvFZhZtvy1B9OBABt.png","isPro":false,"fullname":"Fredi","user":"Fredithefish","type":"user"},{"_id":"6475c60b4766357252e6b4d6","avatarUrl":"/avatars/00698ab7f1458806b2251f08572eb725.svg","isPro":false,"fullname":"RainyDays","user":"CrystalSusie","type":"user"},{"_id":"636f071287545ca5a13ce96a","avatarUrl":"/avatars/3ba19816e04de2800f95d20994751f3f.svg","isPro":false,"fullname":"NanoBit","user":"Nanobit","type":"user"}],"userCount":15,"collections":[{"slug":"openchat/openchat-65110500e14eeb01d4888806","title":"OpenChat","description":"OpenChat: Advancing Open-source Language Models with Mixed-Quality Data","gating":false,"lastUpdated":"2024-07-31T16:45:43.925Z","owner":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"items":[{"_id":"65110538e14eeb01d48890a9","position":0,"type":"paper","id":"2309.11235","title":"OpenChat: Advancing Open-source Language Models with Mixed-Quality Data","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2309.11235.png","upvotes":15,"publishedAt":"2023-09-20T11:54:40.000Z","isUpvotedByUser":false},{"_id":"659e663e912b75e2c37ac1f6","position":1,"type":"model","author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":13317,"gated":false,"id":"openchat/openchat-3.5-0106","availableInferenceProviders":[],"lastModified":"2024-05-18T18:14:51.000Z","likes":360,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]},{"_id":"657aaf067436ede54644b139","position":2,"type":"model","author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":3170,"gated":false,"id":"openchat/openchat-3.5-1210","availableInferenceProviders":[],"lastModified":"2024-05-18T18:10:44.000Z","likes":278,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":7241748480},{"_id":"6543553f0d2e27122a64d8fd","position":3,"type":"model","author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":4593,"gated":false,"id":"openchat/openchat_3.5","availableInferenceProviders":[],"lastModified":"2024-05-18T18:09:11.000Z","likes":1140,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]}],"position":0,"theme":"orange","private":false,"shareUrl":"https://hf.co/collections/openchat/openchat","upvotes":35,"isUpvotedByUser":false}],"datasets":[{"author":"openchat","downloads":34,"gated":false,"id":"openchat/cogstack-opengpt-sharegpt","lastModified":"2024-04-16T13:43:44.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":31532,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":8,"isLikedByUser":false,"isBenchmark":false},{"author":"openchat","downloads":67,"gated":false,"id":"openchat/ultrachat-sharegpt","lastModified":"2024-04-16T13:25:45.000Z","datasetsServerInfo":{"viewer":"viewer-partial","numRows":805144,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":9,"isLikedByUser":false,"isBenchmark":false},{"author":"openchat","downloads":118,"gated":false,"id":"openchat/openchat_sharegpt_v3","lastModified":"2023-09-04T14:32:11.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":82564,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["parquet"],"modalities":["tabular","timeseries"]},"private":false,"repoType":"dataset","likes":25,"isLikedByUser":false,"isBenchmark":false},{"author":"openchat","downloads":589,"gated":false,"id":"openchat/openchat_sharegpt4_dataset","lastModified":"2023-07-01T13:20:31.000Z","private":false,"repoType":"dataset","likes":173,"isLikedByUser":false,"isBenchmark":false}],"models":[{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":9636,"gated":false,"id":"openchat/openchat-3.6-8b-20240522","availableInferenceProviders":[{"provider":"featherless-ai","modelStatus":"live","providerStatus":"live","providerId":"openchat/openchat-3.6-8b-20240522","task":"conversational","isCheapestPricingOutput":false,"isFastestThroughput":false,"isModelAuthor":false}],"lastModified":"2024-05-28T05:23:57.000Z","likes":157,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":8030261248},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":13317,"gated":false,"id":"openchat/openchat-3.5-0106","availableInferenceProviders":[],"lastModified":"2024-05-18T18:14:51.000Z","likes":360,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":3217,"gated":false,"id":"openchat/openchat-3.5-0106-gemma","availableInferenceProviders":[],"lastModified":"2024-05-18T18:11:14.000Z","likes":57,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":8537680896},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":3170,"gated":false,"id":"openchat/openchat-3.5-1210","availableInferenceProviders":[],"lastModified":"2024-05-18T18:10:44.000Z","likes":278,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":7241748480},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":4593,"gated":false,"id":"openchat/openchat_3.5","availableInferenceProviders":[],"lastModified":"2024-05-18T18:09:11.000Z","likes":1140,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":684,"gated":false,"id":"openchat/openchat_v3.2","availableInferenceProviders":[],"lastModified":"2023-11-29T08:16:32.000Z","likes":42,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":691,"gated":false,"id":"openchat/openchat_v3.2_super","availableInferenceProviders":[],"lastModified":"2023-11-29T08:16:13.000Z","likes":34,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":679,"gated":false,"id":"openchat/openchat_v3.1","availableInferenceProviders":[],"lastModified":"2023-09-24T10:11:15.000Z","likes":6,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":674,"gated":false,"id":"openchat/opencoderplus","availableInferenceProviders":[],"lastModified":"2023-08-24T07:01:34.000Z","likes":102,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]},{"author":"openchat","authorData":{"_id":"64847900c830787e01141f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61b6cbbdbfb266841ec0f24a/bbSODuJyPwH5HKOC6RBVc.png","fullname":"OpenChat","name":"openchat","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":353,"isUserFollowing":false},"downloads":0,"gated":"auto","id":"openchat/openchat_v2_openorca_preview","availableInferenceProviders":[],"lastModified":"2023-07-18T08:43:26.000Z","likes":36,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[]}],"paperPreviews":[],"spaces":[],"buckets":[],"numBuckets":0,"numDatasets":4,"numModels":14,"numSpaces":1,"lastOrgActivities":[],"acceptLanguages":["*"],"canReadRepos":false,"canReadSpaces":false,"blogPosts":[],"currentRepoPage":0,"filters":{},"paperView":false}">