A trio of powerful models: fine-tuned from Llama3-8b-Instruct, with BitNet architecture!
in this blogpost\n
\n
datasets
0
- \n
Llama3-8B-1.58-100B-tokens
\n
Fine-tuned on 100B tokens for maximum performance. \nLlama3-8B-1.58-Linear-10B-tokens
\n
Fine-tuned with a Linear Lambda scheduler on 10B tokens. \nLlama3-8B-1.58-Sigmoid-k100-10B-tokens
\n
Fine-tuned with a Simgoid Lambda scheduler with k=100 on 10B tokens. \n
\n
Join us in the era of extreme quantization as we continue to push this technology forward !
\n","classNames":"hf-sanitized hf-sanitized-TX-536VRgsnreOBsEdTmk"},"users":[{"_id":"6632d7e22c4f4bfc3f6a05c2","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6632d7e22c4f4bfc3f6a05c2/TCDlrb-O5aormNjSX-tyE.png","isPro":false,"fullname":"Mohamed Mekkouri","user":"medmekk","type":"user"},{"_id":"63ce875d199b36f7552d4f07","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63ce875d199b36f7552d4f07/bpUrvhXDagzRqZ3vxTcSF.jpeg","isPro":false,"fullname":"Marc Sun","user":"marcsun13","type":"user"},{"_id":"6310fc2e88942700629e2866","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6310fc2e88942700629e2866/wcJOCfL0Cbm3Ys0M8JN4d.jpeg","isPro":false,"fullname":"Diego Marinho de Oliveira","user":"dmztheone","type":"user"},{"_id":"63148c4db031f7b1c7bc36f9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63148c4db031f7b1c7bc36f9/sl0HUVNI0G_yfScJB38yZ.jpeg","isPro":false,"fullname":"Erik Kaunismäki","user":"erikkaum","type":"user"},{"_id":"5f43448a79c1ba4c353d0d8f","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5f43448a79c1ba4c353d0d8f/DiSygV3dn7A_OjmGVTrHD.jpeg","isPro":true,"fullname":"Sugato Ray","user":"sugatoray","type":"user"},{"_id":"642d4545c5f19fe0da0830ab","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/642d4545c5f19fe0da0830ab/7JfAIdZ_Zf9uWPJSur4mk.jpeg","isPro":false,"fullname":"Anshu Daur","user":"anshudaur","type":"user"},{"_id":"6551340da12178dd75dc4120","avatarUrl":"/avatars/c072b5baa47fe74722e219bf384d2078.svg","isPro":false,"fullname":"Artem Grachev","user":"agrachev","type":"user"},{"_id":"62d3f630c85b0fcf7fda4b86","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62d3f630c85b0fcf7fda4b86/_4QjhUOjAoRojDsGQ5-DN.png","isPro":true,"fullname":"Venky","user":"venkycs","type":"user"},{"_id":"63aa9993785b8279fe2f08bf","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1672124793164-noauth.png","isPro":true,"fullname":"Onuralp SEZER","user":"onuralpszr","type":"user"},{"_id":"664f1fbd751e3db5b2f0d2e4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/4kE7m5z5VviXschVPJudQ.jpeg","isPro":false,"fullname":"Wonjin Kim","user":"wjkim9653","type":"user"},{"_id":"664d7ade692fba5e38b43ac9","avatarUrl":"/avatars/cab10ce9114a1a99349934e4fbf1959a.svg","isPro":false,"fullname":"Zipxxxx","user":"Zipxuan","type":"user"},{"_id":"66edd3f3127751a231679950","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/27bSZPaP1pQHf1viaPGzf.png","isPro":false,"fullname":"Abian Hernandez-Guedes","user":"SolidusAbi","type":"user"},{"_id":"64be41c330a1f0f0f0a1e0eb","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64be41c330a1f0f0f0a1e0eb/8W-z1xMGnQGQ2M4LXnZfy.jpeg","isPro":false,"fullname":"VORTEX","user":"Abhaykoul","type":"user"},{"_id":"63c82e6decdb7c9fdd99a135","avatarUrl":"/avatars/f957844e097928daa5484085f1911061.svg","isPro":false,"fullname":"David Youssef","user":"DavidYoussef","type":"user"},{"_id":"6301e8295e305a35cb08a3ad","avatarUrl":"/avatars/d4fc8546bb38c52e7e83d660cfa172ff.svg","isPro":false,"fullname":"Byeongki Jeong","user":"jbk958","type":"user"},{"_id":"66f1bcf3b86218b7de571207","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/3SRfvXXWiC3IZdbr7HHxA.png","isPro":false,"fullname":"Shiba M","user":"Shi200","type":"user"},{"_id":"63187ef709146074fe8f2afa","avatarUrl":"/avatars/2049088cea15abd4925a3fcc7c310684.svg","isPro":false,"fullname":"zijie tian","user":"zijie-tian","type":"user"},{"_id":"6304ec75bad6ce7fc028eefa","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6304ec75bad6ce7fc028eefa/8-tfqzA47Z77qEDjUibJy.jpeg","isPro":false,"fullname":"Prabhat Kumar Gupta","user":"pkghf","type":"user"},{"_id":"64a9a2e403835e13f9786936","avatarUrl":"/avatars/09dc0a9603b0a10aaddbdc20dba9a221.svg","isPro":false,"fullname":"Acharya","user":"Chhabi","type":"user"},{"_id":"66186cf211548294cc919a6f","avatarUrl":"/avatars/ee2a88aff3f1129280148012c8e42fa9.svg","isPro":false,"fullname":"Rajendra Jena","user":"rajendra-jena","type":"user"},{"_id":"65e34821d821287383101b70","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65e34821d821287383101b70/1l0AVxbrPDrvlfvLRURvR.png","isPro":false,"fullname":"Ammar","user":"Daemontatox","type":"user"},{"_id":"64a9e2ba31a43d72650a9aca","avatarUrl":"/avatars/6d064d5a805fa23a88316eeb792791c1.svg","isPro":false,"fullname":"Grove Stake","user":"Groovy1","type":"user"},{"_id":"66e6561a07c3450742720158","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/66e6561a07c3450742720158/iHpDmZRKDbZd9RRgK2gQ7.jpeg","isPro":false,"fullname":"JoonHo Kim","user":"jhboyo","type":"user"},{"_id":"6121ebfa958946017d768584","avatarUrl":"/avatars/0deedafe4120b507097458c43582361d.svg","isPro":false,"fullname":"dockhardman","user":"dockhardman","type":"user"},{"_id":"6509b07d1b3694179de4d5f3","avatarUrl":"/avatars/a0f304936e9729d5d956b55b62317c65.svg","isPro":false,"fullname":"xianxian","user":"xianml","type":"user"},{"_id":"63235418462470712719fd7d","avatarUrl":"/avatars/a1bbb4f65c337468a48d1eb2f16703d7.svg","isPro":false,"fullname":"Tie Mandalor","user":"SpiritualTie","type":"user"},{"_id":"64549ba5273f64983022b94a","avatarUrl":"/avatars/e899997c86aa0edd4b74b1a9c8e498ae.svg","isPro":false,"fullname":"Vassilios Karakoidas","user":"bkarak","type":"user"},{"_id":"611c2e267fbcc963388f7189","avatarUrl":"/avatars/f3479e2d60d1af2d440b0be9ca269646.svg","isPro":false,"fullname":"Devesh Singh","user":"singhdevesh12","type":"user"},{"_id":"6689586dbdc7e8332b56985c","avatarUrl":"/avatars/f6a930ca3316db9b14c3bccaf58bd800.svg","isPro":false,"fullname":"Eduardo Telmo Fonseca Santos","user":"etfs","type":"user"},{"_id":"659c71cf5751112bb9259fb0","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/659c71cf5751112bb9259fb0/xSFw1V1XfrbOw13m0Oyah.jpeg","isPro":false,"fullname":"giacomo fumagalli","user":"drkr23","type":"user"},{"_id":"66208d3c5c7af6bb1206a28d","avatarUrl":"/avatars/fcf9968e0c911b802019d4cc96d4439c.svg","isPro":false,"fullname":"Chiau Ho Ong","user":"chiauho","type":"user"},{"_id":"642b07c034138fd029ef2d32","avatarUrl":"/avatars/a060f086c80f2d7ac2483131633fe57c.svg","isPro":false,"fullname":"Chetan Gadgil","user":"chetangadgil","type":"user"},{"_id":"6315a59fddb508cf0af04b02","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6315a59fddb508cf0af04b02/UhgcKh_sLyAIOEaPMEaIs.png","isPro":false,"fullname":"十百千","user":"x1001000","type":"user"},{"_id":"6126f3567faf48ab18fcf188","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6126f3567faf48ab18fcf188/yfNqymlvI-DkV_HwPxs85.jpeg","isPro":false,"fullname":"Allan Victor","user":"BecomeAllan","type":"user"},{"_id":"6555c9f36eb0a1c7c38df588","avatarUrl":"/avatars/57668568c127ea1d9f2b71e6756dd11e.svg","isPro":false,"fullname":"dalirudilu","user":"choujoujitoli","type":"user"},{"_id":"64357660f3b08e267d989222","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64357660f3b08e267d989222/cRCYsHq8OVqsG4V0RK7rg.png","isPro":true,"fullname":"Gökdeniz Gülmez","user":"Goekdeniz-Guelmez","type":"user"},{"_id":"63c3f550a361002ba0b1a855","avatarUrl":"/avatars/bdd2e513ef8fe8750cee56bf07389143.svg","isPro":false,"fullname":"Damien SICARD","user":"Altar31","type":"user"},{"_id":"664731bd6a7b3e02109fe900","avatarUrl":"/avatars/7109cb5f45b6cbad52c116b3b7f23ef6.svg","isPro":false,"fullname":"nanchet","user":"nanchet","type":"user"},{"_id":"643508bac7bb9131ce5acc21","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/643508bac7bb9131ce5acc21/W7-31ialHAP2jh445DI6c.png","isPro":false,"fullname":"Justin J","user":"justinj92","type":"user"},{"_id":"663856f2164dfca129e885ed","avatarUrl":"/avatars/4a96a128c36574cd8a0c90fbbe56ed86.svg","isPro":false,"fullname":"Peter Tang","user":"petersktang","type":"user"},{"_id":"66e8875bff3134c96f9765aa","avatarUrl":"/avatars/14eb943f1ace95039cecbff67e388f45.svg","isPro":false,"fullname":"NiKo","user":"korkakak","type":"user"},{"_id":"645c60dd7d655680b57ddbff","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/645c60dd7d655680b57ddbff/MTMtkV6sy44oD-zwkGX0E.png","isPro":true,"fullname":"Ram Kadiyala","user":"1024m","type":"user"},{"_id":"657a3679f1ae42fb122f9861","avatarUrl":"/avatars/3ad92818629be7027a2d667a9bc133ba.svg","isPro":false,"fullname":"Lee Afeawo","user":"LeeAfe","type":"user"},{"_id":"642864e0eb2891d3746bb7d8","avatarUrl":"/avatars/0302d7d177a853c822deaccfebefeaed.svg","isPro":false,"fullname":"marco piccirilli","user":"Picci","type":"user"},{"_id":"6048c34e5da6ba4b1dfb9e2d","avatarUrl":"/avatars/8a7497c7c91ac9b0067a1d3a457a7a18.svg","isPro":false,"fullname":"Ish Girwan","user":"Ish","type":"user"},{"_id":"6462dd59514ee1645bd2c5cd","avatarUrl":"/avatars/18b73330d4c2982b35fd28fa41ebf047.svg","isPro":false,"fullname":"Akhil Rajeev P","user":"akhil2808","type":"user"},{"_id":"63ec257759a46fd5f4b54ae7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63ec257759a46fd5f4b54ae7/swEIF1UALnpJRurVgbIZE.jpeg","isPro":false,"fullname":"Junchen Zhao","user":"zjc664656505","type":"user"},{"_id":"65d9acb0ad7ccf910dc8cd92","avatarUrl":"/avatars/35090dd3222c588c5888c6a44c62186c.svg","isPro":false,"fullname":"MouSoeng","user":"MouSoeng","type":"user"},{"_id":"663a3cbfda13660b8478a7d6","avatarUrl":"/avatars/655b1f10f9b522b1b39302f4f2ccac12.svg","isPro":false,"fullname":"Daniel Chif","user":"nadchif","type":"user"},{"_id":"64396d25b9ac1d55f41edea8","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64396d25b9ac1d55f41edea8/_1IQdkRgf_pafVizqQr0f.png","isPro":false,"fullname":"忍者","user":"byteprobe","type":"user"},{"_id":"674c8a0d2a3a783f45bc4c9f","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/l9eI-cOi_-Fb34nNPP9yP.jpeg","isPro":false,"fullname":"Hououin Kyouma","user":"kamehameha231","type":"user"},{"_id":"62bdf8c8df69b47307cd9609","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62bdf8c8df69b47307cd9609/G9p6iwLm4KnRyky8oKber.jpeg","isPro":false,"fullname":"Onur Güngör","user":"onurgu","type":"user"},{"_id":"660b4c04abd8bd25eea2ce91","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/660b4c04abd8bd25eea2ce91/dGrncckP-tjx_DpUvxeoA.jpeg","isPro":false,"fullname":"Brian Guo","user":"JoyboyBrian","type":"user"},{"_id":"664cba5cbff0766deb234a6d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/OQ0EIrPYPrL8C4AeWGutO.png","isPro":false,"fullname":"Kendell Joseph","user":"kendelljoseph","type":"user"},{"_id":"612102465054d81934c5a75e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1629553183241-noauth.png","isPro":false,"fullname":"Ruslan Magana Vsevolodovna","user":"ruslanmv","type":"user"},{"_id":"6621025b52cfb16741752836","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6621025b52cfb16741752836/s-jSShRfTrOad__65onGL.png","isPro":false,"fullname":"wave","user":"wave-on-discord","type":"user"},{"_id":"6549ca442f77576fa454a8fd","avatarUrl":"/avatars/d41bcad40f0b182c60d895821609a32b.svg","isPro":false,"fullname":"byounghanjang","user":"byounghanjang","type":"user"},{"_id":"676b90af62cee1f3ab985c33","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/3NDmnJTRRO9LJCDUYEs2V.png","isPro":false,"fullname":"max","user":"maxpcfuns2024","type":"user"},{"_id":"677fcdf29b9a9863eba3f29f","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/677fcdf29b9a9863eba3f29f/3dL2oIwA1BVnq4kyKpANa.png","isPro":false,"fullname":"Parvesh Rawal","user":"Parveshiiii","type":"user"},{"_id":"6841e4706ddb920be863e814","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/Viy-T9BrDjbZqwSaQobtk.png","isPro":false,"fullname":"Ruoxing Yang","user":"davidrxyang","type":"user"},{"_id":"626237d9bbcbd1c34f1bb231","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/626237d9bbcbd1c34f1bb231/EJrOjvAL-68qMCYdnvOrq.png","isPro":true,"fullname":"Ali El Filali","user":"alielfilali01","type":"user"},{"_id":"66eafaadf5b06a0e01bf5d92","avatarUrl":"/avatars/191baa4a94c34823382e6ddae2a30fe0.svg","isPro":false,"fullname":"pablo","user":"silver123123","type":"user"},{"_id":"64b25b086d953e7c75d3c6ac","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64b25b086d953e7c75d3c6ac/C7OaVxRUbPuwZDFAqBgoL.png","isPro":true,"fullname":"Dũng Võ","user":"tuandunghcmut","type":"user"},{"_id":"649dc5cc9203d7a25832b7d5","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/649dc5cc9203d7a25832b7d5/TX_N1Jqxh9QaWAFzib_V6.jpeg","isPro":true,"fullname":"Len Hoare","user":"Lenhoare","type":"user"},{"_id":"64eac6091d8b651a9aee160b","avatarUrl":"/avatars/95f43465c4fd8fd64c299273d4c3cff5.svg","isPro":false,"fullname":"fountai","user":"guardiancc","type":"user"}],"userCount":65,"collections":[{"slug":"HF1BitLLM/llama3-8b-158-66e6003b038300b07a34c4f3","title":"Llama3-8B-1.58","description":"A trio of powerful models: fine-tuned from Llama3-8b-Instruct, with BitNet architecture!","gating":false,"lastUpdated":"2024-09-14T21:31:37.801Z","owner":{"_id":"663bc18b9a5d20bd3a6ab74c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6632d7e22c4f4bfc3f6a05c2/96_Digo3LiC7bZKCzZBi-.png","fullname":"Hugging Face 1Bit LLMs","name":"HF1BitLLM","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":257,"isUserFollowing":false},"items":[{"_id":"66e600ab07c3450742585243","position":0,"type":"model","author":"HF1BitLLM","authorData":{"_id":"663bc18b9a5d20bd3a6ab74c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6632d7e22c4f4bfc3f6a05c2/96_Digo3LiC7bZKCzZBi-.png","fullname":"Hugging Face 1Bit LLMs","name":"HF1BitLLM","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":257,"isUserFollowing":false},"downloads":1397,"gated":false,"id":"HF1BitLLM/Llama3-8B-1.58-100B-tokens","availableInferenceProviders":[],"lastModified":"2024-09-19T04:09:11.000Z","likes":201,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":2795770080},{"_id":"66e600b2444055a570904280","position":1,"type":"model","author":"HF1BitLLM","authorData":{"_id":"663bc18b9a5d20bd3a6ab74c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6632d7e22c4f4bfc3f6a05c2/96_Digo3LiC7bZKCzZBi-.png","fullname":"Hugging Face 1Bit LLMs","name":"HF1BitLLM","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":257,"isUserFollowing":false},"downloads":11,"gated":false,"id":"HF1BitLLM/Llama3-8B-1.58-Linear-10B-tokens","availableInferenceProviders":[],"lastModified":"2024-09-18T13:16:20.000Z","likes":10,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":2795770080},{"_id":"66e600b92102f997d0eb7709","position":2,"type":"model","author":"HF1BitLLM","authorData":{"_id":"663bc18b9a5d20bd3a6ab74c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6632d7e22c4f4bfc3f6a05c2/96_Digo3LiC7bZKCzZBi-.png","fullname":"Hugging Face 1Bit LLMs","name":"HF1BitLLM","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":257,"isUserFollowing":false},"downloads":3,"gated":false,"id":"HF1BitLLM/Llama3-8B-1.58-Sigmoid-k100-10B-tokens","availableInferenceProviders":[],"lastModified":"2024-09-18T13:16:52.000Z","likes":9,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":2795770080}],"position":0,"theme":"blue","private":false,"shareUrl":"https://hf.co/collections/HF1BitLLM/llama3-8b-158","upvotes":13,"isUpvotedByUser":false}],"datasets":[],"models":[{"author":"HF1BitLLM","authorData":{"_id":"663bc18b9a5d20bd3a6ab74c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6632d7e22c4f4bfc3f6a05c2/96_Digo3LiC7bZKCzZBi-.png","fullname":"Hugging Face 1Bit LLMs","name":"HF1BitLLM","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":257,"isUserFollowing":false},"downloads":1397,"gated":false,"id":"HF1BitLLM/Llama3-8B-1.58-100B-tokens","availableInferenceProviders":[],"lastModified":"2024-09-19T04:09:11.000Z","likes":201,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":2795770080},{"author":"HF1BitLLM","authorData":{"_id":"663bc18b9a5d20bd3a6ab74c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6632d7e22c4f4bfc3f6a05c2/96_Digo3LiC7bZKCzZBi-.png","fullname":"Hugging Face 1Bit LLMs","name":"HF1BitLLM","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":257,"isUserFollowing":false},"downloads":3,"gated":false,"id":"HF1BitLLM/Llama3-8B-1.58-Sigmoid-k100-10B-tokens","availableInferenceProviders":[],"lastModified":"2024-09-18T13:16:52.000Z","likes":9,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":2795770080},{"author":"HF1BitLLM","authorData":{"_id":"663bc18b9a5d20bd3a6ab74c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6632d7e22c4f4bfc3f6a05c2/96_Digo3LiC7bZKCzZBi-.png","fullname":"Hugging Face 1Bit LLMs","name":"HF1BitLLM","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":257,"isUserFollowing":false},"downloads":11,"gated":false,"id":"HF1BitLLM/Llama3-8B-1.58-Linear-10B-tokens","availableInferenceProviders":[],"lastModified":"2024-09-18T13:16:20.000Z","likes":10,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":2795770080}],"paperPreviews":[],"spaces":[],"buckets":[],"numBuckets":0,"numDatasets":0,"numModels":3,"numSpaces":1,"lastOrgActivities":[{"time":"2025-12-25T20:46:29.442Z","user":"Goekdeniz-Guelmez","userAvatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64357660f3b08e267d989222/cRCYsHq8OVqsG4V0RK7rg.png","type":"paper","paper":{"id":"2512.18901","title":"Gabliteration: Adaptive Multi-Directional Neural Weight Modification for Selective Behavioral Alteration in Large Language Models","publishedAt":"2025-12-21T22:12:54.000Z","upvotes":3,"isUpvotedByUser":true}},{"time":"2025-08-08T16:21:21.522Z","user":"1024m","userAvatarUrl":"","type":"paper","paper":{"id":"2508.04683","title":"Query Attribute Modeling: Improving search relevance with Semantic\n Search and Meta Data Filtering","publishedAt":"2025-08-06T17:47:00.000Z","upvotes":0,"isUpvotedByUser":false}},{"time":"2025-08-06T19:29:23.611Z","user":"1024m","userAvatarUrl":"","type":"paper","paper":{"id":"2507.23336","title":"DSBC : Data Science task Benchmarking with Context engineering","publishedAt":"2025-07-31T08:32:37.000Z","upvotes":2,"isUpvotedByUser":true}}],"acceptLanguages":["*"],"canReadRepos":false,"canReadSpaces":false,"blogPosts":[],"currentRepoPage":0,"filters":{},"paperView":false}">AI & ML interests
Exploring Extreme Quantization techniques !
Recent Activity
View all activity
Organization Card
Welcome to Our Extreme Quantization Hub
Here, we focus on models built with extreme quantization techniques. Our mission is to push the boundaries of this technology, making it accessible for the community and setting new standards for the field.
🚀 Latest Releases: 8B Models Fine-tuned on BitNet Architecture
You can learn more about how we created the following models in this blogpost
Llama3-8B-1.58-100B-tokens
Fine-tuned on 100B tokens for maximum performance.Llama3-8B-1.58-Linear-10B-tokens
Fine-tuned with a Linear Lambda scheduler on 10B tokens.Llama3-8B-1.58-Sigmoid-k100-10B-tokens
Fine-tuned with a Simgoid Lambda scheduler with k=100 on 10B tokens.
Join us in the era of extreme quantization as we continue to push this technology forward !
datasets
0
None public yet