https://huggingface.co/microsoft/Phi-3-mini-4k-instruct\n","updatedAt":"2024-04-23T15:13:42.818Z","author":{"_id":"64726d4045c2f5457fb00e47","avatarUrl":"/avatars/511705723ec776a91bdff4fd4bd37c12.svg","fullname":"Volodymyr","name":"ThreeBlessings","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7681654691696167},"editors":["ThreeBlessings"],"editorAvatarUrls":["/avatars/511705723ec776a91bdff4fd4bd37c12.svg"],"reactions":[],"isReport":false,"parentCommentId":"662728d0974a2868d847890a"}},{"id":"670516f3c89edc4616b515d8","author":{"_id":"650af091b29b1683eda2e143","avatarUrl":"/avatars/cbfcec32c4291c2f7015553e3d6544af.svg","fullname":"chengjianling","name":"www3077665332","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false},"createdAt":"2024-10-08T11:26:43.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"When did mini3.5-gguf release the new mobile phone processing and it can run smoothly?","html":"
When did mini3.5-gguf release the new mobile phone processing and it can run smoothly?
\n","updatedAt":"2024-10-08T11:26:43.624Z","author":{"_id":"650af091b29b1683eda2e143","avatarUrl":"/avatars/cbfcec32c4291c2f7015553e3d6544af.svg","fullname":"chengjianling","name":"www3077665332","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"editors":["www3077665332"],"editorAvatarUrls":["/avatars/cbfcec32c4291c2f7015553e3d6544af.svg"],"reactions":[],"isReport":false,"parentCommentId":"662728d0974a2868d847890a"}}]},{"id":"66272d886ba9408567e69d1c","author":{"_id":"65a9096b539e21143610dfb0","avatarUrl":"/avatars/f8f016759049a9ddd68a1206637e8d89.svg","fullname":"seven zhang","name":"seven89","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1,"isUserFollowing":false},"createdAt":"2024-04-23T03:39:52.000Z","type":"comment","data":{"edited":true,"hidden":false,"latest":{"raw":"G","html":"G
\n","updatedAt":"2024-04-23T03:40:25.672Z","author":{"_id":"65a9096b539e21143610dfb0","avatarUrl":"/avatars/f8f016759049a9ddd68a1206637e8d89.svg","fullname":"seven zhang","name":"seven89","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1,"isUserFollowing":false}},"numEdits":1,"identifiedLanguage":{"language":"zh","probability":0.9832334518432617},"editors":["seven89"],"editorAvatarUrls":["/avatars/f8f016759049a9ddd68a1206637e8d89.svg"],"reactions":[],"isReport":false}},{"id":"66272efb8ea014ccfff47014","author":{"_id":"65a3e1f99acab19980cb6523","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65a3e1f99acab19980cb6523/FE9kMEYpFPFFmJAM378vY.jpeg","fullname":"Maksym Huczynski","name":"h2m","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":11,"isUserFollowing":false},"createdAt":"2024-04-23T03:46:03.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"pocket-size gpt-3.5?\n14B matching GPT-4-0314 MT-Bench?\n<3","html":"pocket-size gpt-3.5?
14B matching GPT-4-0314 MT-Bench?
<3
weights or it didn't happen. Also, please make it apache 2.0.
\n","updatedAt":"2024-04-23T03:47:41.603Z","author":{"_id":"648b344fb04571b0a5e58281","avatarUrl":"/avatars/e33fb6196c422d8c386d18c0bf1465a8.svg","fullname":"Mohd Zeeshan","name":"ZappY-AI","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9741812348365784},"editors":["ZappY-AI"],"editorAvatarUrls":["/avatars/e33fb6196c422d8c386d18c0bf1465a8.svg"],"reactions":[{"reaction":"โ","users":["samusenps","clem","tripathiarpan20","Enigrand","Vezora","Sakanamochi","g-ronimo","mechanicmuthu","dtanow","adamm-hf","alvarobartt","arunsammit","Lin-Chen","Kimmonismus","abhishek","burtenshaw","Jaward","Xalphinions","mlinmg","andriizadaianchuk","eliolio","lolendo","maazmikail17","kitsuneb","MyUser","edmond","jeohalves","3642578a","ksaml","gcrois","utydfd","marinac","druser","metaltiger775","Someman","charlesniswander","Tanne"],"count":37},{"reaction":"๐","users":["adamm-hf","Tanne","kaizuberbuehler","marcusinthesky","barakplasma","abhishek","burtenshaw","mlinmg","lolendo","edmond","3642578a","gcrois","bembo","metaltiger775","Bachstelze","Someman","charlesniswander","mertyazan"],"count":18},{"reaction":"โค๏ธ","users":["adamm-hf","burtenshaw","mlinmg","lolendo","edmond","gcrois","utydfd","jacksth22","viktordanov","Abecid","charlesniswander"],"count":11},{"reaction":"๐ฅ","users":["adamm-hf","burtenshaw","mlinmg","lolendo","edmond","gcrois","viktordanov","charlesniswander"],"count":8}],"isReport":false}},{"id":"662737de311a0f41f97b0843","author":{"_id":"645ba903ca5d8a2977148389","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/zxdZvpuAP6qEhk3vyRO3_.jpeg","fullname":"Zoltan Csaki","name":"zolicsaki","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":36,"isUserFollowing":false},"createdAt":"2024-04-23T04:23:58.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Weights? ","html":"Weights?
\n","updatedAt":"2024-04-23T04:23:58.687Z","author":{"_id":"645ba903ca5d8a2977148389","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/zxdZvpuAP6qEhk3vyRO3_.jpeg","fullname":"Zoltan Csaki","name":"zolicsaki","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":36,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9924558401107788},"editors":["zolicsaki"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/zxdZvpuAP6qEhk3vyRO3_.jpeg"],"reactions":[{"reaction":"๐","users":["adamm-hf","ThreeBlessings","kaizuberbuehler","druser"],"count":4},{"reaction":"โ","users":["adamm-hf"],"count":1}],"isReport":false}},{"id":"66274f92f7cf69d4224d7ca2","author":{"_id":"6340651b388c3fa40f9a5bc0","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6340651b388c3fa40f9a5bc0/av1C4_S7bHGxAzOu8lOmG.jpeg","fullname":"Adam Molnar","name":"adamm-hf","type":"user","isPro":false,"isHf":true,"isHfAdmin":true,"isMod":false,"followerCount":514,"isUserFollowing":false},"createdAt":"2024-04-23T06:05:06.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Very cool! Would be awesome to increase visibility + experimentation by sharing the weights as well ๐ค","html":"Very cool! Would be awesome to increase visibility + experimentation by sharing the weights as well ๐ค
\n","updatedAt":"2024-04-23T06:05:06.167Z","author":{"_id":"6340651b388c3fa40f9a5bc0","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6340651b388c3fa40f9a5bc0/av1C4_S7bHGxAzOu8lOmG.jpeg","fullname":"Adam Molnar","name":"adamm-hf","type":"user","isPro":false,"isHf":true,"isHfAdmin":true,"isMod":false,"followerCount":514,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9653069376945496},"editors":["adamm-hf"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/6340651b388c3fa40f9a5bc0/av1C4_S7bHGxAzOu8lOmG.jpeg"],"reactions":[{"reaction":"๐","users":["kaizuberbuehler","druser","charlesniswander","farpluto"],"count":4}],"isReport":false}},{"id":"66275e7c03be83febc4b6d54","author":{"_id":"65de83ad04b9352580d2f03a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/rta6LcYODzuTjt9SDd-0d.png","fullname":"Arda Tuฤsat","name":"siberparsomen","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false},"createdAt":"2024-04-23T07:08:44.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"This is ฤฑncredible. When we will see the weights?","html":"This is ฤฑncredible. When we will see the weights?
\n","updatedAt":"2024-04-23T07:08:44.887Z","author":{"_id":"65de83ad04b9352580d2f03a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/rta6LcYODzuTjt9SDd-0d.png","fullname":"Arda Tuฤsat","name":"siberparsomen","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9643322229385376},"editors":["siberparsomen"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/rta6LcYODzuTjt9SDd-0d.png"],"reactions":[{"reaction":"๐","users":["kaizuberbuehler","druser","charlesniswander"],"count":3}],"isReport":false}},{"id":"662766d403be83febc4d4762","author":{"_id":"5df7e9e5da6d0311fd3d53f9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1583857746553-5df7e9e5da6d0311fd3d53f9.jpeg","fullname":"Thomas Wolf","name":"thomwolf","type":"user","isPro":true,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":1683,"isUserFollowing":false},"createdAt":"2024-04-23T07:44:20.000Z","type":"comment","data":{"edited":true,"hidden":false,"latest":{"raw":"So great to see the successor of Phi-1.5/2 โ Looking forward to being able to play with the model and embed it locally everywhere!","html":"So great to see the successor of Phi-1.5/2 โ Looking forward to being able to play with the model and embed it locally everywhere!
\n","updatedAt":"2024-04-23T07:44:46.480Z","author":{"_id":"5df7e9e5da6d0311fd3d53f9","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1583857746553-5df7e9e5da6d0311fd3d53f9.jpeg","fullname":"Thomas Wolf","name":"thomwolf","type":"user","isPro":true,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":1683,"isUserFollowing":false}},"numEdits":1,"identifiedLanguage":{"language":"en","probability":0.9642260670661926},"editors":["thomwolf"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1583857746553-5df7e9e5da6d0311fd3d53f9.jpeg"],"reactions":[{"reaction":"๐ฅ","users":["andriizadaianchuk","Pingmeep"],"count":2}],"isReport":false}},{"id":"66276f4bc374273c27f8da64","author":{"_id":"630c2a12910e17bbfeb1ce18","avatarUrl":"/avatars/0c1dd3ebc0e2c8ecf6c771d3728accf9.svg","fullname":"Razvan","name":"razvanab","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":21,"isUserFollowing":false},"createdAt":"2024-04-23T08:20:27.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Weights Please ๐","html":"Weights Please ๐
\n","updatedAt":"2024-04-23T08:20:27.204Z","author":{"_id":"630c2a12910e17bbfeb1ce18","avatarUrl":"/avatars/0c1dd3ebc0e2c8ecf6c771d3728accf9.svg","fullname":"Razvan","name":"razvanab","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":21,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9088301658630371},"editors":["razvanab"],"editorAvatarUrls":["/avatars/0c1dd3ebc0e2c8ecf6c771d3728accf9.svg"],"reactions":[{"reaction":"โค๏ธ","users":["maxrubin629","druser"],"count":2}],"isReport":false}},{"id":"662777ed0d3cf6f7b951cb49","author":{"_id":"662774716268ae5491c621c0","avatarUrl":"/avatars/a74e0c041ae3968b20dbf7ab0ac2b636.svg","fullname":"A Bugayev","name":"Alex805","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false},"createdAt":"2024-04-23T08:57:17.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"These SLMs are better and better so far. Would be cool to get an apk to actually run them on mobile devices without termux. Two existing things that I know of, are with limited models support. And GPT 3.5 level of model quality is a good occasion to wrap it","html":"These SLMs are better and better so far. Would be cool to get an apk to actually run them on mobile devices without termux. Two existing things that I know of, are with limited models support. And GPT 3.5 level of model quality is a good occasion to wrap it
\n","updatedAt":"2024-04-23T08:57:17.779Z","author":{"_id":"662774716268ae5491c621c0","avatarUrl":"/avatars/a74e0c041ae3968b20dbf7ab0ac2b636.svg","fullname":"A Bugayev","name":"Alex805","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9414817690849304},"editors":["Alex805"],"editorAvatarUrls":["/avatars/a74e0c041ae3968b20dbf7ab0ac2b636.svg"],"reactions":[],"isReport":false},"replies":[{"id":"6627874c911d848e35747ba4","author":{"_id":"5e80b7d830dc073f817a2bc0","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1585493970035-noauth.jpeg","fullname":"Haris Jabbar","name":"maveriq","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":7,"isUserFollowing":false},"createdAt":"2024-04-23T10:02:52.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"I agree that SLMs probably need more focus and have potential to make great strides on multiple fronts; be it accessbility, deployability, inference speed and new usecases. Ofcourse it means putting in more effort on dataset curation and maybe even the architecture. Phi series is the proof that focused data curation alone can improve performance quite a bit. ","html":"I agree that SLMs probably need more focus and have potential to make great strides on multiple fronts; be it accessbility, deployability, inference speed and new usecases. Ofcourse it means putting in more effort on dataset curation and maybe even the architecture. Phi series is the proof that focused data curation alone can improve performance quite a bit.
\n","updatedAt":"2024-04-23T10:02:52.746Z","author":{"_id":"5e80b7d830dc073f817a2bc0","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1585493970035-noauth.jpeg","fullname":"Haris Jabbar","name":"maveriq","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":7,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9626772999763489},"editors":["maveriq"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1585493970035-noauth.jpeg"],"reactions":[],"isReport":false,"parentCommentId":"662777ed0d3cf6f7b951cb49"}}]},{"id":"662782d0846c2a66a7c6fcb3","author":{"_id":"64aea8ff67511bd3d965697b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg","fullname":"Feynman Innovations","name":"ajibawa-2023","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":189,"isUserFollowing":false},"createdAt":"2024-04-23T09:43:44.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Given recent events, I don't think weights will be available and forget about dataset. Even if weights are released it will be taken down next day for some testing or alignment or some other stuff only never to return. Great job guys!!","html":"Given recent events, I don't think weights will be available and forget about dataset. Even if weights are released it will be taken down next day for some testing or alignment or some other stuff only never to return. Great job guys!!
\n","updatedAt":"2024-04-23T09:43:44.852Z","author":{"_id":"64aea8ff67511bd3d965697b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg","fullname":"Feynman Innovations","name":"ajibawa-2023","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":189,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9426619410514832},"editors":["ajibawa-2023"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg"],"reactions":[{"reaction":"๐","users":["eek","ThreeBlessings"],"count":2},{"reaction":"๐","users":["CaryPalmer"],"count":1}],"isReport":false},"replies":[{"id":"6627a525efb20bb976a6b7fd","author":{"_id":"64726d4045c2f5457fb00e47","avatarUrl":"/avatars/511705723ec776a91bdff4fd4bd37c12.svg","fullname":"Volodymyr","name":"ThreeBlessings","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1,"isUserFollowing":false},"createdAt":"2024-04-23T12:10:13.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"I'm not sure what recent events you're referring to. I'll wait for the official statement before jumping to conclusions.","html":"I'm not sure what recent events you're referring to. I'll wait for the official statement before jumping to conclusions.
\n","updatedAt":"2024-04-23T12:10:13.879Z","author":{"_id":"64726d4045c2f5457fb00e47","avatarUrl":"/avatars/511705723ec776a91bdff4fd4bd37c12.svg","fullname":"Volodymyr","name":"ThreeBlessings","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9678840637207031},"editors":["ThreeBlessings"],"editorAvatarUrls":["/avatars/511705723ec776a91bdff4fd4bd37c12.svg"],"reactions":[],"isReport":false,"parentCommentId":"662782d0846c2a66a7c6fcb3"}},{"id":"664e19b5bc40cce7a8623640","author":{"_id":"6402c5df5caf6d21d680a2e0","avatarUrl":"/avatars/e78b8cd006ddee8ac5f19f809c3ff659.svg","fullname":"Shawn Fumo","name":"InvidFlower","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false},"createdAt":"2024-05-22T16:13:41.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"I'm pretty sure that was just related to a fine tuning that was done on top of Llama 3. It doesn't have anything to do with Phi 3, which is trained from scratch. And in fact the weights for for the 14b Medium Phi-3 model and a vision model were just released yesterday.","html":"I'm pretty sure that was just related to a fine tuning that was done on top of Llama 3. It doesn't have anything to do with Phi 3, which is trained from scratch. And in fact the weights for for the 14b Medium Phi-3 model and a vision model were just released yesterday.
\n","updatedAt":"2024-05-22T16:13:41.334Z","author":{"_id":"6402c5df5caf6d21d680a2e0","avatarUrl":"/avatars/e78b8cd006ddee8ac5f19f809c3ff659.svg","fullname":"Shawn Fumo","name":"InvidFlower","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9970608949661255},"editors":["InvidFlower"],"editorAvatarUrls":["/avatars/e78b8cd006ddee8ac5f19f809c3ff659.svg"],"reactions":[],"isReport":false,"parentCommentId":"662782d0846c2a66a7c6fcb3"}}]},{"id":"6627891c8c21ce7747fbf64d","author":{"_id":"644a114201e18bf93a6eff8f","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/644a114201e18bf93a6eff8f/rYdjfaJ-4-SlT3PRmChdc.jpeg","fullname":"Mouhu","name":"MouhuAI","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":13,"isUserFollowing":false},"createdAt":"2024-04-23T10:10:36.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"When will the model be released?","html":"When will the model be released?
\n","updatedAt":"2024-04-23T10:10:36.027Z","author":{"_id":"644a114201e18bf93a6eff8f","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/644a114201e18bf93a6eff8f/rYdjfaJ-4-SlT3PRmChdc.jpeg","fullname":"Mouhu","name":"MouhuAI","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":13,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9401509165763855},"editors":["MouhuAI"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/644a114201e18bf93a6eff8f/rYdjfaJ-4-SlT3PRmChdc.jpeg"],"reactions":[{"reaction":"๐","users":["GeroxDev","aseto","tkdss37","SunilSurineni","Bachstelze","RalfB23"],"count":6}],"isReport":false}},{"id":"6627a9d88e14b51809f553ea","author":{"_id":"62af665424488e6adfa9b8e2","avatarUrl":"/avatars/2bdb4a26fde4cbe5b4673e53e0d44540.svg","fullname":"Edmond Jacoupeau","name":"edmond","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":3,"isUserFollowing":false},"createdAt":"2024-04-23T12:30:16.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"LLama was never competitive, LLama 2 got in a few weeks beaten by Mistral, LLama 3 got in a few days beaten by Phi 3 ?\nDamn if this is true Zuck might start to become seriously mad ... (even if phi is using LLama 2)","html":"LLama was never competitive, LLama 2 got in a few weeks beaten by Mistral, LLama 3 got in a few days beaten by Phi 3 ?
Damn if this is true Zuck might start to become seriously mad ... (even if phi is using LLama 2)
Here's a quick walkthrough of the paper: https://huggingface.co/posts/Jaward/284702584639894
\n","updatedAt":"2024-04-23T12:33:43.581Z","author":{"_id":"6438a9027de34e8ea7e4b257","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6438a9027de34e8ea7e4b257/vib8QSd1AWMr_bR9ig_xJ.jpeg","fullname":"Jaward Sesay","name":"Jaward","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":357,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7239969968795776},"editors":["Jaward"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/6438a9027de34e8ea7e4b257/vib8QSd1AWMr_bR9ig_xJ.jpeg"],"reactions":[{"reaction":"๐","users":["lukestanley","braneloop","victor"],"count":3},{"reaction":"๐ฅ","users":["clem"],"count":1}],"isReport":false}},{"id":"6627ae969177494937990401","author":{"_id":"6486638da4cf2081f20c40ec","avatarUrl":"/avatars/0bc16a7447cd71ac18828a678313bd83.svg","fullname":"Mike Young","name":"mikelabs","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":13,"isUserFollowing":false},"createdAt":"2024-04-23T12:50:30.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"I saw weights are coming tomorrow (on Twitter, hopefully it's legit!). In any case, there's a plain-english rewrite of this paper available here if you want: https://www.aimodels.fyi/papers/arxiv/phi-3-technical-report-highly-capable-language","html":"I saw weights are coming tomorrow (on Twitter, hopefully it's legit!). In any case, there's a plain-english rewrite of this paper available here if you want: https://www.aimodels.fyi/papers/arxiv/phi-3-technical-report-highly-capable-language
\n","updatedAt":"2024-04-23T12:50:30.476Z","author":{"_id":"6486638da4cf2081f20c40ec","avatarUrl":"/avatars/0bc16a7447cd71ac18828a678313bd83.svg","fullname":"Mike Young","name":"mikelabs","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":13,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8670075535774231},"editors":["mikelabs"],"editorAvatarUrls":["/avatars/0bc16a7447cd71ac18828a678313bd83.svg"],"reactions":[],"isReport":false}},{"id":"6627c36ca7eec4c3fce66575","author":{"_id":"62f27b53e538a8081154ba9f","avatarUrl":"/avatars/7ba33fdcf3b9f2658839421ea0d1d67f.svg","fullname":"Luke Stanley","name":"lukestanley","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":2,"isUserFollowing":false},"createdAt":"2024-04-23T14:19:24.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Surely the first reference needs fixing to say 2024 and to use capital letters in the right places?\nCurrently says: \"References\n[AI23] Meta AI. Introducing meta llama 3: The most capable openly available llm to date, 2023.\"\n\nSurely it should be: \"[AI23] Meta AI. Introducing Meta Llama 3: The most capable openly available LLM to date, 2024.\"?\n@gugarosa \nSo looking forward to playing with this, well done all!","html":"Surely the first reference needs fixing to say 2024 and to use capital letters in the right places?
Currently says: \"References
[AI23] Meta AI. Introducing meta llama 3: The most capable openly available llm to date, 2023.\"
Surely it should be: \"[AI23] Meta AI. Introducing Meta Llama 3: The most capable openly available LLM to date, 2024.\"?
\n\n@gugarosa\n\t
So looking forward to playing with this, well done all!
How did you \"filter\" data for Phase-1 and 2? Was it manual? How did you ensure if it was automated?
\nAlso, what was the criteria for \"inducing reasoning\" on the dataset and web?
\n","updatedAt":"2024-04-23T15:07:48.091Z","author":{"_id":"630b01434bee441367b788d3","avatarUrl":"/avatars/4e8089069801441e1ecc242e2e706df1.svg","fullname":"Mahesh Deshwal","name":"deshwalmahesh","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9733771681785583},"editors":["deshwalmahesh"],"editorAvatarUrls":["/avatars/4e8089069801441e1ecc242e2e706df1.svg"],"reactions":[],"isReport":false}},{"id":"6627d3764db3629b5361365a","author":{"_id":"60a551a34ecc5d054c8ad93e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60a551a34ecc5d054c8ad93e/dhcBFtwNLcKqqASxniyVw.jpeg","fullname":"Mishig Davaadorj","name":"mishig","type":"user","isPro":false,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":307,"isUserFollowing":false},"createdAt":"2024-04-23T15:27:50.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"it is now available on hugging chat ๐ฅ https://huggingface.co/chat/models/microsoft/Phi-3-mini-4k-instruct\n\n\n","html":"it is now available on hugging chat ๐ฅ https://huggingface.co/chat/models/microsoft/Phi-3-mini-4k-instruct
\nfor some reason the one on hugging chat gives me crappy answers , e.g.:
Q: what files are needed for a chrome extension, what are their names?
A: To add unit tests for the URLAnalyzer class, you'll need to set up a testing framework like Jest. Here's an example of how you might write tests for the waitForClassPresence and analyzeUrl met [...] and so on, completely unrelated junk)
I tried the gguf Q4 version in gpt4all, and got much better results, only issue is with the stop token
\n","updatedAt":"2024-04-24T03:43:31.301Z","author":{"_id":"658430e5c5599ad89a350e95","avatarUrl":"/avatars/49d5d69dca622797a1378c50cf460377.svg","fullname":"Retteghy","name":"retteghy","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1,"isUserFollowing":false}},"numEdits":1,"identifiedLanguage":{"language":"en","probability":0.9022683501243591},"editors":["retteghy"],"editorAvatarUrls":["/avatars/49d5d69dca622797a1378c50cf460377.svg"],"reactions":[],"isReport":false,"parentCommentId":"6627d3764db3629b5361365a"}},{"id":"662985dac9d9396ee27ccf29","author":{"_id":"5f17f0a0925b9863e28ad517","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5f17f0a0925b9863e28ad517/fXIY5i9RLsIa1v3CCuVtt.jpeg","fullname":"Victor Mustar","name":"victor","type":"user","isPro":true,"isHf":true,"isHfAdmin":true,"isMod":false,"followerCount":5157,"isUserFollowing":false},"createdAt":"2024-04-24T22:21:14.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"> for some reason the one on hugging chat gives me crappy answers , e.g.:\n\ncc @nsarrazin who is working on it - should be better soon ๐ฅ","html":"\n\nfor some reason the one on hugging chat gives me crappy answers , e.g.:
\n
cc \n\n@nsarrazin\n\t who is working on it - should be better soon ๐ฅ
\n","updatedAt":"2024-04-24T22:21:14.040Z","author":{"_id":"5f17f0a0925b9863e28ad517","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5f17f0a0925b9863e28ad517/fXIY5i9RLsIa1v3CCuVtt.jpeg","fullname":"Victor Mustar","name":"victor","type":"user","isPro":true,"isHf":true,"isHfAdmin":true,"isMod":false,"followerCount":5157,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8766080737113953},"editors":["victor"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/5f17f0a0925b9863e28ad517/fXIY5i9RLsIa1v3CCuVtt.jpeg"],"reactions":[],"isReport":false,"parentCommentId":"6627d3764db3629b5361365a"}}]},{"id":"6627d389c09f335afc48ca50","author":{"_id":"5e67bdd61009063689407479","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1583857146757-5e67bdd61009063689407479.jpeg","fullname":"Clem ๐ค","name":"clem","type":"user","isPro":true,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":2868,"isUserFollowing":false},"createdAt":"2024-04-23T15:28:09.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"The weights just dropped - MIT license!\n\nhttps://huggingface.co/microsoft/Phi-3-mini-128k-instruct \nhttps://huggingface.co/microsoft/Phi-3-mini-4k-instruct","html":"The weights just dropped - MIT license!
\nhttps://huggingface.co/microsoft/Phi-3-mini-128k-instruct
https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
Would love to see all models in this family on LMSYS arena!
\nArena is like double blind peer review ++ randomized controlled trials in science! The golden standard to judge something. I hope some API provider like Together API would provide inference services for these family of models to us all and also for Arena!
\n","updatedAt":"2024-04-23T17:20:24.977Z","author":{"_id":"64aed48cfec303c461d06242","avatarUrl":"/avatars/236c771e6c5a25ef6ed5e1bc061e30b8.svg","fullname":"Krishna Kaasyap","name":"KrishnaKaasyap","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":6,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9594466090202332},"editors":["KrishnaKaasyap"],"editorAvatarUrls":["/avatars/236c771e6c5a25ef6ed5e1bc061e30b8.svg"],"reactions":[],"isReport":false},"replies":[{"id":"6627ef58c09f335afc4fe9bb","author":{"_id":"5e67bdd61009063689407479","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1583857146757-5e67bdd61009063689407479.jpeg","fullname":"Clem ๐ค","name":"clem","type":"user","isPro":true,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":2868,"isUserFollowing":false},"createdAt":"2024-04-23T17:26:48.000Z","type":"comment","data":{"edited":true,"hidden":false,"latest":{"raw":"you can try the models with transformers (https://github.com/huggingface/transformers) or TGI already ( https://github.com/huggingface/text-generation-inference) cc @Narsil @lysandre","html":"you can try the models with transformers (https://github.com/huggingface/transformers) or TGI already ( https://github.com/huggingface/text-generation-inference) cc \n\n@Narsil\n\t \n\n@lysandre\n\t
\n","updatedAt":"2024-04-23T17:27:09.091Z","author":{"_id":"5e67bdd61009063689407479","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1583857146757-5e67bdd61009063689407479.jpeg","fullname":"Clem ๐ค","name":"clem","type":"user","isPro":true,"isHf":true,"isHfAdmin":false,"isMod":false,"followerCount":2868,"isUserFollowing":false}},"numEdits":1,"identifiedLanguage":{"language":"en","probability":0.7363807559013367},"editors":["clem"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1583857146757-5e67bdd61009063689407479.jpeg"],"reactions":[{"reaction":"โค๏ธ","users":["KrishnaKaasyap"],"count":1}],"isReport":false,"parentCommentId":"6627edd82c3877cd9db67680"}}]},{"id":"6627f34809826aaa250d1b01","author":{"_id":"615b8a9c23f3c5e91441a387","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/615b8a9c23f3c5e91441a387/b7wAb09b-doTD5zf4gZOc.jpeg","fullname":"Carlos Escobar","name":"Broomva","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false},"createdAt":"2024-04-23T17:43:36.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Does it have any tuning for function calling? What dataset was used or how to fine tune it for agent applications?","html":"Does it have any tuning for function calling? What dataset was used or how to fine tune it for agent applications?
\n","updatedAt":"2024-04-23T17:43:36.247Z","author":{"_id":"615b8a9c23f3c5e91441a387","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/615b8a9c23f3c5e91441a387/b7wAb09b-doTD5zf4gZOc.jpeg","fullname":"Carlos Escobar","name":"Broomva","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9594060182571411},"editors":["Broomva"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/615b8a9c23f3c5e91441a387/b7wAb09b-doTD5zf4gZOc.jpeg"],"reactions":[],"isReport":false}},{"id":"6627fe02ddab753c4a19a818","author":{"_id":"60c8d264224e250fb0178f77","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60c8d264224e250fb0178f77/i8fbkBVcoFeJRmkQ9kYAE.png","fullname":"Adam Lee","name":"Abecid","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":7,"isUserFollowing":false},"createdAt":"2024-04-23T18:29:22.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Wow people are actually starting to use hf comments now really cool ๐","html":"Wow people are actually starting to use hf comments now really cool ๐
\n","updatedAt":"2024-04-23T18:29:22.801Z","author":{"_id":"60c8d264224e250fb0178f77","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60c8d264224e250fb0178f77/i8fbkBVcoFeJRmkQ9kYAE.png","fullname":"Adam Lee","name":"Abecid","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":7,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9734535813331604},"editors":["Abecid"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/60c8d264224e250fb0178f77/i8fbkBVcoFeJRmkQ9kYAE.png"],"reactions":[{"reaction":"๐","users":["clem"],"count":1},{"reaction":"๐ฅ","users":["victor"],"count":1}],"isReport":false}},{"id":"662809bad48d5daa797416a3","author":{"_id":"639c751c8a34ed9a404d1627","avatarUrl":"/avatars/ad21cfa15f2ac6dfbbd7ad60c28266f6.svg","fullname":"Damodharan","name":"damojay","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false},"createdAt":"2024-04-23T19:19:22.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"To be able to finetune it for json mode and the ability to use it in mobile will have very nice impact!\nOpens so many opportunities for agents in GPU poor devices","html":"To be able to finetune it for json mode and the ability to use it in mobile will have very nice impact!
Opens so many opportunities for agents in GPU poor devices
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
\nThe following papers were recommended by the Semantic Scholar API
\n- \n
- Stable LM 2 1.6B Technical Report (2024) \n
- Nemotron-4 15B Technical Report (2024) \n
- Latxa: An Open Language Model and Evaluation Suite for Basque (2024) \n
- Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws (2024) \n
- LAB: Large-Scale Alignment for ChatBots (2024) \n
Please give a thumbs up to this comment if you found it helpful!
\nIf you want recommendations for any Paper on Hugging Face checkout this Space
\n You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot\n\t recommend
phi-4 will run on a toaster
\n","updatedAt":"2024-04-26T22:51:35.868Z","author":{"_id":"5f353bb37e58354338621655","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1639773384591-5f353bb37e58354338621655.jpeg","fullname":"Nicholas Broad","name":"nbroad","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":117,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7404853105545044},"editors":["nbroad"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1639773384591-5f353bb37e58354338621655.jpeg"],"reactions":[{"reaction":"๐","users":["mrfakename","m-ric","florentgbelidji","CkMad","InvidFlower","jayebaku"],"count":6}],"isReport":false}},{"id":"662e8a46a364f7df3995db19","author":{"_id":"648a210e9da3cc3506961585","avatarUrl":"/avatars/808e9d7ac99837fe79169d0b8d49c366.svg","fullname":"Ajith V Prabhakar","name":"ajithprabhakar","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":3,"isUserFollowing":false},"createdAt":"2024-04-28T17:41:26.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Here is my blog showcasing this paper : https://ajithp.com/2024/04/28/the-miniature-language-model-with-massive-potential-introducing-phi-3/","html":"Here is my blog showcasing this paper : https://ajithp.com/2024/04/28/the-miniature-language-model-with-massive-potential-introducing-phi-3/
\n","updatedAt":"2024-04-28T17:41:26.653Z","author":{"_id":"648a210e9da3cc3506961585","avatarUrl":"/avatars/808e9d7ac99837fe79169d0b8d49c366.svg","fullname":"Ajith V Prabhakar","name":"ajithprabhakar","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":3,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7513186931610107},"editors":["ajithprabhakar"],"editorAvatarUrls":["/avatars/808e9d7ac99837fe79169d0b8d49c366.svg"],"reactions":[],"isReport":false}},{"id":"662fc89872779ad1f13569b8","author":{"_id":"63d10d4e8eaa4831005e92b5","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63d10d4e8eaa4831005e92b5/7p7-OmWM6PqqCs7ZStPGD.jpeg","fullname":"Aymeric Roucher","name":"m-ric","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1889,"isUserFollowing":false},"createdAt":"2024-04-29T16:19:36.000Z","type":"comment","data":{"edited":true,"hidden":false,"latest":{"raw":"This very high performance on some benchmarks (the paper claims a performance than Mixtral 8x7B) seems suspicious, given that the model scores way lower on Chatbot Arena: it has an ELO 1064 as of now, so it's good but below Mistral 7B-Instruct-0.2 (1073), and far below Mixtral (1114).","html":"This very high performance on some benchmarks (the paper claims a performance than Mixtral 8x7B) seems suspicious, given that the model scores way lower on Chatbot Arena: it has an ELO 1064 as of now, so it's good but below Mistral 7B-Instruct-0.2 (1073), and far below Mixtral (1114).
\n","updatedAt":"2024-04-29T16:33:16.979Z","author":{"_id":"63d10d4e8eaa4831005e92b5","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63d10d4e8eaa4831005e92b5/7p7-OmWM6PqqCs7ZStPGD.jpeg","fullname":"Aymeric Roucher","name":"m-ric","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":1889,"isUserFollowing":false}},"numEdits":3,"identifiedLanguage":{"language":"en","probability":0.9493606090545654},"editors":["m-ric"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/63d10d4e8eaa4831005e92b5/7p7-OmWM6PqqCs7ZStPGD.jpeg"],"reactions":[],"isReport":false}},{"id":"66303f85b6d15534200c23e0","author":{"_id":"6366313c361a96184dbadff8","avatarUrl":"/avatars/9b83c5aedc02267d9596b19c20fbe593.svg","fullname":"HAN JUNGU","name":"JUNGU","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":4,"isUserFollowing":false},"createdAt":"2024-04-30T00:47:01.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"I've never seen so many comments on an HF paper before.","html":"I've never seen so many comments on an HF paper before.
\n","updatedAt":"2024-04-30T00:47:01.431Z","author":{"_id":"6366313c361a96184dbadff8","avatarUrl":"/avatars/9b83c5aedc02267d9596b19c20fbe593.svg","fullname":"HAN JUNGU","name":"JUNGU","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":4,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9923465251922607},"editors":["JUNGU"],"editorAvatarUrls":["/avatars/9b83c5aedc02267d9596b19c20fbe593.svg"],"reactions":[{"reaction":"โค๏ธ","users":["edmond","clem","jayebaku"],"count":3}],"isReport":false},"replies":[{"id":"6630e9c95a9e326bb340764e","author":{"_id":"62af665424488e6adfa9b8e2","avatarUrl":"/avatars/2bdb4a26fde4cbe5b4673e53e0d44540.svg","fullname":"Edmond Jacoupeau","name":"edmond","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":3,"isUserFollowing":false},"createdAt":"2024-04-30T12:53:29.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Yeah, people dont want to understand that we dont want big open source LLMs but decent sized ones... ","html":"Yeah, people dont want to understand that we dont want big open source LLMs but decent sized ones...
\n","updatedAt":"2024-04-30T12:53:29.413Z","author":{"_id":"62af665424488e6adfa9b8e2","avatarUrl":"/avatars/2bdb4a26fde4cbe5b4673e53e0d44540.svg","fullname":"Edmond Jacoupeau","name":"edmond","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":3,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8838304877281189},"editors":["edmond"],"editorAvatarUrls":["/avatars/2bdb4a26fde4cbe5b4673e53e0d44540.svg"],"reactions":[{"reaction":"๐ฅ","users":["jayebaku"],"count":1}],"isReport":false,"parentCommentId":"66303f85b6d15534200c23e0"}},{"id":"664e1a012fb51bcf1e752356","author":{"_id":"6402c5df5caf6d21d680a2e0","avatarUrl":"/avatars/e78b8cd006ddee8ac5f19f809c3ff659.svg","fullname":"Shawn Fumo","name":"InvidFlower","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false},"createdAt":"2024-05-22T16:14:57.000Z","type":"comment","data":{"edited":true,"hidden":false,"latest":{"raw":"You didn't see the bitnet paper ๐","html":"You didn't see the bitnet paper ๐
\n","updatedAt":"2024-05-22T16:15:13.607Z","author":{"_id":"6402c5df5caf6d21d680a2e0","avatarUrl":"/avatars/e78b8cd006ddee8ac5f19f809c3ff659.svg","fullname":"Shawn Fumo","name":"InvidFlower","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isUserFollowing":false}},"numEdits":1,"identifiedLanguage":{"language":"en","probability":0.985586941242218},"editors":["InvidFlower"],"editorAvatarUrls":["/avatars/e78b8cd006ddee8ac5f19f809c3ff659.svg"],"reactions":[],"isReport":false,"parentCommentId":"66303f85b6d15534200c23e0"}}]},{"id":"6664a73b8a270cedd51cbee1","author":{"_id":"6186ddf6a7717cb375090c01","avatarUrl":"/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg","fullname":"Julien BLANCHON","name":"blanchon","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":176,"isUserFollowing":false},"createdAt":"2024-06-08T18:47:23.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"# Unleashing Phi-3-mini: Powerful AI on Your Phone \n\nhttps://cdn-uploads.huggingface.co/production/uploads/6186ddf6a7717cb375090c01/cBOSBURURaxRjK1TD6GQ4.mp4 \n\n## Links ๐:\n๐ Subscribe: https://www.youtube.com/@Arxflix\n๐ Twitter: https://x.com/arxflix\n๐ LMNT (Partner): https://lmnt.com/\n\n\nBy Arxflix\n","html":"\n\t\n\t\t\n\t\n\t\n\t\tUnleashing Phi-3-mini: Powerful AI on Your Phone\n\t\n
\n \n\n\n\t\n\t\t\n\t\n\t\n\t\tLinks ๐:\n\t\n
\n๐ Subscribe: https://www.youtube.com/@Arxflix
๐ Twitter: https://x.com/arxflix
๐ LMNT (Partner): https://lmnt.com/
By Arxflix
Papers
arxiv:2404.14219
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
Authors:
Abstract
Phi-3-mini, a compact 3.8 billion parameter language model, achieves competitive performance with larger models through an enhanced training dataset and alignment.
AI-generated summary
We introduce phi-3-mini, a 3.8 billion parameter language model trained on 3.3 trillion tokens, whose overall performance, as measured by both academic benchmarks and internal testing, rivals that of models such as Mixtral 8x7B and GPT-3.5 (e.g., phi-3-mini achieves 69% on MMLU and 8.38 on MT-bench), despite being small enough to be deployed on a phone. The innovation lies entirely in our dataset for training, a scaled-up version of the one used for phi-2, composed of heavily filtered web data and synthetic data. The model is also further aligned for robustness, safety, and chat format. We also provide some initial parameter-scaling results with a 7B and 14B models trained for 4.8T tokens, called phi-3-small and phi-3-medium, both significantly more capable than phi-3-mini (e.g., respectively 75% and 78% on MMLU, and 8.7 and 8.9 on MT-bench).
Community
Nice! When will the weights be released under an open source license?
Also important could we also get the 3.3T token dataset? ๐ค pretty please
G
pocket-size gpt-3.5?
14B matching GPT-4-0314 MT-Bench?
<3
weights or it didn't happen. Also, please make it apache 2.0.
Weights?
Very cool! Would be awesome to increase visibility + experimentation by sharing the weights as well ๐ค
This is ฤฑncredible. When we will see the weights?
So great to see the successor of Phi-1.5/2 โ Looking forward to being able to play with the model and embed it locally everywhere!
Weights Please ๐
These SLMs are better and better so far. Would be cool to get an apk to actually run them on mobile devices without termux. Two existing things that I know of, are with limited models support. And GPT 3.5 level of model quality is a good occasion to wrap it
I agree that SLMs probably need more focus and have potential to make great strides on multiple fronts; be it accessbility, deployability, inference speed and new usecases. Ofcourse it means putting in more effort on dataset curation and maybe even the architecture. Phi series is the proof that focused data curation alone can improve performance quite a bit.
Given recent events, I don't think weights will be available and forget about dataset. Even if weights are released it will be taken down next day for some testing or alignment or some other stuff only never to return. Great job guys!!
I'm not sure what recent events you're referring to. I'll wait for the official statement before jumping to conclusions.
When will the model be released?
LLama was never competitive, LLama 2 got in a few weeks beaten by Mistral, LLama 3 got in a few days beaten by Phi 3 ?
Damn if this is true Zuck might start to become seriously mad ... (even if phi is using LLama 2)
I saw weights are coming tomorrow (on Twitter, hopefully it's legit!). In any case, there's a plain-english rewrite of this paper available here if you want: https://www.aimodels.fyi/papers/arxiv/phi-3-technical-report-highly-capable-language
Surely the first reference needs fixing to say 2024 and to use capital letters in the right places?
Currently says: "References
[AI23] Meta AI. Introducing meta llama 3: The most capable openly available llm to date, 2023."
Surely it should be: "[AI23] Meta AI. Introducing Meta Llama 3: The most capable openly available LLM to date, 2024."?
@gugarosa
So looking forward to playing with this, well done all!
How did you "filter" data for Phase-1 and 2? Was it manual? How did you ensure if it was automated?
Also, what was the criteria for "inducing reasoning" on the dataset and web?
it is now available on hugging chat ๐ฅ https://huggingface.co/chat/models/microsoft/Phi-3-mini-4k-instruct
for some reason the one on hugging chat gives me crappy answers , e.g.:
Q: what files are needed for a chrome extension, what are their names?
A: To add unit tests for the URLAnalyzer class, you'll need to set up a testing framework like Jest. Here's an example of how you might write tests for the waitForClassPresence and analyzeUrl met [...] and so on, completely unrelated junk)
I tried the gguf Q4 version in gpt4all, and got much better results, only issue is with the stop token
The weights just dropped - MIT license!
https://huggingface.co/microsoft/Phi-3-mini-128k-instruct
https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
Would love to see all models in this family on LMSYS arena!
Arena is like double blind peer review ++ randomized controlled trials in science! The golden standard to judge something. I hope some API provider like Together API would provide inference services for these family of models to us all and also for Arena!
you can try the models with transformers (https://github.com/huggingface/transformers) or TGI already ( https://github.com/huggingface/text-generation-inference) cc @Narsil @lysandre
Does it have any tuning for function calling? What dataset was used or how to fine tune it for agent applications?
Wow people are actually starting to use hf comments now really cool ๐
To be able to finetune it for json mode and the ability to use it in mobile will have very nice impact!
Opens so many opportunities for agents in GPU poor devices
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Stable LM 2 1.6B Technical Report (2024)
- Nemotron-4 15B Technical Report (2024)
- Latxa: An Open Language Model and Evaluation Suite for Basque (2024)
- Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws (2024)
- LAB: Large-Scale Alignment for ChatBots (2024)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment:
@librarian-bot
recommend
phi-4 will run on a toaster
Here is my blog showcasing this paper : https://ajithp.com/2024/04/28/the-miniature-language-model-with-massive-potential-introducing-phi-3/
This very high performance on some benchmarks (the paper claims a performance than Mixtral 8x7B) seems suspicious, given that the model scores way lower on Chatbot Arena: it has an ELO 1064 as of now, so it's good but below Mistral 7B-Instruct-0.2 (1073), and far below Mixtral (1114).
Unleashing Phi-3-mini: Powerful AI on Your Phone
Links ๐:
๐ Subscribe: https://www.youtube.com/@Arxflix
๐ Twitter: https://x.com/arxflix
๐ LMNT (Partner): https://lmnt.com/
By Arxflix