dataset, paper), \nKMMLU (general knowledge, dataset, paper), HRM8K (math, dataset, paper), and KMMLU-Redux/Pro (general knowledge, dataset, paper).

\n

Evaluation
We developed the haerae-evaluation-toolkit, a unified LLM evaluation framework designed to provide consistent and reproducible benchmarking for Korean and multilingual models.

\n

Reasoning Language Models
With cooperation with KISTI-KONI we released the KO-REAson series, <10B reasoning language models trained for Korean.

\n

News

\n

2026.01.08: HAERAE-VISION a vision successor of HAE-RAE Bench is here! 👑
2025.08.31: We release six KO-REAson-0831 models 🔥🔥🔥
2025.07.11: We've collaborated with LG AI Research to build KMMLU-PRO an major update to our KMMLU franchise.
2025.01.05: We are releasing the first public korean math (📐e = ∑∞ⁿ⁼⁰ ¹ₙ🤓) benchmark HRM8K

\n","classNames":"hf-sanitized hf-sanitized-vK1IVeNuY8wqOWScw-sNW"},"users":[{"_id":"60d3e619b8448e1785bbda2a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60d3e619b8448e1785bbda2a/q2re5u1HNwsCCyIMtid_I.jpeg","isPro":true,"fullname":"GUIJIN SON","user":"amphora","type":"user"},{"_id":"6237dfd72d85ea7b3051d5bb","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6237dfd72d85ea7b3051d5bb/zt7RDDHwhxeBtyiP4e6ti.png","isPro":true,"fullname":"Hanwool Albert Lee","user":"Albertmade","type":"user"},{"_id":"64703a049ba7aeaacb288940","avatarUrl":"/avatars/386e8957ffd848bb5db3700993cd3a9e.svg","isPro":false,"fullname":"lim","user":"tae2089","type":"user"},{"_id":"63e0b169af523c37e5a4cfb3","avatarUrl":"/avatars/c8101bccd71e321040c7b0378fa487f8.svg","isPro":false,"fullname":"HanearlJung","user":"onelineai","type":"user"},{"_id":"648bdc09f39b9ba9ac819ba3","avatarUrl":"/avatars/3654017c010909d2fc506acfde622e33.svg","isPro":false,"fullname":"BaekSangWon","user":"swbaek","type":"user"},{"_id":"5f1eb362eec0ad2a071ad6e2","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5f1eb362eec0ad2a071ad6e2/IXMYkYKuTwn6kBdWnQeeY.png","isPro":false,"fullname":"Niklas Muennighoff","user":"Muennighoff","type":"user"},{"_id":"645992c138d95f3427a4c8bf","avatarUrl":"/avatars/dea23d6c77bcc13ff9d17ce07e5ec009.svg","isPro":false,"fullname":"Guijin Son","user":"GSON-backup","type":"user"},{"_id":"6469949654873f0043b09c22","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6469949654873f0043b09c22/Lk7IJAR16Wa_sGJ2g81AQ.jpeg","isPro":true,"fullname":"Seungone Kim","user":"seungone","type":"user"},{"_id":"63c3e898c7d7f4c63a51594a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1673783426328-noauth.png","isPro":false,"fullname":"Suzie Oh","user":"ohsuz","type":"user"},{"_id":"650c0029987b1ae4e51fa2d4","avatarUrl":"/avatars/2bc642851c6c3af100cd7ce10cb9b9e4.svg","isPro":false,"fullname":"OneLineAI","user":"OLAResearch","type":"user"},{"_id":"66120647cac232c1507e13da","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/66120647cac232c1507e13da/iOBrsyr2mVdVLAFF6pZt6.png","isPro":false,"fullname":"DasolChoi","user":"Dasool","type":"user"},{"_id":"6486825d702854dc05da9ed4","avatarUrl":"/avatars/b4c7de3bc50a4c6e5372f64bd9ee7345.svg","isPro":false,"fullname":"Ilgyun Jeong","user":"johnny9210","type":"user"},{"_id":"63e087b6a98d931aa90c1b9c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63e087b6a98d931aa90c1b9c/4ZnfL0U8rrj3cNhj7WTgo.jpeg","isPro":false,"fullname":"Hyunwoo Ko","user":"Cartinoe5930","type":"user"},{"_id":"64d9b94f99eb22b8da8192ce","avatarUrl":"/avatars/bada31d98fb5cc27a321c6cc1acf6afa.svg","isPro":false,"fullname":"kim ye won","user":"cong1230","type":"user"},{"_id":"662c3305982b04e6a0b354b4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/662c3305982b04e6a0b354b4/QIcRfgGIefBVj9COuWEFu.jpeg","isPro":false,"fullname":"Seunghyeok Hong","user":"shongdr","type":"user"},{"_id":"664ab123f7e9d961cf598157","avatarUrl":"/avatars/c9d7e1b230f14c1158bc8ff6b917edac.svg","isPro":false,"fullname":"Minhyuk Kim","user":"torchtorchkimtorch","type":"user"},{"_id":"64fac8a88d50404bc4ec66d4","avatarUrl":"/avatars/c424a0ef2187457e563c697cd9355a9e.svg","isPro":false,"fullname":"kim","user":"ksyint","type":"user"},{"_id":"67e7779fb13aed34b4b200a9","avatarUrl":"/avatars/c7142eba473fd5fe9e4f5a1b6a838ed3.svg","isPro":false,"fullname":"NAHYUN LEE","user":"2nhyn","type":"user"},{"_id":"681c6fea822d05bba755e9f7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/2mwDT1arCa2_V-xJ0GVLp.png","isPro":false,"fullname":"우영서","user":"miwha","type":"user"},{"_id":"640eff5af2d7c41a1e9ba9d4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/640eff5af2d7c41a1e9ba9d4/NcZga_7TbMOW4qhUrE7q1.jpeg","isPro":false,"fullname":"YOUNG SOOK SONG","user":"songys","type":"user"},{"_id":"6505379a850cfc46807e6905","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6505379a850cfc46807e6905/4Qi4b2SCjANlbx239S7c2.jpeg","isPro":false,"fullname":"Hyungho Byun","user":"NotoriousH2","type":"user"},{"_id":"60a387e1eb729661127edc83","avatarUrl":"/avatars/c188436ed9b3d17730841b23a58322d7.svg","isPro":false,"fullname":"Jungwhan Kim","user":"jungwhank","type":"user"},{"_id":"642b0c2fecec03b4464a1d9b","avatarUrl":"/avatars/76c794c7c17503ae9a0d5336395bd132.svg","isPro":false,"fullname":"KuKu","user":"dragonkue","type":"user"},{"_id":"63eba6674dcaaf0876391207","avatarUrl":"/avatars/b3027af926746f9f64c3bfbb7548f2c9.svg","isPro":false,"fullname":"ChanyoungKim","user":"cykim","type":"user"},{"_id":"67aa9e215716d8c0207eab19","avatarUrl":"/avatars/0484849011e3169051784317f3dc5a96.svg","isPro":false,"fullname":"Joonyong Park","user":"JoonYong-Park","type":"user"},{"_id":"665ec951b246e4e792ccf89d","avatarUrl":"/avatars/34043b930ab46426de22bce3e3eecbab.svg","isPro":false,"fullname":"kyubeenhan","user":"kyubeen","type":"user"},{"_id":"64268e6bf8868e1ac3517a5f","avatarUrl":"/avatars/d74118bea36d13aececfab02f53fff85.svg","isPro":false,"fullname":"SangdaeNam","user":"SangdaeNam","type":"user"}],"userCount":27,"collections":[],"datasets":[{"author":"HAERAE-HUB","downloads":2,"gated":false,"id":"HAERAE-HUB/KMMMU","lastModified":"2026-02-20T04:17:17.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":4387,"libraries":["datasets","mlcroissant"],"formats":["imagefolder"],"modalities":["image"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":40,"gated":false,"id":"HAERAE-HUB/Ko-PIQA","lastModified":"2026-01-13T10:43:53.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":441,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["csv"],"modalities":["tabular","text"]},"private":false,"repoType":"dataset","likes":3,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":71,"gated":false,"id":"HAERAE-HUB/HAERAE-VISION","lastModified":"2026-01-13T01:31:41.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":165,"libraries":["datasets","pandas","polars","mlcroissant"],"formats":["parquet","optimized-parquet"],"modalities":["image","text"]},"private":false,"repoType":"dataset","likes":11,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":1672,"gated":false,"id":"HAERAE-HUB/KoSimpleEval","lastModified":"2025-10-12T16:05:19.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":122690,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["csv"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":813,"gated":false,"id":"HAERAE-HUB/HRM8K","lastModified":"2025-02-14T06:36:41.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":8011,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["csv"],"modalities":["tabular","text"]},"private":false,"repoType":"dataset","likes":23,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":23,"gated":false,"id":"HAERAE-HUB/butterflies_and_moths_vqa","lastModified":"2025-01-21T06:17:31.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":400,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["parquet"],"modalities":["image","text"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":9,"gated":false,"id":"HAERAE-HUB/hret_agent_idavidrein_gpqa_diamond_translated","lastModified":"2025-01-20T08:08:29.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":5,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["parquet"],"modalities":["tabular","text"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":29,"gated":false,"id":"HAERAE-HUB/HRMCR","lastModified":"2025-01-13T06:56:14.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":100,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["csv"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":3,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":13,"gated":false,"id":"HAERAE-HUB/KHJ-RB-Format","lastModified":"2024-09-30T07:59:53.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":524,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["parquet"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":5,"isLikedByUser":false,"isBenchmark":false},{"author":"HAERAE-HUB","downloads":30,"gated":false,"id":"HAERAE-HUB/KUDGE","lastModified":"2024-09-20T04:16:55.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":6312,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["csv"],"modalities":["tabular","text"]},"private":false,"repoType":"dataset","likes":7,"isLikedByUser":false,"isBenchmark":false}],"models":[],"paperPreviews":[{"id":"2601.06165","title":"What Users Leave Unsaid: Under-Specified Queries Limit Vision-Language Models","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2601.06165.png"}],"spaces":[{"author":"HAERAE-HUB","authorData":{"_id":"645ae5e85e6871b4b2d6bd80","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60d3e619b8448e1785bbda2a/zasfyk1U_yRBgrluB6ggc.png","fullname":"HAE-RAE","name":"HAERAE-HUB","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":142,"isUserFollowing":false},"colorFrom":"yellow","colorTo":"pink","createdAt":"2024-07-19T05:23:38.000Z","emoji":"📉","id":"HAERAE-HUB/Open-Research-Questions","lastModified":"2024-07-19T05:47:39.000Z","likes":0,"pinned":false,"private":false,"sdk":"streamlit","repoType":"space","runtime":{"stage":"SLEEPING","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"requested":1},"devMode":false,"domains":[{"domain":"haerae-hub-open-research-questions.hf.space","stage":"READY"}]},"title":"Open Research Questions","isLikedByUser":false,"ai_short_description":"Participate in HAERAE-Math Challenge","ai_category":"Text Analysis","trendingScore":0,"tags":["streamlit","region:us"],"featured":false}],"buckets":[],"numBuckets":0,"numDatasets":25,"numModels":0,"numSpaces":2,"lastOrgActivities":[{"time":"2026-02-20T04:17:17.475Z","user":"2nhyn","userAvatarUrl":"/avatars/c7142eba473fd5fe9e4f5a1b6a838ed3.svg","orgAvatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60d3e619b8448e1785bbda2a/zasfyk1U_yRBgrluB6ggc.png","type":"update","repoData":{"author":"HAERAE-HUB","downloads":2,"gated":false,"id":"HAERAE-HUB/KMMMU","lastModified":"2026-02-20T04:17:17.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":4387,"libraries":["datasets","mlcroissant"],"formats":["imagefolder"],"modalities":["image"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false,"isBenchmark":false},"repoId":"HAERAE-HUB/KMMMU","repoType":"dataset","org":"HAERAE-HUB"},{"time":"2026-02-10T09:07:36.544Z","user":"Cartinoe5930","userAvatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63e087b6a98d931aa90c1b9c/4ZnfL0U8rrj3cNhj7WTgo.jpeg","type":"paper","paper":{"id":"2602.06291","title":"Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Math","publishedAt":"2026-02-06T01:10:28.000Z","upvotes":23,"isUpvotedByUser":true}},{"time":"2026-02-09T04:38:27.398Z","user":"amphora","userAvatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60d3e619b8448e1785bbda2a/q2re5u1HNwsCCyIMtid_I.jpeg","type":"paper-daily","paper":{"id":"2602.06291","title":"Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Math","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2602.06291.png","upvotes":23,"publishedAt":"2026-02-06T01:10:28.000Z","isUpvotedByUser":true}}],"acceptLanguages":["*"],"canReadRepos":false,"canReadSpaces":false,"blogPosts":[],"currentRepoPage":0,"filters":{},"orgPapers":[{"paper":{"id":"2601.06165","upvotes":16,"authors":[],"githubStars":15},"title":"What Users Leave Unsaid: Under-Specified Queries Limit Vision-Language Models","publishedAt":"2026-01-06T21:33:03.000Z","thumbnail":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2601.06165.png","numComments":3,"upvoted":false,"submittedBy":{"avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/66120647cac232c1507e13da/iOBrsyr2mVdVLAFF6pZt6.png","name":"DasolChoi"},"organization":{"_id":"645ae5e85e6871b4b2d6bd80","name":"HAERAE-HUB","fullname":"HAE-RAE","avatar":"https://cdn-uploads.huggingface.co/production/uploads/60d3e619b8448e1785bbda2a/zasfyk1U_yRBgrluB6ggc.png"},"isAuthorParticipating":true}],"paperView":true}">