Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
opencompass (OpenCompass)
[go: Go Back, main page]

\n
 
\n
\n OpenCompass Website\n \n \n HOT\n \n \n     \n OpenCompass Toolkit\n \n \n TRY IT OUT\n \n \n
\n
 
\n
\n\n

\n 👋 join us on Discord and WeChat\n

\n

\n follow us on Github\n

\n\nOpenCompass is a platform focused on evaluation of AGI, include Large Language Model and Multi-modality Model. We aim to:\n\n- develop high-quality libraries to reduce the difficulties in evaluation\n- provide convincing leaderboards for improving the understanding of the large models\n- create powerful toolchains targeting a variety of abilities and tasks\n- build solid benchmarks to support the large model research\n\n\n","html":"
\n \n
 
\n
\n OpenCompass Website\n \n \n HOT\n \n \n     \n OpenCompass Toolkit\n \n \n TRY IT OUT\n \n \n
\n
 
\n
\n\n

\n 👋 join us on Discord and WeChat\n

\n

\n follow us on Github\n

\n\n

OpenCompass is a platform focused on evaluation of AGI, include Large Language Model and Multi-modality Model. We aim to:

\n\n","classNames":"hf-sanitized hf-sanitized-Y6FrhLNi5dofenN4JASkL"},"users":[{"_id":"630716d11801ecc7d2595021","avatarUrl":"/avatars/2d36a880ce4a3cf7efc5ff3987dbeaf3.svg","isPro":false,"fullname":"Songyang Zhang","user":"zsytony","type":"user"},{"_id":"640d3eaa3623f6a56dde856d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1678589663024-640d3eaa3623f6a56dde856d.jpeg","isPro":true,"fullname":"vansin","user":"vansin","type":"user"},{"_id":"64ca6a3be3cc4a476d478c4d","avatarUrl":"/avatars/e6c4a8851993035e76deae6d07fd3cfb.svg","isPro":false,"fullname":"Na","user":"A3331","type":"user"},{"_id":"63ee1379190ddd6214efd73a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1676546883247-noauth.png","isPro":false,"fullname":"HAODONG DUAN","user":"KennyUTC","type":"user"},{"_id":"627ca439a09edfe62239c671","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1652335660508-noauth.jpeg","isPro":false,"fullname":"Tian Lan","user":"GMFTBY","type":"user"},{"_id":"64e8505321540e1da3226b54","avatarUrl":"/avatars/18958b8406d1ce492b54c1c839f18c54.svg","isPro":false,"fullname":"Wenwei Zhang","user":"ZwwWayne","type":"user"},{"_id":"6601196cc91ba4c08ad6e270","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6601196cc91ba4c08ad6e270/venywO3WPi2fNi5WUJTH0.jpeg","isPro":false,"fullname":"Yuzhe Gu","user":"vanilla1116","type":"user"},{"_id":"6432683407bad11484a68457","avatarUrl":"/avatars/ae7ac4d83ff45155e983b3671cc1792b.svg","isPro":false,"fullname":"gelina1001","user":"gelina1001","type":"user"},{"_id":"66961cac37b573b6007e6f49","avatarUrl":"/avatars/471304f051f66160c92a4049431a45a3.svg","isPro":false,"fullname":"zhang","user":"34siqi","type":"user"},{"_id":"6576fe2b42ab083faea19841","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/c91ZKOR2E0gL8iIVkvEUa.jpeg","isPro":false,"fullname":"Mo Li","user":"Mor-Li","type":"user"},{"_id":"64f5f8dd9b17cd59c453c57f","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64f5f8dd9b17cd59c453c57f/MulhwLcePFUWUQel8LQZ8.jpeg","isPro":false,"fullname":"Xinyu Fang","user":"nebulae09","type":"user"},{"_id":"614ffea450eec00bf3c23652","avatarUrl":"/avatars/0e89f66b16e16f016f0fb1663ead83f4.svg","isPro":false,"fullname":"lioushz","user":"Shz","type":"user"},{"_id":"63fc0d040aab060792003a68","avatarUrl":"/avatars/d573d4c4ec49513f3b157f7691becbdd.svg","isPro":false,"fullname":"Alexander Lam","user":"acylam","type":"user"},{"_id":"643d26979347842571bc9613","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/3heFf7h3jbhhJWJ4JfGfh.jpeg","isPro":false,"fullname":"Junnan Liu","user":"jnanliu","type":"user"},{"_id":"642e368f958faf258a40bde6","avatarUrl":"/avatars/dd8230607b62c3624d522308d677622c.svg","isPro":false,"fullname":"Xiao","user":"TracyMc","type":"user"},{"_id":"630da0fae57da204209411d3","avatarUrl":"/avatars/e79c250cf8031441ffd0e853e653cef6.svg","isPro":false,"fullname":"dongsheng zhu","user":"dongsheng","type":"user"},{"_id":"65b92c8d98d8720151544c32","avatarUrl":"/avatars/86a71da795ff0384d292c14dfa93ba57.svg","isPro":false,"fullname":"Zhou","user":"myhs","type":"user"},{"_id":"64c8835a4cc48498134364be","avatarUrl":"/avatars/a26120216483c6bf3b830c0cf9c4008e.svg","isPro":false,"fullname":"TaolinZhang","user":"iridescentttt","type":"user"},{"_id":"654ce87af0b05673196a9f45","avatarUrl":"/avatars/7b9c854eb98e487e3057479b1c7860ac.svg","isPro":false,"fullname":"Shudong Liu","user":"Sudanl","type":"user"},{"_id":"65e5250275019230a0074f33","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65e5250275019230a0074f33/pfDL_cfqEZIrPF908-ZNa.png","isPro":false,"fullname":"Yufeng Zhao","user":"epsilondylan","type":"user"},{"_id":"63859cf3b2906edaf83af9f0","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63859cf3b2906edaf83af9f0/kajwuVzd4pDucSPlwghxo.png","isPro":true,"fullname":"Yuhang Zang","user":"yuhangzang","type":"user"},{"_id":"634fb993685e43e02d2544a2","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/634fb993685e43e02d2544a2/L9MuXYlXMBuQgnwXd4lCU.jpeg","isPro":false,"fullname":"mzr1996","user":"mzr1996","type":"user"}],"userCount":22,"collections":[{"slug":"opencompass/opencompass-multi-modal-leaderboards-68747f03a00f3cac8e35a247","title":"OpenCompass Multi-Modal Leaderboards","description":"","gating":false,"lastUpdated":"2025-07-24T06:50:07.736Z","owner":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"items":[{"_id":"68747f2bacfcdbef025663dd","position":0,"type":"space","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"blue","colorTo":"green","createdAt":"2024-01-23T10:43:33.000Z","emoji":"🌎","id":"opencompass/open_vlm_leaderboard","lastModified":"2025-01-20T06:49:40.000Z","likes":992,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-upgrade","requested":"cpu-upgrade"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"opencompass-open-vlm-leaderboard.hf.space","stage":"READY"}],"sha":"c19604e023a7929f5eeaaa3c703eee122ba13ab5"},"shortDescription":"VLMEvalKit Evaluation Results Collection ","title":"Open VLM Leaderboard","isLikedByUser":false,"ai_short_description":"Explore and filter Open VLM model leaderboards interactively","ai_category":"Data Visualization","trendingScore":4,"tags":["gradio","leaderboard","region:us"],"featured":false},{"_id":"6875f3fdeab5441c45ffb18b","position":1,"type":"space","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"blue","colorTo":"green","createdAt":"2024-09-24T04:00:46.000Z","emoji":"🌎","id":"opencompass/openvlm_video_leaderboard","lastModified":"2024-11-21T13:35:06.000Z","likes":130,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-basic","requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"opencompass-openvlm-video-leaderboard.hf.space","stage":"READY"}],"sha":"62c094e2005080b561106962793333b149026dc0"},"shortDescription":"VLMEvalKit Eval Results in video understanding benchmark","title":"Open VLM Video Leaderboard","isLikedByUser":false,"ai_short_description":"Explore video leaderboard results","ai_category":"Video Generation","trendingScore":0,"tags":["gradio","leaderboard","region:us"],"featured":true},{"_id":"68747f34ae1aa753c7b95b19","position":2,"type":"space","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"green","colorTo":"indigo","createdAt":"2024-12-17T03:53:58.000Z","emoji":"🥇","id":"opencompass/Open_LMM_Reasoning_Leaderboard","lastModified":"2025-03-31T08:15:16.000Z","likes":44,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-basic","requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"opencompass-open-lmm-reasoning-leaderboard.hf.space","stage":"READY"}],"sha":"407559ce38d6daf71a410750a6c29ae6eeb20b65"},"shortDescription":"A Leaderboard that demonstrates LMM reasoning capabilities","title":"Open LMM Reasoning Leaderboard","isLikedByUser":false,"ai_short_description":"Explore and filter math model leaderboards","ai_category":"Data Visualization","trendingScore":0,"tags":["gradio","leaderboard","region:us"],"featured":false},{"_id":"68747f43fbb475d45561904c","position":3,"type":"space","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"blue","colorTo":"yellow","createdAt":"2023-09-18T01:53:59.000Z","emoji":"🚀","id":"opencompass/MMBench","lastModified":"2025-01-06T03:18:10.000Z","likes":24,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"PAUSED","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":86400,"replicas":{"requested":1},"devMode":false,"domains":[{"domain":"opencompass-mmbench.hf.space","stage":"READY"}]},"title":"MMBench Leaderboard","isLikedByUser":false,"ai_short_description":"Explore MMBench Leaderboard data","ai_category":"Data Visualization","trendingScore":0,"tags":["gradio","leaderboard","region:us"],"featured":false}],"position":1,"theme":"green","private":false,"shareUrl":"https://hf.co/collections/opencompass/opencompass-multi-modal-leaderboards","upvotes":4,"isUpvotedByUser":false},{"slug":"opencompass/compassverifier-686e5a25e8672e603b17c666","title":"CompassVerifier","description":"CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward","gating":false,"lastUpdated":"2025-08-31T07:55:34.264Z","owner":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"items":[{"_id":"686e5a616d3e96f540a80abf","position":0,"type":"model","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":988,"gated":false,"id":"opencompass/CompassVerifier-3B","availableInferenceProviders":[],"lastModified":"2026-01-04T06:26:02.000Z","likes":7,"private":false,"repoType":"model","isLikedByUser":false,"numParameters":3397103616},{"_id":"686e5a6e6327a535fa030cfb","position":1,"type":"model","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":1176,"gated":false,"id":"opencompass/CompassVerifier-7B","availableInferenceProviders":[],"lastModified":"2025-11-26T13:24:42.000Z","likes":4,"private":false,"repoType":"model","isLikedByUser":false,"numParameters":7615616512},{"_id":"686e5a69d9f6088aadccac9c","position":2,"type":"model","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":2,"gated":false,"id":"opencompass/CompassVerifier-32B","availableInferenceProviders":[],"lastModified":"2026-01-04T06:25:08.000Z","likes":7,"private":false,"repoType":"model","isLikedByUser":false,"numParameters":32763876352},{"_id":"6870a67c9f681293651b2f17","position":3,"type":"dataset","author":"opencompass","downloads":95,"gated":false,"id":"opencompass/VerifierBench","lastModified":"2025-08-26T18:35:12.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":2817,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":4,"isLikedByUser":false,"isBenchmark":false}],"position":2,"theme":"indigo","private":false,"shareUrl":"https://hf.co/collections/opencompass/compassverifier","upvotes":7,"isUpvotedByUser":false},{"slug":"opencompass/compassjudger-670819df1685f619ea559684","title":"CompassJudger","description":"","gating":false,"lastUpdated":"2025-07-24T06:50:07.737Z","owner":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"items":[{"_id":"67081ca70450ae1fe4df52dd","position":0,"type":"model","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":51,"gated":false,"id":"opencompass/CompassJudger-1-32B-Instruct","availableInferenceProviders":[],"lastModified":"2024-10-30T12:40:57.000Z","likes":18,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":32763876352},{"_id":"670f6edaa6d52274580c0b09","position":1,"type":"model","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":4,"gated":false,"id":"opencompass/CompassJudger-1-14B-Instruct","availableInferenceProviders":[],"lastModified":"2024-10-30T12:41:34.000Z","likes":2,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":14770033664},{"_id":"670819ed0703a28813f1eb5d","position":2,"type":"model","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":11,"gated":false,"id":"opencompass/CompassJudger-1-7B-Instruct","availableInferenceProviders":[],"lastModified":"2024-10-22T08:52:12.000Z","likes":10,"private":false,"repoType":"model","isLikedByUser":false},{"_id":"670f6ee3d21cac9366bc5c34","position":3,"type":"model","author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":3,"gated":false,"id":"opencompass/CompassJudger-1-1.5B-Instruct","availableInferenceProviders":[],"lastModified":"2024-10-22T08:52:44.000Z","likes":1,"private":false,"repoType":"model","isLikedByUser":false,"numParameters":1777088000}],"position":4,"theme":"blue","private":false,"shareUrl":"https://hf.co/collections/opencompass/compassjudger","upvotes":8,"isUpvotedByUser":false}],"datasets":[{"author":"opencompass","downloads":117,"gated":false,"id":"opencompass/ATLAS","lastModified":"2025-11-20T03:40:13.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":798,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":15474,"gated":false,"id":"opencompass/NeedleBench","lastModified":"2025-09-01T15:28:58.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":6804,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":5,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":73,"gated":false,"id":"opencompass/ReasonZoo","lastModified":"2025-08-27T12:31:13.000Z","private":false,"repoType":"dataset","likes":0,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":95,"gated":false,"id":"opencompass/VerifierBench","lastModified":"2025-08-26T18:35:12.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":2817,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":4,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":214,"gated":"auto","id":"opencompass/LiveMathBench","lastModified":"2025-08-05T03:15:15.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":483,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":10,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":360,"gated":false,"id":"opencompass/CodeForce_SAGA","lastModified":"2025-08-01T08:03:46.000Z","datasetsServerInfo":{"viewer":"viewer-partial","numRows":5570,"libraries":["datasets","dask","mlcroissant","polars"],"formats":["parquet"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":1,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":276,"gated":false,"id":"opencompass/CodeCompass","lastModified":"2025-08-01T08:03:18.000Z","private":false,"repoType":"dataset","likes":1,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":4,"gated":"auto","id":"opencompass/compass_academic_predictions","lastModified":"2025-04-07T06:49:38.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":4423228,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":0,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":139,"gated":false,"id":"opencompass/Creation-MMBench","lastModified":"2025-03-19T11:44:29.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":765,"libraries":["datasets","pandas","mlcroissant","polars"],"formats":["parquet"],"modalities":["image","text"]},"private":false,"repoType":"dataset","likes":3,"isLikedByUser":false,"isBenchmark":false},{"author":"opencompass","downloads":47,"gated":false,"id":"opencompass/anah","lastModified":"2025-03-13T06:40:34.000Z","datasetsServerInfo":{"viewer":"viewer","numRows":783,"libraries":["datasets","dask","mlcroissant"],"formats":["json"],"modalities":["text"]},"private":false,"repoType":"dataset","likes":4,"isLikedByUser":false,"isBenchmark":false}],"models":[{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":988,"gated":false,"id":"opencompass/CompassVerifier-3B","availableInferenceProviders":[],"lastModified":"2026-01-04T06:26:02.000Z","likes":7,"private":false,"repoType":"model","isLikedByUser":false,"numParameters":3397103616},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":2,"gated":false,"id":"opencompass/CompassVerifier-32B","availableInferenceProviders":[],"lastModified":"2026-01-04T06:25:08.000Z","likes":7,"private":false,"repoType":"model","isLikedByUser":false,"numParameters":32763876352},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":1176,"gated":false,"id":"opencompass/CompassVerifier-7B","availableInferenceProviders":[],"lastModified":"2025-11-26T13:24:42.000Z","likes":4,"private":false,"repoType":"model","isLikedByUser":false,"numParameters":7615616512},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":56,"gated":false,"id":"opencompass/CompassJudger-2-7B-Instruct","availableInferenceProviders":[],"lastModified":"2025-07-22T07:42:38.000Z","likes":3,"pipeline_tag":"text-ranking","private":false,"repoType":"model","isLikedByUser":false,"numParameters":7615616512},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":496,"gated":false,"id":"opencompass/CompassJudger-2-32B-Instruct","availableInferenceProviders":[],"lastModified":"2025-07-22T07:42:17.000Z","likes":3,"pipeline_tag":"text-ranking","private":false,"repoType":"model","isLikedByUser":false,"numParameters":32763876352},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":2,"gated":false,"id":"opencompass/anah-7b","availableInferenceProviders":[],"lastModified":"2025-03-08T12:54:28.000Z","likes":0,"pipeline_tag":"text-classification","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":7737708544},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":1,"gated":false,"id":"opencompass/anah-20b","availableInferenceProviders":[],"lastModified":"2025-03-08T12:54:09.000Z","likes":0,"pipeline_tag":"text-classification","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":19861149696},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":4,"gated":false,"id":"opencompass/anah-v2","availableInferenceProviders":[],"lastModified":"2025-03-08T12:53:47.000Z","likes":4,"pipeline_tag":"text-classification","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":7737708544},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":4,"gated":false,"id":"opencompass/CompassJudger-1-14B-Instruct","availableInferenceProviders":[],"lastModified":"2024-10-30T12:41:34.000Z","likes":2,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":14770033664},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"downloads":51,"gated":false,"id":"opencompass/CompassJudger-1-32B-Instruct","availableInferenceProviders":[],"lastModified":"2024-10-30T12:40:57.000Z","likes":18,"pipeline_tag":"text-generation","private":false,"repoType":"model","isLikedByUser":false,"widgetOutputUrls":[],"numParameters":32763876352}],"paperPreviews":[{"_id":"2508.03686","title":"CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and\n Outcome Reward","id":"2508.03686","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2508.03686.png"},{"_id":"2503.14478","title":"Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLM","id":"2503.14478","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2503.14478.png"}],"spaces":[{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"green","colorTo":"indigo","createdAt":"2025-11-19T06:23:51.000Z","emoji":"🧪","id":"opencompass/ATLAS","lastModified":"2025-11-20T07:11:54.000Z","likes":3,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"SLEEPING","hardware":{"current":null,"requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"requested":1},"devMode":false,"domains":[{"domain":"opencompass-atlas-leaderboard.hf.space","stage":"READY"},{"domain":"opencompass-atlas.hf.space","stage":"READY"}]},"shortDescription":"ATLAS for Frontier Scientific Benchmark","title":"ATLAS Benchmark","isLikedByUser":false,"ai_short_description":"Submit ATLAS results and track leaderboard","ai_category":"Model Benchmarking","trendingScore":0,"tags":["gradio","leaderboard","science","benchmark","evaluation","region:us"],"featured":false},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"indigo","colorTo":"gray","createdAt":"2025-07-07T08:46:54.000Z","emoji":"👀","id":"opencompass/RISEBench_Gallery","lastModified":"2025-07-14T03:57:25.000Z","likes":28,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-upgrade","requested":"cpu-upgrade"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"opencompass-risebench-gallery.hf.space","stage":"READY"}],"sha":"25bf6d6a08a7d110de00aa28f8fea022db84c6fd"},"shortDescription":"A Gallery of Generation Results on RISEBench","title":"RISEBench Gallery","isLikedByUser":false,"ai_short_description":"Browse and compare RISEBench generation results","ai_category":"Image","trendingScore":0,"tags":["gradio","region:us"],"featured":false},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"blue","colorTo":"indigo","createdAt":"2025-06-28T09:16:43.000Z","emoji":"🥇","id":"opencompass/openlmm_spatial_leaderboard","lastModified":"2025-06-28T09:25:54.000Z","likes":6,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-basic","requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"opencompass-openlmm-spatial-leaderboard.hf.space","stage":"READY"}],"sha":"3fb19d617c1abbea226de140bab934bfbe9eaecd"},"shortDescription":"A Leaderboard for LMM spatial understanding capabilities","title":"Open LMM Spatial Leaderboard","isLikedByUser":false,"ai_short_description":"Explore and filter model leaderboard data","ai_category":"Data Visualization","trendingScore":0,"tags":["gradio","region:us"],"featured":false},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"blue","colorTo":"green","createdAt":"2025-04-30T13:13:53.000Z","emoji":"🌎","id":"opencompass/openlmm_subjective_leaderboard","lastModified":"2025-06-28T09:14:38.000Z","likes":26,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-basic","requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"opencompass-openvlm-subjective-leaderboard.hf.space","stage":"READY"},{"domain":"opencompass-openlmm-subjective-leaderboard.hf.space","stage":"READY"}],"sha":"ad4b3fc2f3ac0be2ac2f9bdb3721972679a0eb52"},"shortDescription":"VLMEvalKit Subjectivce Benchmark Results","title":"Open LMM Subjective Leaderboard","isLikedByUser":false,"ai_short_description":"Explore and filter OpenVLM leaderboard data","ai_category":"Data Visualization","trendingScore":0,"tags":["gradio","leaderboard","region:us"],"featured":false},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"blue","colorTo":"pink","createdAt":"2025-03-27T03:58:12.000Z","emoji":"🦀","id":"opencompass/CompassAcademic-Leaderboard-Full-Version","lastModified":"2025-04-17T07:53:59.000Z","likes":3,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-basic","requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"opencompass-compassacademic-leaderboard-full-version.hf.space","stage":"READY"}],"sha":"73af091f28193d1e3e232851b940cadbb856556e"},"shortDescription":"Compass Academic Leaderboard Full Version","title":"CompassAcademic Leaderboard Full Version","isLikedByUser":false,"originRepo":{"name":"demo-leaderboard-backend/leaderboard","author":{"_id":"655dbd8360009b03e4451217","avatarUrl":"https://www.gravatar.com/avatar/48236a8e5b71950f0708b3f2e3e7925f?d=retro&size=100","fullname":"Demo leaderboard with an integrated backend","name":"demo-leaderboard-backend","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":22,"isUserFollowing":false}},"ai_short_description":"Explore and filter model predictions on academic datasets","ai_category":"Data Visualization","trendingScore":0,"tags":["gradio","region:us"],"featured":false},{"author":"opencompass","authorData":{"_id":"64ef24837b31b8cf66b2e911","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/630716d11801ecc7d2595021/OP8C6Z5-G7p6E33wZJm33.png","fullname":"OpenCompass","name":"opencompass","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":180,"isUserFollowing":false},"colorFrom":"green","colorTo":"indigo","createdAt":"2024-12-17T03:53:58.000Z","emoji":"🥇","id":"opencompass/Open_LMM_Reasoning_Leaderboard","lastModified":"2025-03-31T08:15:16.000Z","likes":44,"pinned":true,"private":false,"sdk":"gradio","repoType":"space","runtime":{"stage":"RUNNING","hardware":{"current":"cpu-basic","requested":"cpu-basic"},"storage":null,"gcTimeout":172800,"replicas":{"current":1,"requested":1},"devMode":false,"domains":[{"domain":"opencompass-open-lmm-reasoning-leaderboard.hf.space","stage":"READY"}],"sha":"407559ce38d6daf71a410750a6c29ae6eeb20b65"},"shortDescription":"A Leaderboard that demonstrates LMM reasoning capabilities","title":"Open LMM Reasoning Leaderboard","isLikedByUser":false,"originRepo":{"name":"demo-leaderboard-backend/leaderboard","author":{"_id":"655dbd8360009b03e4451217","avatarUrl":"https://www.gravatar.com/avatar/48236a8e5b71950f0708b3f2e3e7925f?d=retro&size=100","fullname":"Demo leaderboard with an integrated backend","name":"demo-leaderboard-backend","type":"org","isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":22,"isUserFollowing":false}},"ai_short_description":"Explore and filter math model leaderboards","ai_category":"Data Visualization","trendingScore":0,"tags":["gradio","leaderboard","region:us"],"featured":false}],"buckets":[],"numBuckets":0,"numDatasets":16,"numModels":13,"numSpaces":18,"lastOrgActivities":[{"time":"2026-02-12T13:28:18.474Z","user":"GMFTBY","userAvatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1652335660508-noauth.jpeg","type":"paper","paper":{"id":"2602.10652","title":"UMEM: Unified Memory Extraction and Management Framework for Generalizable Memory","publishedAt":"2026-02-11T08:58:41.000Z","upvotes":2,"isUpvotedByUser":true}},{"time":"2026-02-12T03:46:05.128Z","user":"GMFTBY","userAvatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1652335660508-noauth.jpeg","type":"paper-daily","paper":{"id":"2602.10652","title":"UMEM: Unified Memory Extraction and Management Framework for Generalizable Memory","thumbnailUrl":"https://cdn-thumbnails.huggingface.co/social-thumbnails/papers/2602.10652.png","upvotes":2,"publishedAt":"2026-02-11T08:58:41.000Z","isUpvotedByUser":true}},{"time":"2026-02-09T14:31:30.194Z","user":"GMFTBY","userAvatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1652335660508-noauth.jpeg","type":"paper","paper":{"id":"2602.06724","title":"Table-as-Search: Formulate Long-Horizon Agentic Information Seeking as Table Completion","publishedAt":"2026-02-06T14:18:26.000Z","upvotes":2,"isUpvotedByUser":true}}],"acceptLanguages":["*"],"canReadRepos":false,"canReadSpaces":false,"blogPosts":[],"currentRepoPage":0,"filters":{},"paperView":false}">

AI & ML interests

None defined yet.

Recent Activity

 
OpenCompass Website HOT      OpenCompass Toolkit TRY IT OUT
 

👋 join us on Discord and WeChat

follow us on Github

OpenCompass is a platform focused on evaluation of AGI, include Large Language Model and Multi-modality Model. We aim to:

  • develop high-quality libraries to reduce the difficulties in evaluation
  • provide convincing leaderboards for improving the understanding of the large models
  • create powerful toolchains targeting a variety of abilities and tasks
  • build solid benchmarks to support the large model research