Resources for Measure what Matters: Psychometric Evaluation of AI with Situational Judgment Tests)(https://arxiv.org/abs/2510.22170)
AI & ML interests
We work with you to develop a high impact AI strategy for your industry, refine your data foundations and design meaningful human-AI interactions. We also empower you to develop, integrate and test the latest AI technologies responsibly.
Recent Activity
View all activity
models 17
thoughtworks/coding-sorl
4B • Updated • 18
thoughtworks/arithmetic-sorl
Updated • 2
thoughtworks/Qwen3-Coder-Next-Eagle3
Text Generation • 0.1B • Updated • 40 • 1
thoughtworks/GLM-4.7-FP8-Eagle3
Text Generation • 0.6B • Updated • 12 • 1
thoughtworks/MiniMax-M2.5-Eagle3
Text Generation • 0.2B • Updated • 1.8k • 7
thoughtworks/GLM-4.7-Flash-Eagle3
Text Generation • 0.1B • Updated • 43 • 2
thoughtworks/Gemma-4-31B-Eagle3
Text Generation • 0.6B • Updated • 60 • 5
thoughtworks/arithmetic-sorl-saes
Updated
thoughtworks/DeepSeek-R1-Distill-Qwen-14B-Eagle3
Text Generation • 0.6B • Updated • 12
thoughtworks/DeepSeek-R1-Distill-Qwen-7B-Eagle3
Text Generation • 0.4B • Updated • 8
datasets 14
thoughtworks/document-processing-benchmark
Viewer • Updated • 15.7k • 130
thoughtworks/CulturalCounterfactuals
Viewer • Updated • 7.5k • 792
thoughtworks/psychometric_personas_responses
Viewer • Updated • 6.85M • 2.53k
thoughtworks/agentic-coding-trajectories
Viewer • Updated • 15k • 234
thoughtworks/psychometric_personas
Viewer • Updated • 23.9k • 243
thoughtworks/gemma_psychometrics_personas_responses
Viewer • Updated • 5.59M • 2.33k • 1
thoughtworks/ablation_psychometrics_personas
Viewer • Updated • 500 • 215
thoughtworks/psychometric_human_annotations
Viewer • Updated • 55 • 27
thoughtworks/parliamentary_personas
Viewer • Updated • 2.2k • 177
thoughtworks/psychometric_SJTs
Viewer • Updated • 4k • 35