Skip to main content

Last updated: November 12, 2026

DataBench

A frontier benchmark for complex data work and analytical reasoning

arrow-right-mediumLearn more about DataBench

DataBench score

Pareto frontier is the best possible score for a given metric. It is the line that connects the highest scores for each metric.
DataBench score by average cost per task
ModelAverage cost per taskDataBench score
GPT-5.6 Luna XHigh$0.0435.3%
GPT-5.6 Luna High$0.0331.3%
GPT-5.6 Luna Medium$0.0224%
GPT-5.6 Luna Low$0.0119%
GPT-5.6 Terra XHigh$0.3039.3%
GPT-5.6 Terra High$0.2032.7%
GPT-5.6 Terra Medium$0.1529.3%
GPT-5.6 Terra Low$0.1427%
GPT-5.6 Sol XHigh$0.9840.3%
GPT-5.6 Sol High$0.7538%
GPT-5.6 Sol Medium$0.6139.7%
GPT-5.6 Sol Low$0.3729.7%
GPT-6 Astra Max$2.1155%
GPT-6 Astra XHigh$1.7552.3%
GPT-6 Astra High$1.6252%
GPT-6 Astra Medium$1.2452.7%
GPT-6 Astra Low$0.8555%
Sonnet 5 Max$1.0712.3%
Sonnet 5 XHigh$0.6214.3%
Sonnet 5 High$0.4913.7%
Sonnet 5 Medium$0.3613.3%
Sonnet 5 Low$0.2611.7%
Opus 4.8 Max$1.7815%
Opus 4.8 XHigh$1.2018.7%
Opus 4.8 High$0.8614%
Opus 4.8 Medium$0.7617%
Opus 4.8 Low$0.6012%
Opus 5 Max$2.1119.7%
Opus 5 XHigh$1.8917.3%
Opus 5 High$1.6118%
Opus 5 Medium$1.1017%
Opus 5 Low$0.7415.7%
Fable 5 Max$3.4918%
Fable 5 High$1.8816%
Fable 5 Medium$1.5014.7%
Fable 5 Low$1.1415%
Fable 5.1 Max$3.3627%
Fable 5.1 XHigh$2.5021.7%
Fable 5.1 High$1.5720.3%
Fable 5.1 Medium$1.1821%
Fable 5.1 Low$0.9216.3%
GLM 5.3 Max$0.6416.3%
GLM 5.3 High$0.3614.7%
GLM 5.3 Low$0.208.7%
GLM 5.2 Max$0.329%
GLM 5.2 High$0.2513.3%
Kimi K2.7 Medium$0.2812.7%
Opus 5.5 Max$3.5770.5%
Opus 5.5 XHigh$2.1667%
Opus 5.5 High$1.2565%
Opus 5.5 Medium$0.9762.5%
Opus 5.5 Low$0.6154%
GPT-6 Luna Max$0.0652.3%
GPT-6 Luna XHigh$0.0446%
GPT-6 Luna High$0.0346%
GPT-6 Luna Medium$0.0242.7%
GPT-6 Luna Low$0.0130.3%
GPT-6 Sol Max$0.9857%
GPT-6 Sol XHigh$0.5861.3%
GPT-6 Sol High$0.3954.7%
GPT-6 Sol Medium$0.2751.3%
GPT-6 Sol Low$0.1750.3%
GPT-6.1 Sol Max$0.5057%
GPT-6.1 Sol XHigh$0.4455%
GPT-6.1 Sol High$0.3855%
GPT-6.1 Sol Medium$0.2558%
GPT-6.1 Sol Low$0.2148%
Claude Haiku 5.5 High$0.0628%
Claude Haiku 5.5 Medium$0.0328%
Claude Haiku 5.5 Low$0.0223%
GPT-6.1 Terra Max$0.4549%
GPT-6.1 Terra XHigh$0.2750%
GPT-6.1 Terra High$0.1951%
GPT-6.1 Terra Medium$0.1544%
GPT-6.1 Terra Low$0.1046%
Sonnet 5.5 Medium$0.1922%
Grok 4.6 XHigh$0.9628%
Grok 4.6 High$0.9327%
Grok 4.6 Medium$0.9726%
Grok 4.6 Low$0.9427%
Kimi K3.1 Pro Max$0.4948%
Kimi K3.1 Pro High$0.3341%
Kimi K3.1 Pro Low$0.2329%
DeepSeek V4.1 Max$0.0813%
DeepSeek V4.1 High$0.0711%
DeepSeek V4.1 Low$0.0511%

Average cost per task

OpenAI
Anthropic
Z.ai
DeepSeek
xAI
Moonshot
  • Low Effort
  • Medium Effort
  • High Effort
  • XHigh Effort
  • Max Effort

Example tasks

Each is evaluated against a rubric measuring analytical reasoning, tool use, evidence quality, and the final recommendation.

1Opus 5.5 · Max70.5%$3.57115.1K677.2s
2Opus 5.5 · XHigh67.0%$2.1662.8K387.6s
3Opus 5.5 · High65.0%$1.2530.5K220.1s
4Opus 5.5 · Medium62.5%$0.9722.5K169.6s
5GPT-6 Sol · XHigh61.3%$0.5814.6K326.7s
6GPT-6.1 Sol · Medium58.0%$0.254.3K109.5s
7GPT-6 Sol · Max57.0%$0.9829.9K617.5s
8GPT-6.1 Sol · Max57.0%$0.5016.3K365s
9GPT-6 Astra · Low55.0%$0.852.7K88.5s
10GPT-6 Astra · Max55.0%$2.1114.8K313.9s
11GPT-6.1 Sol · High55.0%$0.387.7K180.7s
12GPT-6.1 Sol · XHigh55.0%$0.4410K259.4s
13GPT-6 Sol · High54.7%$0.398.5K238s
14Opus 5.5 · Low54.0%$0.6113K110.8s
15GPT-6 Astra · Medium52.7%$1.244.9K128.3s
16GPT-6 Astra · XHigh52.3%$1.759.3K224.3s
17GPT-6 Luna · Max52.3%$0.0637.9K353.2s
18GPT-6 Astra · High52.0%$1.627.7K186.5s
19GPT-6 Sol · Medium51.3%$0.274.8K146.2s
20GPT-6.1 Terra · High51.0%$0.1913.3K264.5s
21GPT-6 Sol · Low50.3%$0.172.8K97.6s
22GPT-6.1 Terra · XHigh50.0%$0.2719.3K326.9s
23GPT-6.1 Terra · Max49.0%$0.4535.5K467.2s
24GPT-6.1 Sol · Low48.0%$0.213.1K80.5s
25Kimi K3.1 Pro · Max48.0%$0.4920.7K183.2s
26GPT-6 Luna · High46.0%$0.0315.5K175.4s
27GPT-6 Luna · XHigh46.0%$0.0419.3K188.7s
28GPT-6.1 Terra · Low46.0%$0.107.7K162.8s
29GPT-6.1 Terra · Medium44.0%$0.1510.7K222.4s
30GPT-6 Luna · Medium42.7%$0.029.1K116.6s
31Kimi K3.1 Pro · High41.0%$0.3313K110.5s
32GPT-5.6 Sol · XHigh40.3%$0.9811.4K210.2s
33GPT-5.6 Sol · Medium39.7%$0.615.6K134.3s
34GPT-5.6 Terra · XHigh39.3%$0.309.5K123.9s
35GPT-5.6 Sol · High38.0%$0.758K173.3s
36GPT-5.6 Luna · XHigh35.3%$0.0411K145.3s
37GPT-5.6 Terra · High32.7%$0.205.4K95.2s
38GPT-5.6 Luna · High31.3%$0.037.9K118.1s
39GPT-6 Luna · Low30.3%$0.012.6K63.5s
40GPT-5.6 Sol · Low29.7%$0.372.8K76.2s
41GPT-5.6 Terra · Medium29.3%$0.153.2K69.4s
42Kimi K3.1 Pro · Low29.0%$0.238K80.2s
43Claude Haiku 5.5 · Medium28.0%$0.0316.2K58.4s
44Claude Haiku 5.5 · High28.0%$0.0628.8K85.2s
45Grok 4.6 · XHigh28.0%$0.9623.3K574.1s
46GPT-5.6 Terra · Low27.0%$0.142.8K64.5s
47Fable 5.1 · Max27.0%$3.3631.3K419s
48Grok 4.6 · Low27.0%$0.9424.6K543.7s
49Grok 4.6 · High27.0%$0.9323.5K514s
50Grok 4.6 · Medium26.0%$0.9725.4K503.3s
51GPT-5.6 Luna · Medium24.0%$0.023.8K78.8s
52Claude Haiku 5.5 · Low23.0%$0.0210.4K42.3s
53Sonnet 5.5 · Medium22.0%$0.193.6K41.5s
54Fable 5.1 · XHigh21.7%$2.5021.1K296.7s
55Fable 5.1 · Medium21.0%$1.188.1K126.3s
56Fable 5.1 · High20.3%$1.5711.4K192.6s
57Opus 5 · Max19.7%$2.1129.1K392.7s
58GPT-5.6 Luna · Low19.0%$0.012.3K61.3s
59Opus 4.8 · XHigh18.7%$1.2020K251s
60Opus 5 · High18.0%$1.6118.9K246.5s
61Fable 5 · Max18.0%$3.4927.5K380s
62Opus 5 · XHigh17.3%$1.8924.2K337.5s
63Opus 4.8 · Medium17.0%$0.7610.1K133.4s
64Opus 5 · Medium17.0%$1.1011.4K149.5s
65Fable 5.1 · Low16.3%$0.926.1K101.7s
66GLM 5.3 · Max16.3%$0.6438.8K518.5s
67Fable 5 · High16.0%$1.8810.2K156.7s
68Opus 5 · Low15.7%$0.746.9K98.2s
69Opus 4.8 · Max15.0%$1.7834.7K433.9s
70Fable 5 · Low15.0%$1.144.7K79.8s
71Fable 5 · Medium14.7%$1.507.2K125s
72GLM 5.3 · High14.7%$0.3614.9K215.1s
73Sonnet 5 · XHigh14.3%$0.6220.2K213.6s
74Opus 4.8 · High14.0%$0.8612.2K186.7s
75Sonnet 5 · High13.7%$0.4914.3K170.4s
76Sonnet 5 · Medium13.3%$0.369.1K114s
77GLM 5.2 · High13.3%$0.2510.5K136.7s
78DeepSeek V4.1 · Max13.0%$0.0832.4K246.4s
79Kimi K2.7 · Medium12.7%$0.2811.8K156.4s
80Sonnet 5 · Max12.3%$1.0743.1K450.9s
81Opus 4.8 · Low12.0%$0.606.9K96.2s
82Sonnet 5 · Low11.7%$0.265.9K75.4s
83DeepSeek V4.1 · Low11.0%$0.0518.4K156.6s
84DeepSeek V4.1 · High11.0%$0.0726.9K205.4s
85GLM 5.2 · Max9.0%$0.3219.1K184s
86GLM 5.3 · Low8.7%$0.205.3K94.7s

Changelog

v1.1: Judge calibration improvements

Updated judges and rubrics to fix accidental rewarding of misleading responses. This makes the benchmark significantly more difficult overall, with Anthropic models especially impacted.

Additional model results on DataBench v1.1

Added GPT-6.1 Terra, Sonnet 5.5, Grok 4.6, Kimi K3.1 Pro, Fable 5.2, and DeepSeek V4.1 Flash 1017.

All additions use v1.1 grading; new model points use one repetition each.