# ADE-bench: Analytics Engineering Benchmark

> dbt Labs' 75-task analytics-engineering benchmark, scored on whether the dbt project's tests actually pass.

- Published by: [dbt Labs](https://www.getdbt.com)
- Repository: https://github.com/dbt-labs/ade-bench
- Tasks: 75

## What this benchmark measures

ADE-bench hands an agent a real dbt project running on DuckDB and asks it to fix a broken model, build a new one, or extend the semantic layer. Each of the 75 tasks is graded by running the project's own tests afterwards, so the benchmark measures completed engineering work rather than plausible-looking SQL. Tasks span eight domains, and there is no partial credit: a task counts only when the resulting project genuinely builds and passes.

## Latest result

On 21 July 2026, Dex + Claude Sonnet 5 resolved 57 of 75 tasks (76.0%).

| Run | Resolved | Accuracy | Cost |
| --- | --- | --- | --- |
| Claude Sonnet 5 (with dex) **[best]** | 57 / 75 | 76.0% | $35.95 |
| Claude Fable 5 (with dex) | 56 / 75 | 74.7% | $91.98 |
| Claude Opus 4.8 (with dex) | 54 / 75 | 72.0% | $43.38 |
| Claude Sonnet 5 (baseline) | 53 / 75 | 70.7% | $30.76 |

Dex + Sonnet 5 leads at 76%, for about 2.5x less than Fable 5 and ~17% less than Opus 4.8. With Dex, accuracy holds in a 72–76% band across all three models while cost ranges from $36 to $92, so the practical call is to run an inexpensive model.

For context, dbt's published agent skills reported 58% on this benchmark with Opus 4.6.

## Run history

- [21 July 2026](https://www.exmergo.com/benchmarks/ade-bench/2026-07-21) — 76.0% (57/75), best run: Claude Sonnet 5

## FAQ

### What is ADE-bench?

ADE-bench is dbt Labs' Analytics Engineering Benchmark: a 75-task suite that hands an agent a real dbt project running on DuckDB and asks it to fix a broken model, build a new one, or extend the semantic layer. The agent's work is then scored on whether the project's tests actually pass, so it measures completed engineering work rather than plausible-looking SQL.

### Who publishes ADE-bench?

dbt Labs publishes and maintains ADE-bench as an open benchmark at github.com/dbt-labs/ade-bench. It is a third-party suite, not one Exmergo authored, which is what makes results on it comparable across tools.

### How is ADE-bench scored?

Each of the 75 tasks is graded pass or fail by running the dbt project's own tests after the agent finishes. Accuracy is the share of tasks resolved across the full suite. There is no partial credit, so a task counts only when the resulting project genuinely builds and passes.

### How does Dex perform on ADE-bench?

In Exmergo's 21 July 2026 run, Dex with Claude Sonnet 5 resolved 57 of 75 tasks (76%), the strongest of the four configurations measured, at about $36 in model spend. For context, dbt's own published agent skills reported 58% on this benchmark with Opus 4.6.

### Does adding Dex actually change the result, or is it the model?

Both were measured. The same Claude Sonnet 5 loop with no plugin resolved 53 of 75 tasks (70.7%), against 57 of 75 (76%) with Dex supplied as the exmergo/dex skill plugin. Accuracy also held in a 72-76% band across three different models with Dex, while cost ranged from $36 to $92, which is what makes running an inexpensive model the practical call.