Capabilities & Benchmarking

How well do frontier LLMs know the Danish Building Regulations?

We test each model against the same fixed set of questions grounded in Bygningsreglementet.

Explore the benchmark

Three ways to look at the results

Start with the leaderboard for a snapshot, track performance over time as we re-test models, or dig into calibration to see whether each model actually knows what it doesn’t know.

Leaderboard

Accuracy by model

Point estimate with 90% confidence interval, sorted from highest to lowest accuracy.

Open →
Performance over time

Tracking model performance as new versions and benchmarks arrive

Each point is one model’s accuracy on the day we tested it.

Open →
Calibration explorer

Does the model know what it doesn’t know?

For each self-reported confidence level, we plot the model’s actual accuracy.

Open →
Methodology

How we build and score the benchmark

The question set is drawn from real provisions of the Danish Building Regulations.

Every model is given the same questions, with the same prompt structure.

Note

Figures on this page are placeholders pending the final published dataset.