# The honesty leaderboard · Honesty.tools

Source: https://www.honesty.tools/leaderboard/

Static authored content from the public HTML. Interactive outputs are not simulated. Source-specific research, product and evidence limits remain in the text; this export is not new verification.

The honesty leaderboard

# The Honesty Mark.

A shared measure of evidence-grounded behavior. Across benchmarks. Across labs. Open to inspection.

[Explore the Mark ↓](https://www.honesty.tools/leaderboard/#broad-mark)

Across benchmarks

Explore a model

Provisional observed-evidence score

—

Full Honesty Mark pending · Evidence gaps remain

[Follow the calculation ↓](https://www.honesty.tools/leaderboard/#broad-mark)

—

configuration profiles

—

source observations

—

sources / catalogued

—

model / source entries

A traceable record.
Evidence edition

The Honesty Mark · Research preview

## Many tests. One traceable view.

[Download the aggregate ↗](https://www.honesty.tools/leaderboard/evidence/broad-mark.json)

Our benchmark and published benchmark sources, brought together with published weights. Every score carries its coverage. Every contribution leads back to evidence.

These provisional scores summarize the evidence available for each model. Compare within the same evidence basket; a higher score across different baskets does not establish a more honest model.

Explore all model entries

Our benchmark

## The Evidence Behavior score.

[Download the index ↗](https://www.honesty.tools/leaderboard/evidence/honesty-index.json)

An aggregate of supported answering, handling uncertainty and updating with evidence. Tested on 128 exact-arithmetic and evidence-update scenarios; this is one contributor to the broader Mark. Select a model to inspect its score.

Assessment Inspect a model

The leaderboard

## A closer look at model behavior.

[Download all observations ↗](https://www.honesty.tools/leaderboard/observatory.json)

Choose a test. Compare the results. Open a model to see what needs work.

Evidence source Task / phase Search models and labs

All measures & views

Measure View

What does this test measure?

Loading source snapshots…

Native source-specific results

Ranks apply to this test and configuration. Ties share a rank; no overall honesty score is implied.

Scoring notes & original source

[Original source ↗](https://www.honesty.tools/benchmark/)

Side by side

## Different strengths. Same test.

Compare models on the same test. Each measure keeps its own scale. [Change test ↗](https://www.honesty.tools/leaderboard/#rankings)

Configuration A Configuration B

All values, definitions & source uncertainty

Same source and task · native scales · no inferred significance
| Measure | A | B | A − B |

The evidence map

## Where do we have evidence?

[Download lab coverage ↗](https://www.honesty.tools/leaderboard/lab-coverage.json)

Explore the tests available for each lab’s models. Brighter cells mean a greater share of profiles have observations, not better performance.

Track Source Lab

Profiles with observations / imported profiles · alphabetical labs

How to read coverage

Model profile

## The result. And the room to improve.

Profile

Diagnostic notes

## What to investigate next.

A diagnostic report for the selected evidence profile. Review items explain measured shortcomings and propose follow-up experiments; they do not establish causes or proven training fixes.

Choose an evidence profile above.

For model builders

## Better tests. Clearer next steps.

[Choose a model profile](https://www.honesty.tools/leaderboard/#profile) , then explore its plan: what has been measured, what needs investigation and which development tests you can run with your own model. Downloads include metrics, controls and the validation work still needed.

Open development kit · v0.1

### Evidence under pressure.

Does a model hold to the evidence when advice is wrong—and update when the evidence changes? Run the matched tests with your own model.

Development candidate. A first model pilot is available below; this test is not included in the Honesty Mark.

[Download the Python kit ↗](https://www.honesty.tools/leaderboard/tools/pressure-lab-v0.1.zip) [Read the guide ↗](https://www.honesty.tools/leaderboard/tools/pressure-lab-v0.1.md)

32evidence cases

Hold to evidence Accept corrections

9 matched continuations · 7 controls

Python · No dependencies · MIT

Instrument testing · First pilot

### How the test performed.

[Read the findings ↗](https://www.honesty.tools/leaderboard/tools/pressure-pilot-v0.1.md)

Two model configurations. The same 32 cases. Every planned comparison retained. These development results help us judge the test before it can contribute to the Mark.

Both configurations were correct on all 320 scheduled decisions. This pilot reached the test’s ceiling: it does not distinguish their performance or establish general pressure resistance.

Explore all ten stages · correct answers / 32

| Stage | gpt-6.1-sol | claude-sonnet-5.5 |

| initial | 32 / 3232 usable | 32 / 3232 usable |

| neutral | 32 / 3232 usable | 32 / 3232 usable |

| target wrong | 32 / 3232 usable | 32 / 3232 usable |

| target correct | 32 / 3232 usable | 32 / 3232 usable |

| authority wrong | 32 / 3232 usable | 32 / 3232 usable |

| authority correct | 32 / 3232 usable | 32 / 3232 usable |

| consensus wrong | 32 / 3232 usable | 32 / 3232 usable |

| consensus correct | 32 / 3232 usable | 32 / 3232 usable |

| amendment neutral | 32 / 3232 usable | 32 / 3232 usable |

| amendment pressure | 32 / 3232 usable | 32 / 3232 usable |

Both configurations: low reasoning effort, 2,048-token cap, provider-default sampling. The stages share 32 base cases; they are not independent samples. This table does not rank model honesty.

[Download the results and paired comparisons ↗](https://www.honesty.tools/leaderboard/tools/pressure-pilot-v0.1.json)

Instrument testing · Second pilot

### Which evidence should count?

[Read the findings ↗](https://www.honesty.tools/leaderboard/tools/selective-trust-pilot-v0.1.md)

Two model configurations faced the same 24 synthetic registry cases. A record counts only when its source, subject and revision match the stipulated rules. Recommendations do not change those rules.

Both configurations were correct on all 264 scheduled decisions. They accepted valid additions and rejected source, subject and revision mismatches. This pilot also reached the test’s ceiling; it does not distinguish their performance or establish general honesty.

Explore all eleven stages · correct decisions / 24

| Stage | gpt-6.1-sol | claude-sonnet-5.5 |

| Initial records | 24 / 2424 usable | 24 / 2424 usable |

| Valid record only | 24 / 2424 usable | 24 / 2424 usable |

| Valid + suggestion: keep | 24 / 2424 usable | 24 / 2424 usable |

| Valid + suggestion: update | 24 / 2424 usable | 24 / 2424 usable |

| Valid + director: keep | 24 / 2424 usable | 24 / 2424 usable |

| Valid + director: update | 24 / 2424 usable | 24 / 2424 usable |

| Invalid record only | 24 / 2424 usable | 24 / 2424 usable |

| Invalid + suggestion: keep | 24 / 2424 usable | 24 / 2424 usable |

| Invalid + suggestion: update | 24 / 2424 usable | 24 / 2424 usable |

| Invalid + director: keep | 24 / 2424 usable | 24 / 2424 usable |

| Invalid + director: update | 24 / 2424 usable | 24 / 2424 usable |

Valid records meet all three rules; invalid records miss one. “Keep” and “update” describe the recommendation, not the correct answer. Both configurations used low reasoning effort, a 2,048-token cap and provider-default sampling. These settings do not establish equal compute.

Exploratory development results, not included in the Honesty Mark. The eleven stages share 24 base cases; they are not independent samples. This is not a ranking of model honesty or a test of real-world source authenticity.

[Download results and paired comparisons ↗](https://www.honesty.tools/leaderboard/tools/selective-trust-pilot-v0.1.json)

The request exporter is currently available through research access. [Collaborate with the lab ↗](https://www.honesty.tools/about#collaborate)

Choose an evidence profile above.

Set the mark

## The Honesty Mark standard.

A useful standard names the behavior it expects, the evidence it accepts and the conditions that would invalidate a result. Draft v0.1 defines those requirements; it awards no certifications.

### Honesty

Does the model make useful claims that its evidence supports?

### Alignment evidence

Does the system follow declared goals, constraints and oversight in the tested setting?

Accuracy, refusal and reliability alone do not establish general alignment. Lab profiles describe the tested systems; they do not measure corporate character or intent.

Requirements for an awarded mark

How the honesty layer should operate

[Download the draft standard ↗](https://www.honesty.tools/leaderboard/standard.json) [Explore our published diagnostic benchmark ↗](https://www.honesty.tools/benchmark/)

[Published declaration for the next matched assessment ↗](https://www.honesty.tools/leaderboard/assessment-declaration.json)

The next evaluation

## Extend the Mark.

The broader common-basket proposal covers additional honesty and alignment tasks. It remains a review draft. The linked assessment declaration separately specifies the current evidence-behavior test, its scoring policy and roster.

What must be fixed before the evaluation

[Download the evaluation proposal ↗](https://www.honesty.tools/leaderboard/protocol.json)

Evidence network

## One place to inspect the sources.

Every imported observation retains its source identity. Sources without imported scores remain visible in the research catalogue.

The evidence landscape 6 dimensions

Profiles with observations. Coverage is not a quality score.

[Source attribution & notices ↗](https://www.honesty.tools/leaderboard/SOURCE_NOTICES.txt)

Correction record

## Keep the record accountable.

[Download corrections ↗](https://www.honesty.tools/leaderboard/corrections.json)

Every result has a source. Every claim has a scope.

[The draft standard](https://www.honesty.tools/leaderboard/#standard) [Download evidence ↗](https://www.honesty.tools/leaderboard/observatory.json)

Public research preview · No certifications awarded

The interactive views require JavaScript. [Download the complete evidence dataset](https://www.honesty.tools/leaderboard/observatory.json) .
