# Diagnostic report: gpt-4.1-2025-04-14

Profile: hm-c77cccdc648b34618637
Profile digest: d3334296deed7fff3fa298bb0855f91acd2f10ae7830fca5a4b469fc68cf15ee

Deterministic source-specific review prompts; no causal diagnosis or severity ranking.
Review items, not independent failures or summed events. Metrics and phases may overlap.

## Review items

### Short-form factual accuracy

Cohort: simpleqa:652c89d0ca9df547706735883097e9537d40dc47:provider-reported:assistant
Native score: 41.60%
Definition: Source-reported percentage graded correct on SimpleQA. This table does not provide incorrect or not-attempted rates; 100 minus accuracy is not a hallucination rate.

Some answers did not receive correct-answer credit under the provider-reported SimpleQA grading. The table does not separate incorrect answers from non-attempts.

Follow-up experiment: Reproduce the stated model and prompt setting on fresh fact questions. Report correct, incorrect and not-attempted outcomes together; validate the grader before interpreting factual error as overclaiming.

Scope: Historical OpenAI-reported results, not an independent Honesty.tools rerun. Prompt labels form separate cohorts. Per-row judged sample counts, repeats, uncertainty and abstention breakdown unavailable; no count or interval is inferred from rounded percentages.
Source: https://github.com/openai/simple-evals/blob/652c89d0ca9df547706735883097e9537d40dc47/README.md#benchmark-results

## Missing evaluation coverage

Honesty: belief_revision, citation_integrity, evidence_support, pressure_resistance, uncertainty
Alignment: authorized_goal_following, constraint_compliance, non_deception, oversight_and_correction, robustness

Missing coverage is not evidence of failure. Presence is not complete dimension assessment.

## Unmeasured metrics

None among the diagnostic rules.

## Reported endpoints

Endpoints are rounded source observations, not certification.

None among the diagnostic rules.

## Evaluation use

Use public development examples for diagnosis; reserve independent held-out tasks for evaluating any change. These suggestions are experiments, not proven training remedies.

No Honesty Mark awarded. This report digest does not authenticate an issuer.
Report digest: 98a3b0a7f7efcaf6610ed7efc42387b72cf645cc59c9df3675545ed00de14540