# Diagnostic report: qwen/qwen3.5-122b-a10b

Profile: hm-f1dd91e80dc1ce0756b7
Profile digest: c4f20304297b513a9266bcb7bf311dc876f3c86fce7a04b2f6cf0f7adc3ff898

Deterministic source-specific review prompts; no causal diagnosis or severity ranking.
Review items, not independent failures or summed events. Metrics and phases may overlap.

## Review items

### Summarization answer coverage

Cohort: vectara:af0e3207741054b44e7c87688a40a815ecf446df
Native score: 99.80%
Definition: Source-reported rate of responding to the summarization request; not factual correctness.

The publisher reports that some requests did not receive an answer. The aggregate does not establish why.

Follow-up experiment: Inspect non-answer reasons using accessible response records or a fresh matched evaluation. Do not label non-answers unnecessary abstentions without answerability evidence.

Scope: Exact configuration and trial-level evidence unavailable in this snapshot.
Source: https://github.com/vectara/hallucination-leaderboard/blob/af0e3207741054b44e7c87688a40a815ecf446df/README.md

### Summarization grounding errors

Cohort: vectara:af0e3207741054b44e7c87688a40a815ecf446df
Native score: 11.20%
Definition: Source-reported hallucination rate on document summarization.

The benchmark publisher reports a nonzero hallucination rate under its summarization scorer.

Follow-up experiment: Reproduce document-conditioned summarization with the declared scorer. Inspect unsupported statements and omissions together, while retaining answer rate and summary length.

Scope: Exact configuration and trial-level evidence unavailable in this snapshot.
Source: https://github.com/vectara/hallucination-leaderboard/blob/af0e3207741054b44e7c87688a40a815ecf446df/README.md

## Missing evaluation coverage

Honesty: belief_revision, citation_integrity, factual_accuracy, pressure_resistance, uncertainty
Alignment: authorized_goal_following, constraint_compliance, non_deception, oversight_and_correction, robustness

Missing coverage is not evidence of failure. Presence is not complete dimension assessment.

## Unmeasured metrics

None among the diagnostic rules.

## Reported endpoints

Endpoints are rounded source observations, not certification.

None among the diagnostic rules.

## Evaluation use

Use public development examples for diagnosis; reserve independent held-out tasks for evaluating any change. These suggestions are experiments, not proven training remedies.

No Honesty Mark awarded. This report digest does not authenticate an issuer.
Report digest: 98eda739fec58d96aceb65c4ec37e8bb5929eb8ed1dde00de00b7dcd2c28cd03