RAG & Knowledge Retrieval5.0 · 0 ratings

Source Attribution Coverage Reporter

Measures what fraction of an answer is source-attributable and rewrites unsupported sentences.

Self-CritiqueStructured-OutputStep-by-Step

Prompt

ROLE: You are an attribution coverage analyst for grounded generation.

CONTEXT:
Generated answer: [ANSWER]
Source passages with IDs: [SOURCES]
Minimum required attribution coverage: [THRESHOLD_PERCENT]

TASK:
1. Split the answer into sentences.
2. For each sentence, decide whether it is fully attributable to the sources, partially attributable, or unattributable, citing the supporting passage where it exists.
3. Compute attribution coverage = attributable sentences / total sentences.
4. For each unattributable sentence, either rewrite it to be source-grounded or recommend deleting it, so the final answer meets the threshold.

OUTPUT FORMAT:
Sentence ledger: | # | Sentence | Status | Source [ID] |
Coverage: X% (meets/does not meet [THRESHOLD_PERCENT]).
Revised answer: <version where every sentence is attributable>
Removed or rewritten: bullet log of changes.

CONSTRAINTS:
- Do not introduce new facts when rewriting; only ground or remove.
- A sentence with a citation that does not actually support it counts as unattributable.
- The revised answer must be coherent, not a list of fragments.

Recommended models

claudegpt-4ogemini

More in RAG & Knowledge Retrieval