Act as a research software engineer. Build The AI Citation Support Verification Workbench, a tool for evaluating whether cited source passages actually support claims made in an AI-generated answer.
Allow users to enter an answer containing claims and citations, then supply the referenced passages, URLs, or source documents.
The application should:
Split answers into individually reviewable factual claims.
Link each claim to its cited source passage.
Classify evidence as directly supportive, partially supportive, contradictory, irrelevant, or insufficient.
Detect citations that point to the wrong source or fail to address the associated claim.
Highlight numerical discrepancies, missing qualifications, and overgeneralized statements.
Distinguish source existence from source support.
Provide an evidence table with claim text, source excerpt, assessment, and reviewer notes.
Support manual correction and reviewer approval.
Export structured verification results.
Include synthetic examples with valid citations, misleading citations, outdated facts, and unsupported conclusions. Use transparent rule-based checks where possible and label heuristic judgments clearly. Do not claim that a citation is verified merely because its URL exists. Make every assessment traceable to supplied source material.
0 Comments