Auditing retrieval self-check for retrieval-augmented answering under 9% distractor density: a blocked comparison
PDF

Keywords

retrieval-augmented answering
retrieval self-check
distractor density
paired simulation
reproducibility

Abstract

We evaluated retrieval self-check for retrieval-augmented answering under 9% distractor density. A deterministic paired simulation generated 72 cases and preserved a median slice. Mean evidence faithfulness changed from 0.585 to 0.636; the paired difference was +0.050 (95% interval +0.048 to +0.053). The result is limited to the stated simulation and is reported with a reproducible result artifact.

PDF

References

Sang, Y. (2025). AutoCrit: A Meta-Reasoning Framework for Self-Critique and Iterative Error Correction in LLM Chains-of-Thought. 2025 6th International Conference on Machine Learning and Computer Application (ICMLCA), 1177-1180. https://doi.org/10.1109/icmlca66850.2025.11336788

Maharana, P. R., Verma, A., & Joshi, K. (2025). Retrieval augmented generation for building datasets from scientific literature. https://doi.org/10.26434/chemrxiv-2024-qjx32-v2

Zandigohar, M., & Dai, Y. (2026). RAGulate: Retrieval-Augmented Generation for Post-hoc Literature-Grounded Regulatory Assessment. https://doi.org/10.64898/2026.01.20.700704

Karasan, A. (2026). Improving Retrieval-Augmented Generation: A Systematic Literature Review of Retrieval-Enhancement Techniques. https://doi.org/10.21203/rs.3.rs-10368581/v1

Qu, J., & Luo, F. (2026). Research on Citizen Privacy Risk Assessment Method Based on Retrieval-Augmented Generation. https://doi.org/10.21203/rs.3.rs-9015963/v1

Glendenning, J. (2026). Is Retrieval-Augmented Generation Fair Use?. https://doi.org/10.2139/ssrn.6165167

Madhurima, M. (2026). FaithGate: A Proposed Architecture for Real-Time Hallucination Detection and Correction in Retrieval-Augmented Generation Systems. https://doi.org/10.2139/ssrn.7242858

Kasim Vali, D. (2025). Autonomous QA Agent: A Retrieval-Augmented Framework for Reliable Selenium Script Generation. https://doi.org/10.31224/5891

Liu, C. (2025). Retrieval-Augmented Generation. https://doi.org/10.31224/5781

Martin, T., & Gilchrist, S. (2026). A2JRAG: Process-Aware Retrieval-Augmented Generation for Public Legal Information Systems. https://doi.org/10.2139/ssrn.7114139