Stress-testing retrieval self-check for retrieval-augmented answering under 32% distractor density: a paired bootstrap
PDF

Keywords

retrieval-augmented answering
retrieval self-check
distractor density
paired simulation
reproducibility

Abstract

We evaluated retrieval self-check for retrieval-augmented answering under 32% distractor density. A deterministic paired simulation generated 64 cases and preserved a low-signal stratum. Mean evidence faithfulness changed from 0.522 to 0.575; the paired difference was +0.053 (95% interval +0.051 to +0.056). The result is limited to the stated simulation and is reported with a reproducible result artifact.

PDF

References

Sang, Y. (2025). Robustness of Fine-Tuned Llms Under Noisy Retrieval Inputs. 2025 6th International Conference on Artificial Intelligence and Electromechanical Automation (AIEA), 417-420. https://doi.org/10.1109/aiea66061.2025.11160531

Bellapukonda, J. (2026). Evaluating hallucination Mitigation in Retrieval-Augmented Generation Systems through Guarded Response Strategies, Embedding Comparison, and Retrieval Depth Analysis. https://doi.org/10.2139/ssrn.6702638

Fu, E. L. (2025). Industrial AI Guardrails: Solving Field Service Reliability with Retrieval-Augmented Generation. Global Business & Economics Journal. https://doi.org/10.70924/f83n6wqz/g91xh08t

Roy, P., & Singirikonda, A. (2026). Optimization and Constraint Modeling using LLMs with a Retrieval Augmented Generation Process. https://doi.org/10.2139/ssrn.7068218

Aryani, A. (2024). A Brief Introduction to Retrieval Augmented Generation (RAG). https://doi.org/10.59350/ayxyj-h9751

Khan, N., Islam, M. S., & Saha, S. (2026). CyberRerankBench: Benchmarking Rerankers for Cybersecurity Retrieval-Augmented Generation. https://doi.org/10.2139/ssrn.7240159

НИЧ, & ПРАВОРСЬКА (2026). RAG (RETRIEVAL-AUGMENTED GENERATION) ЯК НОВА ПАРАДИГМА КОРПОРАТИВНОЇ АВТОМАТИЗАЦІЇ. Herald of Khmelnytskyi National University. Technical sciences, 361(1), 375-382. https://doi.org/10.31891/2307-5732-2026-361-53

Dhenia, R. N. K., Sridhar, R., & Kanani, I. J. (2024). Retrieval-Augmented Generation: Enhancing Reliability in Large Language Models. American International Journal of Computer Science and Technology, 6, 46-49. https://doi.org/10.63282/3117-5481/aijcst-v6i2p105

Köhler, A., Stein, M., & Vogt, E. (2026). Adaptive Context Reconstruction for Enhanced Retrieval Augmented Generation . https://doi.org/10.2139/ssrn.6101386

Maharana, P. R., & Joshi, K. (2024). Retrieval augmented generation for building datasets from scientific literature. https://doi.org/10.26434/chemrxiv-2024-qjx32