Lexical Anchors and Repository Graphs for Coding Agents
Regular Issue cover
PDF

Keywords

coding agents
repository graphs
lexical anchors
structural retrieval
code search
retrieval evaluation

Abstract

This evidence synthesis examines anchored structural retrieval in coding agents that must locate relevant files and tests in unfamiliar repositories. It argues that the appropriate object of evaluation is the chain from query and index state through candidate retrieval, structural expansion, generation or extraction, confidence, and downstream use, not a model score in isolation. The review brings together the assigned studies with established work on uncertainty, robustness, provenance, and governance. Across these literatures, a common problem emerges: a fluent answer or entity label can rest on stale, temporally invalid, or systematically omitted evidence. The proposed framework separates evidence quality, model behavior, decision policy, and operational monitoring, then asks how each layer changes under distribution shift, adversarial pressure, or incomplete information. It recommends evaluation by slices and repeated trials, explicit reject and escalation policies, preservation of data and reasoning lineage, and prospective monitoring tied to defined actions. The result is a research agenda for systems that are efficient enough to use but also bounded enough to audit. No new experiment is claimed; the article develops a comparative conceptual model and identifies tests that would make future empirical claims more credible.

PDF

References

Hu, Yuntong, et al. “LARGER: Lexically Anchored Repository Graph Exploration and Retrieval.” arXiv, version 1, 8 May 2026, https://arxiv.org/abs/2605.16352v1. Preprint.

Hamilton, William L., Rex Ying, and Jure Leskovec. “Inductive Representation Learning on Large Graphs.” Advances in Neural Information Processing Systems, vol. 30, 2017.

Thakur, Nandan, et al. “BEIR: A Heterogeneous Benchmark for Zero-Shot Evaluation of Information Retrieval Models.” Advances in Neural Information Processing Systems, vol. 34, 2021, pp. 5370–82.

Lin, Jimmy, Rodrigo Nogueira, and Andrew Yates. Pretrained Transformers for Text Ranking: BERT and Beyond. Morgan & Claypool, 2021.

Gururangan, Suchin, et al. “Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks.” Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, pp. 8342–60.

Loughran, Tim, and Bill McDonald. “When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10-Ks.” Journal of Finance, vol. 66, no. 1, 2011, pp. 35–65.

Araci, Dogu. “FinBERT: Financial Sentiment Analysis with Pre-Trained Language Models.” arXiv, 2019, arXiv:1908.10063.

Guo, Chuan, et al. “On Calibration of Modern Neural Networks.” Proceedings of the 34th International Conference on Machine Learning, 2017, pp. 1321–30.

Geifman, Yonatan, and Ran El-Yaniv. “Selective Classification for Deep Neural Networks.” Advances in Neural Information Processing Systems, vol. 30, 2017.

Sculley, D., et al. “Hidden Technical Debt in Machine Learning Systems.” Advances in Neural Information Processing Systems, vol. 28, 2015.

Robertson, Stephen, and Hugo Zaragoza. “The Probabilistic Relevance Framework: BM25 and Beyond.” Foundations and Trends in Information Retrieval, vol. 3, no. 4, 2009, pp. 333–89.