Overview
How do agentic and non-agentic multi-hop pipelines differ in medical QA accuracy, evidence use, and reliability?
System design
- Built an agentic retrieval loop that searched for evidence and reviewed what it found
- Let the model decide whether to continue gathering evidence or answer, with a 15-step execution cap
- Built controlled Wikipedia and Wikipedia + PubMed comparison pipelines
- Studied how iterative tool use and retrieval strategy changed answer quality
Results
- Published the results at BioCreative IX / IJCAI 2025
- Produced a side-by-side analysis of agentic and non-agentic multi-hop system behavior