Agentic RAG
Hybrid Retrieval, Evals, Workflows
- Built a production-style document Q&A pipeline handling PDF ingestion, chunking, and embedding into a durable, retry-safe workflow with full retrieval traceability.
- Established a baseline retrieval precision of 68% by designing a ground-truth eval harness of 75+ Q&A pairs using exact-match and LLM-as-judge scoring.
- Boosted eval pass rate to 89% and precision by 22% by implementing hybrid BM25 + cross-encoder re-ranking with agentic query-routing for low-confidence retrieval.
Python · Inngest · LlamaIndex · Qdrant · OpenAI