RegBot LLM Compliance Assistant Genomics
Genomic data sharing is slowed by manually cross-checking consent and data-use language against dense GA4GH and related policy text, while generic LLMs risk hallucinated citations. This project extends GA4GH-RegBot, an open-source RAG assistant that ingests policy PDFs into a Chroma vector store with a BM25 manifest, retrieves with dense embeddings plus BM25 fused via reciprocal rank fusion, and generates structured compliance JSON with hard grounding: chunk-ID allow-list verification with automatic retries and token-overlap filtering on the LLM path. Deliverables across the GSoC period include hierarchy-aware parsing and richer metadata for GA4GH PDFs, cross-encoder re-ranking on top of the existing hybrid stack, an open-source LLM path alongside the current OpenAI integration, Streamlit and CLI updates, Ragas or TruLens-based evaluation with documented thresholds, expanded tests and CI, and polished documentation for contributors and REWS stakeholders.
Project details
Technologies
Not listed in the archive