Back to OpenVINO Toolkit
GSoC 2026

Agentic Toolkit for AI PC with OpenVINO

OVAT is a modular Python toolkit with a CLI for building and running local AI agents on Intel AIPCs. Uses OVMS as the inference backbone, adds YAML-driven configuration validated with pydantic v2, framework integration with LangChain, LlamaIndex, and OpenAI Agents SDK, MCP tool registration for document search and audio transcription, provider abstraction for swappable LLM/Embedding/Retriever backends, and hardware-aware GPU/NPU device routing. Includes tiered hardware profiles for 8GB and 16GB machines with sample agents. Core patterns validated by OvaSearch, a working C++ RAG engine with P50 6ms retrieval and zero crashes across 100-query stress test.

Project details

Contributor

Lagmator22

Mentors

Not available

Technologies

Not listed in the archive