Skip to main content
Featured AI ProjectOffline-First Architecture

Karya

Offline-first multilingual AI learning platform combining on-device quantized LLM inference, ChromaDB vector retrieval, and neural translation across 22 Indian languages.

View All Projects
01
AI
Vector ~68ms · Chat ~1.1s (Benchmark)

Karya

Offline-first multilingual AI learning platform.

An offline AI education platform combining quantized on-device LLM inference, multilingual RAG across 22 Indian languages + English, document OCR, and interactive whiteboard tools.

Architecture Highlight

Implemented an offline-first AI architecture using a quantized 1.5B LLM designed for 4–8GB RAM environments.

Key Engineering Deliverables
  • •Local LLM Tutoring: Quantized DeepSeek-R1-Distill-Qwen-1.5B designed and tested for 4–8GB RAM environments
  • •Multilingual RAG & NMT: Local semantic retrieval with ChromaDB and separate NLLB-200 translation across 22 Indian languages + English
  • •Automated Study Materials: Summaries, notes, flashcards, MCQs & algorithmic whiteboard diagrams
ReactNode.jsMongoDBChromaDBllama.cppNLLB-200Tesseract.js