Inference Engines & Infra
ML infrastructure, inference, and ops.
Cactus
Open-source inference engine for deploying AI models locally on mobile and edge devices with automatic cloud fallback.
Cognita
An open-source RAG framework for building and deploying scalable retrieval-augmented generation applications.
LanceDB
Open-source embedded vector database for multimodal AI with billion-scale search on Lance columnar format.
Thunderbolt
Open-source, self-hosted enterprise AI client emphasizing data sovereignty and model choice.
OpenVINO™ Toolkit
Open-source toolkit for optimizing and deploying AI inference on Intel and multi-platform hardware.
MimicBot
Generates embeddable AI chatbots that crawl websites to answer questions with citations, book appointments, and submit forms without…
Ollama
Ollama downloads open-source models like Llama 2 and Mistral and runs them on your own hardware—no API calls, no subscriptions, no data…