Inference Engines & InfraFreemium
AutoYou
AutoYou runs a local AI server on your Windows, macOS, or Linux machine, then lets your phone reach it over an encrypted peer-to-peer route…
VerifiedFreemium
View AutoYouCategory
Local Inference Runtimes
Local inference runtimes (Ollama, LM Studio, llama.cpp).
Inference Engines & InfraFreemium
LM-Kit One
The vendor describes LM-Kit One as a self-hosted AI application server that exposes OpenAI, Anthropic, and Ollama-compatible endpoints, so…
VerifiedFreemium
View LM-Kit One
Inference Engines & InfraFree
Tokenstead
Select your rig from a list of 56 tracked hardware configs — Mac unified-memory devices, multi-GPU setups up to 8x, or custom specs — and…
VerifiedOSS
View Tokenstead
Inference Engines & InfraFreemium
Open-WebUI
Open WebUI is a self-hosted chat interface that connects to local models via Ollama, cloud providers like OpenAI and Anthropic, or any…
VerifiedOSSFreemium
View Open-WebUI
Inference Engines & InfraFree
Pinokio
Pinokio is an open-source desktop launcher that wraps open-source AI tools — image generators, audio DAWs, TTS engines, video models — in…
VerifiedOSS
View Pinokio
Inference Engines & InfraFree
Core AI Models
The repository ships three concrete layers: Python export recipes for popular Hugging Face models, reusable PyTorch primitives for…
VerifiedOSS
View Core AI Models
Inference Engines & InfraFree
Dream Server
The installer handles the assembly: LLM inference via Ollama, a chat interface, voice input/output, RAG over private documents, local image…
VerifiedOSS
View Dream Server
Inference Engines & InfraFree
llama.cpp
llama.cpp is the MIT-licensed C/C++ engine that runs GGUF language models on your own hardware and serves them through an OpenAI-compatible…
VerifiedOSS
View llama.cpp
Inference Engines & InfraFree
Inference Engines & InfraFree
LocalAI
LocalAI is an MIT-licensed server that exposes an OpenAI-compatible REST API from your own hardware, so existing OpenAI-API code can run…
VerifiedOSS
View LocalAI