Fastest and most memory-efficient inference engine for LLMs with PagedAttention algorithm, 24× higher throughput, continuous batching, and OpenAI-compatible…

Free tier Open source Self-host

OpenHands

Open-source / Self-host Code / Agents Free-only

Open-source autonomous software engineering agent that can write code, run tests, and fix bugs like a human developer

Free tier Open source Self-host Code

Unsloth

Open-source / Self-host Free-only

Fine-tune LLMs 2× faster with 70% less VRAM; run 70B models on 24GB GPU or free Colab with LoRA, DPO, GRPO support.

Free tier Open source Self-host

LiteLLM

Code / Agents Open-source / Self-host Free-only

Universal proxy/router for 100+ LLM providers with unified OpenAI-compatible API, load balancing, fallbacks, and cost tracking.

Free tier Open source Self-host Code

InvokeAI

Image Open-source / Self-host Free-only

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using…

Free tier Open source Self-host Image