Search
Categories
Blog
Pricing
Submit

Newsletter

Join the Community

Subscribe to our newsletter for the latest news and updates

Email

AI Tools Nav

Find the best AI tool for the job — curated, English-first.

Explore

Search
Categories
Tags
Collections

Resources

Blog
Pricing
Submit a tool

Jobs

Writing
Image
Code / Agents
Research / Chat

Company

About
Privacy Policy
Terms of Service
Sitemap

Copyright © 2026 AI Tools Nav. Open-source listings include data from OSS AI Hub (CC BY 4.0).

Home
Category
llama.cpp

llama.cpp

Most popular C/C++ inference engine for LLMs; quantize any Hugging Face model to GGUF and run on CPU, GPU, or Apple Silicon.

Introduction

Information

Websitegithub.com
Published date2026/10/13

Categories

Open-source / Self-host
Free-only

Tags

Free tier
Open source
Self-host

More Products

Hugging Face

Open-source / Self-host Code / Agents Free-only

Open models, datasets, and spaces for building with AI.

Free tier Freemium Open source Code

Ollama

Open-source / Self-host Code / Agents Free-only

Run open large language models locally with a simple CLI.

Free tier Open source Self-host Code

Stable Diffusion

Image Free-only Open-source / Self-host

Stable Diffusion is an open-source text-to-image model by Stability AI that can run locally on consumer hardware, enabling private and customizable AI image…

Free tier Open source Self-host Image

What it is for

Most popular C/C++ inference engine for LLMs; quantize any Hugging Face model to GGUF and run on CPU, GPU, or Apple Silicon.

Pricing

Open source (MIT).

Website

https://github.com/ggml-org/llama.cpp

Repository

https://github.com/ggml-org/llama.cpp

Last verified

2026-10-13 via OSS AI Hub (ossaihub.com), CC BY 4.0. Editorial notes are short and may lag the vendor site.