llamafile
mozilla-ai/llamafile
Distribute and run LLMs with a single file
Why pick itRuns on multiple platforms without installation
Install
- GitHub
- mozilla-ai/llamafile
- Website
- docs.mozilla.ai
- Stars
- ★ 26.6k
- Language
- C++
- Last push
- Nov 9, 2026
- Category
- Run locally
Good for
- Run large language models locally
- Quickly test different models
- Use without installation
- Support speech-to-text function
Getting started
- Download model file
- Give execute permission
- Run the file directly
- Windows needs to rename .exe
Before you install
Windows limits files under 4GB, need to download external weight files
Summarized by AI from the project docs; check the official docs before relying on it.
Similar tools
- private-gptRun locally · ★ 57.6k
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, and more
- LocalAIRun locally · ★ 50.3k
Run any AI model on any hardware, no GPU required
- codebase-memory-mcpRun locally · ★ 48.4k
Local code intelligence tool that connects code, docs, and infrastructure in a persistent graph.
- meetilyRun locally · ★ 32.5k
AI meeting assistant with real-time speech-to-text and meeting summaries
- dyadRun locally · ★ 22k
Local open-source AI app builder, fast, private, and fully under your control
Source GitHub · Updated Nov 9, 2026 · All rights belong to the original creators