awesomer_
>

Local LLM

> Platforms, tools, practices and resources that helps run LLMs locally

## about
1
HOTTESTthis week
obra avatar

superpowers

An agentic skills framework & software development methodology that works.

+2,707298.9k
2
mendableai avatar

firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence.

+2,056191.4k
3
earendil-works avatar

pi

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

+1,951115.0k
4
pingdotgg avatar

t3code

+1,49827.5k
5
open-webui avatar

open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

+1,493155.6k
6
p-e-w avatar
hereticFully automatic censorship removal for language models
+1,40735.2k
7
sst avatar
opencodeThe open source coding agent.
+1,266213.4k
8
trycua avatar
cuaScale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.
+1,14529.7k
9
NVIDIA avatar
OpenShellOpenShell is the safe, private runtime for autonomous AI agents.
+97216.2k
10
microsoft avatar
BitNetOfficial inference framework for 1-bit LLMs
+77441.1k
11
topoteretes avatar
cogneeCognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free
+73832.3k
12
All-Hands-AI avatar
OpenHandsOpenHands: AI-Driven Development
+70690.9k
13
unslothai avatar
unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
+69478.0k
14
ollama avatar
ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
+665183.1k
ALL REPOS187 of 187 repos
22 of 22 categories
▼ CATEGORIESall selected
sort:
repostars7d
superpowers
Agents
298.9k+2,707
firecrawl
Browser Automation
191.4k+2,056
pi
Agent Frameworks
115.0k+1,951
t3code
Agent Frameworks
27.5k+1,498
open-webui
User Interfaces
155.6k+1,493
heretic
Training and Fine-tuning
35.2k+1,407
opencode
Coding Agents
213.4k+1,266
cua
Computer Use
29.7k+1,145
OpenShell
Security and Sandboxing
16.2k+972
BitNet
Inference engines
41.1k+774
cognee
Memory Management
32.3k+738
OpenHands
Coding Agents
90.9k+706
unsloth
Inference platforms
78.0k+694
ollama
Inference engines
183.1k+665
browser-use
Browser Automation
117.9k+594
llama.cpp
Inference engines
131.1k+579
system_prompts_leaks
Prompt Engineering
69.6k+540
playwright
Browser Automation
97.7k+477
chrome-devtools-mcp
Model Context Protocol
53.5k+454
vllm
Inference engines
93.8k+439
mem0
Memory Management
67.2k+409
langfuse
Testing, Evaluation and Observability
35.8k+338
cline
Coding Agents
70.3k+325
openchamber
Coding Agents
11.6k+325
zed
Coding Agents
91.7k+316
langchain
Agent Frameworks
147.8k+311
500-AI-Agents-Projects
Agents
38.7k+307
Prompt-Engineering-Guide
Prompt Engineering
79.2k+286
sglang
Inference engines
37.1k+286
SillyTavern
User Interfaces
34.4k+273
open-notebook
Research
40.2k+271
crewAI
Agent Frameworks
59.7k+266
anything-llm
Agent Frameworks
67.0k+265
context7
Miscellaneous
63.0k+263
goose
Coding Agents
55.3k+249
llmfit
Models
37.9k+234
playwright-mcp
Model Context Protocol
38.1k+230
Perplexica
Research
37.3k+228
graphiti
Retrieval-Augmented Generation
31.7k+220
lobe-chat
User Interfaces
83.2k+194
omlx
Inference engines
22.8k+184
github-mcp-server
Model Context Protocol
33.6k+182
RAG_Techniques
Retrieval-Augmented Generation
29.9k+181
agentskills
Agents
26.1k+177
nanochat
Models
58.6k+176
opik
Testing, Evaluation and Observability
22.6k+172
openwork
Computer Use
24.1k+166
agents-towards-production
Agents
21.7k+164
gpt-researcher
Research
30.1k+155
openai-agents-python
Agent Frameworks
30.0k+153
agent-framework
Agent Frameworks
14.1k+143
pydantic-ai
Agent Frameworks
20.6k+141
aider
Coding Agents
49.5k+138
agno
Agent Frameworks
42.7k+131
LightRAG
Retrieval-Augmented Generation
40.1k+126
ZLUDA
Hardware
15.0k+124
mempalace
Memory Management
59.6k+119
presenton
Miscellaneous
11.1k+118
autogen
Agent Frameworks
61.4k+115
agents.md
Agents
24.9k+112
CubeSandbox
Security and Sandboxing
12.9k+111
crush
Coding Agents
28.6k+110
stagehand
Browser Automation
25.7k+105
GenAI_Agents
Agents
24.6k+105
jan
Inference platforms
44.9k+103
LocalAI
Inference platforms
49.5k+101
exo
Inference engines
47.9k+101
onyx
Retrieval-Augmented Generation
32.4k+101
nano-vllm
Inference engines
15.8k+100
12-factor-agents
Agents
26.7k+97
SurfSense
Research
16.4k+95
nanobrowser
Browser Automation
14.1k+95
langflow
Agent Frameworks
155.6k+94
graphrag
Retrieval-Augmented Generation
36.3k+93
LMCache
Memory Management
12.1k+86
garak
Security and Sandboxing
9.6k+86
kilocode
Coding Agents
27.6k+80
supermemory
Memory Management
31.2k+76
continue
Coding Agents
36.2k+73
LiteRT-LM
Inference engines
6.7k+73
llama-swap
Models
6.0k+73
camel
Agent Frameworks
17.9k+70
RD-Agent
Research
14.9k+68
NemoClaw
Agent Frameworks
22.7k+67
miles
Training and Fine-tuning
3.1k+67
letta
Memory Management
25.1k+63
Agent-S
Computer Use
12.6k+63
slime
Training and Fine-tuning
8.7k+63
mlx-lm
Inference engines
7.3k+63
deepwiki-open
Miscellaneous
18.2k+62
llama_index
Agent Frameworks
52.5k+60
flashinfer
Inference engines
6.6k+60
lemonade
Inference platforms
5.9k+57
ChatBox
Inference platforms
42.0k+56
open-interpreter
Computer Use
68.6k+53
haystack
Retrieval-Augmented Generation
26.7k+52
trl
Training and Fine-tuning
19.5k+47
dynamo
Inference engines
8.3k+47
tokenspeed
Inference engines
2.2k+47
mini-sglang
Inference engines
5.3k+46
genkit
Agent Frameworks
6.5k+44
mlx-vlm
Inference engines
5.6k+42
Guardrails
Security and Sandboxing
7.3k+40
TensorRT-LLM
Inference engines
14.8k+39
gpustack
Inference engines
5.8k+39
OpenEnv
Training and Fine-tuning
2.7k+38
local-deep-research
Research
9.2k+32
koboldcpp
Inference engines
12.0k+31
dbhub
Model Context Protocol
3.6k+31
mobile-use
Miscellaneous
3.3k+31
giskard
Testing, Evaluation and Observability
5.9k+30
sim
Agent Frameworks
29.8k+29
mcp-atlassian
Model Context Protocol
6.0k+29
memU
Memory Management
14.5k+28
puppeteer
Browser Automation
95.7k+26
OmniParser
Computer Use
25.5k+26
claude-context
Retrieval-Augmented Generation
12.6k+25
outlines
Models
15.9k+24
speakr
Miscellaneous
4.1k+24
litert
Inference engines
3.5k+24
skills
Agents
11.2k+23
openllmetry
Testing, Evaluation and Observability
7.5k+23
txtai
Agent Frameworks
13.0k+21
mcp
Model Context Protocol
9.8k+21
ik_llama.cpp
Inference engines
3.3k+20
SpecForge
Training and Fine-tuning
1.2k+20
humanlayer
Coding Agents
11.7k+19
pipeshub-ai
Retrieval-Augmented Generation
3.8k+19
kiln
Training and Fine-tuning
5.2k+18
FastFlowLM
Inference engines
2.0k+18
n8n-mcp
Model Context Protocol
23.1k+17
sentence-transformers
Training and Fine-tuning
19.2k+17
agenta
Testing, Evaluation and Observability
4.8k+17
rl
Training and Fine-tuning
2.1k+17
OpenRLHF
Training and Fine-tuning
10.1k+16
gym
Training and Fine-tuning
1.2k+13
local-deep-researcher
Research
9.4k+12
Prompt_Engineering
Prompt Engineering
7.9k+11
mistral.rs
Inference engines
7.7k+11
Flowise
Agent Frameworks
55.5k+10
tabby
Coding Agents
33.9k+10
reasoning-bank
Memory Management
615+10
executorch
Inference engines
5.1k+9
production-stack
Inference
2.7k+8
llm-scaler
Inference engines
564+8
archgw
Agent Frameworks
7.1k+7
Awesome-Context-Engineering
Context Engineering
3.3k+7
bullshit-benchmark
Explorers, Benchmarks, Leaderboards
1.9k+7
mindsdb
Model Context Protocol
39.8k+6
distributed-llama
Inference engines
3.1k+6
sonar
Inference engines
1.9k+6
llguidance
Models
888+6
local-llm
Miscellaneous
1.9k+5
Context-Engineering
Context Engineering
9.3k+4
page-assist
User Interfaces
8.3k+4
99
Coding Agents
4.8k+4
ragbits
Agent Frameworks
1.7k+4
Observer
Miscellaneous
1.7k+4
evaluator
Testing, Evaluation and Observability
352+4
NeMo-Agent-Toolkit
Agent Frameworks
2.7k+3
Controllable-RAG-Agent
Retrieval-Augmented Generation
1.6k+3
maestro
Research
1.5k+3
gabber
Miscellaneous
1.1k+3
SuperAGI
Agent Frameworks
17.7k+2
OmniGen2
Miscellaneous
4.1k+2
OpenRoom
Computer Use
1.3k+2
LLM-Agents-Ecosystem-Handbook
Agents
553+2
vanna
Retrieval-Augmented Generation
23.8k+1
ClaraVerse
Agent Frameworks
3.9k+1
krasis
Inference engines
524+1
vllm-gfx906
Inference engines
435+1
text-generation-webui
User Interfaces
47.7k
Strata
Inference engines
24.2k
superset
Agent Frameworks
15.2k
emdash
Agent Frameworks
6.0k
ProxyAI
Coding Agents
1.9k
gguf-docs
Models
522
4o-ghibli-at-home
Miscellaneous
491
self-operating-computer
Computer Use
10.3k-1
augmentoolkit
Training and Fine-tuning
1.9k-1
Roo-Code
Coding Agents
24.3k-4
cai
Miscellaneous
9.8k-7
void
Coding Agents
28.8k-14
llm-app
Retrieval-Augmented Generation
58.8k-39
pathway
Retrieval-Augmented Generation
62.1k-40
system-prompts-and-models-of-ai-tools
Prompt Engineering
144.0k-53
AutoGPT
Agent Frameworks
187.6k-113