local-llm

local-llm

Shell

70

Everything I know about running LLMs locally

gemma-chat

TypeScript

67

Local AI chat + coding agent for Apple Silicon, powered by Gemma 4 via MLX / Supports Ollama

deltafin

Rust

72

Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

vomit

Go

68

Clean up Claude's token vomit with a separate LLM. Save your tokens, Opus is hopeless

LocalAI

Go

100

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

CarWatch

Python

72

Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.

ollama

Go

95

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

jarvis

Shell

68

Jarvis meta-repository: shared docs, configs, and setup scripts

MTPLX

Python

90

3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

Lexicon

JavaScript

72

The free open source offline writing assistant assist with grammar, rewriting & tone entirely on your machine.

SiliconScope

Swift

82

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

llm-space

TypeScript

95

A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.

unsloth

Python

95

Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.

deja-vu

Go

82

Search your past AI coding sessions — Claude Code, Codex, Cursor and 17 more. Indexes the session history they already wrote to disk, including months from before you installed it, and recalls it in any of them. No LLM, no embeddings, one local Go binary.

bindwidth

JavaScript

72

Evidence-aware on-prem LLM inference sizing and TCO calculator

agentacct

Python

77

See what your coding agents did and what it cost. Breaks each task down into work steps — tools used, files changed, tests run, time and tokens spent. Local-first dashboard for Claude Code, Codex, OpenCode, and more. No login, no telemetry.

Soup

Python

90

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

mdflux

Python

72

Turn any document into clean, AI-ready Markdown. Local-first desktop app: reads scanned PDFs, batches folders, runs offline, and uses far fewer tokens than vision models.

MLX-LoRA-Studio

Swift

72

A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

macos-harness

Python

77

The simplest, thinnest harness that gives an LLM complete freedom to control a Mac.

waku-agent

Python

90

Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.

kimodo.cpp

C++

72

Animate skeletons with natural language; NVIDIA's Kimodo ported to C++/GGML

nativ

Swift

87

Local AI, native to your Mac. Chat, serve, monitor, and connect MLX models from one macOS app.

writer-computer

TypeScript

80

Local-first desktop markdown editor

agenttrail

HTML

72

Local observability map for AI coding agents. Watch Claude Code, Codex, and Cursor plans, tool calls, file changes, and progress in real time.

kiac

Go

82

Local Kubernetes on Apple's container framework - every node is its own lightweight VM. Metrics, storage, and LoadBalancer included.

outreachr

TypeScript

77

Local-first, open-source investor fundraising CRM for founders

app-monitor

Swift

63

Local-first macOS app usage, storage, cleanup, update, and uninstall monitor.

Pythia

TypeScript

80

One local API call gives your agent the entire live state of the planet — every major world event at once, plus forecasts. 40+ free keyless feeds, runs entirely on Ollama. No cloud, no cost. Keyless live feeds into one global view and forecasts what’s likely next. No cloud, no keys, no cost. 1d,1w,1m,1y predictions by Mirofish.

sloptrim

Python

77

A local detector for AI-writing patterns. Scores every prose file your agent saves. Python standard library only, no network, no model.

Token-Saver

Python

72

A local Claude Desktop extension to query large PDFs with 92–98% fewer tokens. Performs local hybrid search, cites exact page numbers, and keeps your documents private on your machine

gorest-2d-animation-spritesheet-generator

TypeScript

90

Codex-assisted local 2D animation spritesheet generator and scene compositing workspace.

da-cli

Python

53

Sync DeviantArt galleries to local folders — zero-dependency Python CLI with OAuth 2.1 PKCE, a SQLite index, and scheduled macOS syncs.

ds4

C

95

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

maka

TypeScript

90

Apache Maka (Incubating) is a local-first AI agent workspace. Model messages, tool calls, tool results, permission decisions, and termination events are recorded as an append-only log.

junction

TypeScript

73

VS Code chat sidebar for local AI coding agents

frp

Go

100

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

viseron

Python

90

Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.

open-science

TypeScript

90

Open Science is an open-source, local-first, model-agnostic AI research workbench for reproducible scientific research on macOS, Windows, and Linux.

OpenChatCut

TypeScript

90

Open-source, local-first conversational AI video editor with a professional multi-track timeline, Agent Skills, MCP integration, and Remotion rendering.

qwen-scribe

Python

73

Private, local transcription and system-wide dictation for Apple Silicon.

ownmem

JavaScript

68

Open-source, Git-native memory for AI coding agents — deterministic local recall for Claude Code, Codex, Cursor, Gemini CLI, and compatible tools.

Alexandrie

Vue

95

📚 The open-source, offline-first Notion, Obsidian & Confluence alternative. Advanced Markdown, multi-tenant teams, OIDC/SSO, and local S3 backups. Deploy in one command.

world-model-optimizer

Python

82

An open source model gateway that provides one control plane across closed, open-source, local, and custom models.

understory

TypeScript

77

understory — memory that grows. Self-wiring, plain-markdown memory for AI agents (MCP + local models + a living graph).

vibepulse

C

72

ESP32-S3 AMOLED for Claude Code & Codex usage, live agent activity, and answerable NEEDS YOU alerts. Local-first macOS/Windows host; optional encrypted relays.

jit

Go

73

Find the plaintext secrets on your Mac and move them behind Touch ID, injected just in time without breaking the tools that read them. Free and local-first.

burrow

TypeScript

63

a whole dev machine in a browser tab - bun.wasm, shell, git, and local AI. phones home to nobody.