llm

llm-space

TypeScript

95

A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.

awesome-llm-apps

Python

100

100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.

local-llm

Shell

70

Everything I know about running LLMs locally

llama.cpp

C++

95

LLM inference in C/C++

Soup

Python

90

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

apex-inference-chip

Python

68

An inference chip design that runs a real LLM (Qwen2.5-0.5B) on FPGA — one transformer decoder layer in RTL, every silicon value bit-exact against a golden model. 0.56 tok/s measured, a 140× climb, full evidence trail.

ctrlb-decompose

Rust

77

LLM-ready reasoning surface over logs

Investbrain

PHP

82

Smart LLM-enabled investment tracker that consolidates and monitors market performance across your different brokerages

chorus

TypeScript

82

Multi-LLM peer review for code decisions. Bring your own CLI; Chorus convenes 2-4 other LLMs to review the work before you ship.

pi

TypeScript

100

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

shard

Python

72

Pipeline-parallel LLM inference across GPUs on separate machines.

voidllm

Go

72

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

bindwidth

JavaScript

72

Evidence-aware on-prem LLM inference sizing and TCO calculator

unsloth

Python

95

Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.

tokenspeed

Python

90

TokenSpeed is a speed-of-light LLM inference engine.

macos-harness

Python

77

The simplest, thinnest harness that gives an LLM complete freedom to control a Mac.

MLX-LoRA-Studio

Swift

72

A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

trueforge

TypeScript

90

The open-source agent harness - the runtime layer that turns an LLM into a working agent.

inference-school

Swift

77

A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exercises, a native macOS Studio, and a complete companion book.

vomit

Go

68

Clean up Claude's token vomit with a separate LLM. Save your tokens, Opus is hopeless

LocalAI

Go

100

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Photo-agents

Python

72

Autonomous self-evolving agents. Vision-grounded layered memory and self-written skills for LLM agents that operate your computer.

feeds.fun

Python

67

News reader with tags, scoring, and LLM

AI-Engineering-Lab

Jupyter Notebook

75

A free, self-paced 24-week AI engineering course: Python, machine learning, LLMs, RAG, fine-tuning, agents and MCP, Azure and Vertex and Bedrock, and Databricks. 43 runnable notebooks, one continuous case study. MIT licensed, no signup. By Zorost Intelligence AI Lab.

ragflow

Go

95

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

harness

Swift

72

AI-driven user testing for iOS Simulator, macOS apps, and web apps. Write a goal in plain language; an LLM agent drives the UI and reports friction. macOS 14+, Swift 6.

deja-vu

Go

82

Search your past AI coding sessions — Claude Code, Codex, Cursor and 17 more. Indexes the session history they already wrote to disk, including months from before you installed it, and recalls it in any of them. No LLM, no embeddings, one local Go binary.

ollama

Go

95

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

open-webui

Python

100

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

langchain

Python

100

The agent engineering platform.

deltafin

Rust

72

Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

ratel

TypeScript

77

Context engineering for AI agents. ~80% fewer tokens. Fix tool overload. Skills and memory with in-process BM25 and semantic retrieval. Progressive Disclosure. No vector DB.

cursed_browser

Swift

45

True AI-Native Browser — a VLM reads the HTML and hallucinates the page.

spec-ptc

Python

72

Speculative programmatic tool calling (sPTC) for harnesses like RLM, CodeAct, etc.

market-pilot

JavaScript

63

Evidence-grounded market research prototype with traceable AI workflows.

jarvis

Shell

68

Jarvis meta-repository: shared docs, configs, and setup scripts

unlazy

JavaScript

95

Anti-laziness skill for AI agents. Core: the Depth Tree method, which splits a task N layers deep and gives every leaf the full time budget of the whole task, so effort multiplies with depth. Grounded in 2025-2026 research on model laziness, underthinking and premature completion.

MTPLX

Python

90

3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

OptMem

Python

72

Permanent memory for AI agents. A 426-token prompt, a script, plug and play.

waggle

Rust

67

Attributed, resolvable artifact references for agent handoffs — a ~30-byte token instead of pasted context. MCP-native; the reference layer for the agent-harness world.

agentacct

Python

77

See what your coding agents did and what it cost. Breaks each task down into work steps — tools used, files changed, tests run, time and tokens spent. Local-first dashboard for Claude Code, Codex, OpenCode, and more. No login, no telemetry.

appless

TypeScript

72

What if your phone had no apps

rome

TypeScript

77

Rome is the agentic OS.

evonic

Python

82

Open Agentic AI Platform - The home your agents deserve

lora-speedrun

Python

73

Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

CodeJury

Python

72

Terminal-first, knowledge-grounded multi-agent software delivery pipeline: scope requirements, implement changes, run tests, and gate pull requests with deterministic QA and ensemble code review.

ambient-context

Rust

73

A menu bar app that keeps a written record of what you worked on.

ECC

JavaScript

100

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.