llm-routing

ratel

Rust

77

Context engineering for AI agents. ~80% fewer tokens. Fix tool overload. Skills and memory with in-process BM25 and semantic retrieval. Progressive Disclosure. No vector DB.

voidllm

Go

72

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

klaatcode

TypeScript

77

Open-source AI coding agent for the terminal. Claude Code-grade accuracy with smart model routing — uses the right AI model for each task, cutting costs 10x. Supports Claude, GPT, Gemini, DeepSeek & more.

llm-space

TypeScript

90

A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.

awesome-llm-apps

Python

95

100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.

local-llm

Shell

77

Everything I know about running LLMs locally

llama.cpp

C++

90

LLM inference in C/C++

ctrlb-decompose

Rust

72

LLM-ready reasoning surface over logs

Investbrain

PHP

77

Smart LLM-enabled investment tracker that consolidates and monitors market performance across your different brokerages

chorus

TypeScript

72

Multi-LLM peer review for code decisions. Bring your own CLI; Chorus convenes 2-4 other LLMs to review the work before you ship.

shard

Python

77

Pipeline-parallel LLM inference across GPUs on separate machines.

tokenspeed

Python

85

TokenSpeed is a speed-of-light LLM inference engine.

MLX-LoRA-Studio

Swift

77

A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

inference-school

Swift

82

A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exercises, a native macOS Studio, and a complete companion book.

Photo-agents

Python

77

Autonomous self-evolving agents. Vision-grounded layered memory and self-written skills for LLM agents that operate your computer.

feeds.fun

Python

72

News reader with tags, scoring, and LLM

deja-vu

Go

77

Your agents already solved this. deja finds it — memory operations for fifteen coding agents: retroactive search and MCP recall (84.9% R@1 on LongMemEval-S, no LLM), trust scopes, curated notes with tags and lifecycle states, measured impact. One zero-dep binary, fully local.

harness

Swift

77

AI-driven user testing for iOS Simulator, macOS apps, and web apps. Write a goal in plain language; an LLM agent drives the UI and reports friction. macOS 14+, Swift 6.

ollama

Go

90

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

open-webui

Python

95

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

langchain

Python

95

The agent engineering platform.

deltafin

Python

77

Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

market-pilot

JavaScript

68

Evidence-grounded market research prototype with traceable AI workflows.

jarvis

Shell

68

Jarvis meta-repository: shared docs, configs, and setup scripts

LocalAI

Go

95

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

OptMem

Python

72

Permanent memory for AI agents. A 426-token prompt, a script, plug and play.

waggle

Rust

80

Attributed, resolvable artifact references for agent handoffs — a ~30-byte token instead of pasted context. MCP-native; the reference layer for the agent-harness world.

appless

TypeScript

82

What if your phone had no apps

evonic

Python

77

Open Agentic AI Platform - The home your agents deserve

lora-speedrun

Python

73

Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

CodeJury

Python

77

Terminal-first, knowledge-grounded multi-agent software delivery pipeline: scope requirements, implement changes, run tests, and gate pull requests with deterministic QA and ensemble code review.

ECC

JavaScript

95

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

transformers

Python

90

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

browser-use

Python

95

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

ragflow

Go

90

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

ponytail

JavaScript

95

Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.

openwiki

TypeScript

95

OpenWiki is a CLI that writes and maintains agent documentation for your codebase.

zep

Python

90

Zep | Examples, Integrations, & More

gemma-chat

TypeScript

80

Local AI chat + coding agent for Apple Silicon, powered by Gemma 4 via MLX / Supports Ollama

MTPLX

Python

82

3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

ai-copywriter

Python

87

An AI copywriter that uses real copywriting skills + real marketing knowledge with human tone.

SiliconScope

Swift

82

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

labs-OO-Agents

Python

77

labs-OO-agents

sample-specship

Shell

73

Spec-driven autonomous engineering workflow for AI coding agents: recon → plan → build → validate → ship — with TDD, adversarial validation, and anti-slop quality gates. Packaged as a Kiro Power.

mdflux

Svelte

77

Turn any document into clean, AI-ready Markdown. Local-first desktop app: reads scanned PDFs, batches folders, runs offline, and uses far fewer tokens than vision models.

forsy-trace-skill

Python

67

Open skill for capturing AI agent work as structured traces.

hermes-agent

Python

85

The agent that grows with you

AutoGPT

Python

95

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.