llm-proxy

voidllm

Go

72

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

llm-space

TypeScript

90

A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.

awesome-llm-apps

Python

95

100+ AI Agent & RAG apps you can actually run — clone, customize, ship.

local-llm

Shell

77

Everything I know about running LLMs locally

llama.cpp

C++

90

LLM inference in C/C++

Investbrain

PHP

77

Smart LLM-enabled investment tracker that consolidates and monitors market performance across your different brokerages

chorus

TypeScript

72

Multi-LLM peer review for code decisions. Bring your own CLI; Chorus convenes 2-4 other LLMs to review the work before you ship.

shard

Python

77

Pipeline-parallel LLM inference across GPUs on separate machines.

tokenspeed

Python

85

TokenSpeed is a speed-of-light LLM inference engine.

MLX-LoRA-Studio

Swift

77

A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

inference-school

Swift

82

A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exercises, a native macOS Studio, and a complete companion book.

Photo-agents

Python

77

Autonomous self-evolving agents. Vision-grounded layered memory and self-written skills for LLM agents that operate your computer.

feeds.fun

Python

72

News reader with tags, scoring, and LLM

deja-vu

Go

77

Your agents already solved this. deja finds it — memory operations for fifteen coding agents: retroactive search and MCP recall (84.9% R@1 on LongMemEval-S, no LLM), trust scopes, curated notes with tags and lifecycle states, measured impact. One zero-dep binary, fully local.

harness

Swift

77

AI-driven user testing for iOS Simulator, macOS apps, and web apps. Write a goal in plain language; an LLM agent drives the UI and reports friction. macOS 14+, Swift 6.

ollama

Go

90

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

open-webui

Python

95

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

langchain

Python

95

The agent engineering platform.

market-pilot

JavaScript

68

Evidence-grounded market research prototype with traceable AI workflows.

jarvis

Shell

68

Jarvis meta-repository: shared docs, configs, and setup scripts

LocalAI

Go

95

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

waggle

Rust

80

Attributed, resolvable artifact references for agent handoffs — a ~30-byte token instead of pasted context. MCP-native; the reference layer for the agent-harness world.

appless

TypeScript

82

What if your phone had no apps

evonic

Python

77

Open Agentic AI Platform - The home your agents deserve

lora-speedrun

Python

73

Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

ECC

JavaScript

95

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

transformers

Python

90

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

browser-use

Python

95

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

ragflow

Go

90

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

ponytail

JavaScript

95

Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.

openwiki

TypeScript

95

OpenWiki is a CLI that writes and maintains agent documentation for your codebase.

zep

Python

90

Zep | Examples, Integrations, & More

gemma-chat

TypeScript

80

Local AI chat + coding agent for Apple Silicon, powered by Gemma 4 via MLX / Supports Ollama

MTPLX

Python

82

3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

SiliconScope

Swift

82

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

sample-specship

Shell

73

Spec-driven autonomous engineering workflow for AI coding agents: recon → plan → build → validate → ship — with TDD, adversarial validation, and anti-slop quality gates. Packaged as a Kiro Power.

mdflux

Svelte

77

Turn any document into clean, AI-ready Markdown. Local-first desktop app: reads scanned PDFs, batches folders, runs offline, and uses far fewer tokens than vision models.

forsy-trace-skill

Python

67

Open skill for capturing AI agent work as structured traces.

hermes-agent

Python

85

The agent that grows with you

AutoGPT

Python

95

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

prompts.chat

HTML

95

f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.

firecrawl

TypeScript

95

The API to search, scrape, and interact with the web at scale. 🔥

dify

TypeScript

95

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

unsloth

Python

90

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

omnigent

Python

85

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.

Flawless

Python

80

AI SRE AgenticOps for Kubernetes and cloud infrastructure.

loop.js

TypeScript

68

A loop engineering framework — state a Goal; Rounds run until a skeptical, read-only Verify agent settles it.

Flowise

TypeScript

90

Build AI Agents, Visually