agent-evaluation
Projects tagged with agent-evaluation on GitHub.
238 projects
forsy-trace-skill
PythonOpen skill for capturing AI agent work as structured traces.
llm-space
TypeScriptA desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.
better-harness
JavaScriptAn open-source Harness Engineering platform for coding agents—define harnesses as code, run controlled experiments, inspect evidence, and compare outcomes.
FrontierAgent
Python🧩 FrontierAgent, our agent framework, open-sourced alongside it — native command-line TUI, ReAct and Agent Team modes, one command on macOS and Linux, no preinstall, no hard Docker dependency.
RealReplicaBench
HTMLCommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of Real Online Services
bindwidth
JavaScriptEvidence-aware on-prem LLM inference sizing and TCO calculator
agent-rules-books
AGENTS.md rules / skills for AI coding agents: Codex, Cursor & Claude Code. Inspired by Clean Code, Refactoring, DDD, Clean Architecture and DDIA programming books.
waku-agent
PythonWaku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.
agent-apprenticeship
PythonThe living ecosystem where AI agents complete tasks through workflow loops, improve through iterative execution, are evaluated by mentor agents or humans in the loop, and turn completed work into reusable work experience and data to improve future agents.
agent-apprenticeship
PythonThe living ecosystem where AI agents complete tasks through workflow loops, improve through iterative execution, are evaluated by mentor agents or humans in the loop, and turn completed work into reusable work experience and data to improve future agents.
agent-skills
PythonUseful skills for agents and claws.
agent-as-a-router
TypeScriptThe official implementations of Agent-as-a-Router: Agentic Model Routing for Coding Tasks.
awesome-gamedev-agent-skills
Python67 game-dev skills for AI coding agents — Godot, Unity, Unreal, Phaser, PixiJS, three.js, Bevy, pygame, LÖVE, Roblox. Portable SKILL.md Agent Skills (the format Anthropic launched as Claude Skills), with a router that loads the right skill for your engine and task. Runs in Claude Code, Cursor, Kiro, Codex, Copilot, Gemini CLI and more.
hermes-agent
PythonThe agent that grows with you
fullstack-agent
BatchfileGive your AI a full stack: memory, voice, face, and hands. This is the "I want an AI agent" shortcut. It sets up the entire jaredrhod stack for you with an installation wizard. Select which pieces you want or do it all!
launch-your-agent
HTMLClaude Code skills that take a founder from idea to a live Claude Managed Agent: interview, scope a v0, launch in their own account, grade it, iterate, and schedule it
skills
PythonPublic repository for Agent Skills
ponytail
JavaScriptMakes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
ragflow
GoRAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
omnigent
PythonOmnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.
trueforge
TypeScriptThe open-source agent harness - the runtime layer that turns an LLM into a working agent.
devspace
TypeScriptMinimal Coding Agent Harness over MCP for ChatGPT, Claude, Hermes, Grok Bot, OpenClaw
maka
TypeScriptApache Maka (Incubating) is a local-first AI agent workspace. Model messages, tool calls, tool results, permission decisions, and termination events are recorded as an append-only log.
loopy
JavaScriptA library of practical AI-agent loops and an installable skill for finding, adapting, and designing repeatable agent workflows.
loop-library
JavaScriptA library of practical AI-agent loops and an installable skill for finding, adapting, and designing repeatable agent workflows.
AgentsMesh
GoThe AI Agent Workforce Platform. Run a hundred AI coding agents across your own machines — schedule, isolate, and steer them all from one console.
delegate-skills
JavaScriptDelegate a coding task to a separate coding agent CLI, review the diff, land the commit yourself — one per implementer.
OpenChatCut
TypeScriptOpen-source, local-first conversational AI video editor with a professional multi-track timeline, Agent Skills, MCP integration, and Remotion rendering.
threejs-game-skills
PythonAgent skills for building playable, polished Three.js browser games with gameplay, AAA-style graphics, UI, QA, and optional AI-generated 3D, image, and audio assets.
numbat
GoVisibility into AI agent activity on endpoints, with on-device detection, optional pre-action blocking, and forensic reconstruction.
autoprompt-skill
JavaScriptAutoprompt is a coding-agent skill that cuts failures by 45% on agentic coding tasks.
looper
PythonDesign visual, review-gated agent loops for Claude Code before you run them.
Browser-BC
TypeScriptAgent behavior clone for browser using, targeting general GUI using and distributed trajectory collecting.
good-question
PowerShellA portable agent skill for sharpening research questions.
nopus
TypeScriptDeterministic prose checks for clearer coding-agent responses
lazyskills
Gomission control for agent skills
whathappened
Agent skill: adaptive X-only briefing of what happened + public opinion + debates
marketing-studio
JavaScriptAgent-driven marketing studio for Claude Code: one /marketing command renders your product's full launch asset suite (logo reveal, demo, launch video, social clips, OG assets)
loop.js
TypeScriptA loop engineering framework — state a Goal; Rounds run until a skeptical, read-only Verify agent settles it.
Jixu
TypeScriptDurable single-Agent Harness for TypeScript: recoverable Threads, context continuity, explicit side effects, and a native TUI.
optim-plans
PythonHuman-in-the-loop planning plugin for Claude and Codex: turn ideas into reviewed Markdown plans, record decisions, enforce explicit execution gates, and provide tested controller primitives for safer agent workflows.
ECC
JavaScriptThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
claw-code
RustAn agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.
langchain
PythonThe agent engineering platform.
pi
TypeScriptAI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
openbot
TypeScriptOpen-source AI coworkers that each get a computer of their own: a browser, files and tools, with every action decided before it happens and recorded after. Bring any AG-UI agent.
cumora
TypeScriptWhere agent teams gather. Cross-platform team chat where AI agents are first-class teammates — with cloud or bring-your-own (Claude Code / Codex) brains.
fx
ZigUnix like coding agent