on-device-ai
Projects tagged with on-device-ai on GitHub.
80 projects
MLX-LoRA-Studio
SwiftA native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
openclaw
TypeScriptYour own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
wardnet
RustWardnet is a self-hosted network privacy gateway that runs on linux (docker or bare metal). It sits alongside an existing home or small-office router, and acts as the warden of every device's connection to the internet
KeibiDrop
GoShare files between devices on demand. They show up as a folder on your computer, available instantly while downloading.
token-diet
ShellAlways-on token-efficiency skill for coding agents (Claude Code, Codex, Cursor, Windsurf, Cline). ~31% lower bill on average, no loss of correctness.
dify
TypeScriptBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
voidauth
TypeScriptSingle Sign-On for Your Self-Hosted Universe
MTPLX
Python3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
kiac
GoLocal Kubernetes on Apple's container framework - every node is its own lightweight VM. Metrics, storage, and LoadBalancer included.
ntfsmac
SwiftNTFS read/write on Apple Silicon macOS — no kernel extension, no SIP modification.
inference-school
SwiftA hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exercises, a native macOS Studio, and a complete companion book.
clash-verge-rev
TypeScriptA modern GUI client based on Tauri, designed to run in Windows, macOS and Linux for tailored proxy experience
shard
PythonPipeline-parallel LLM inference across GPUs on separate machines.
bookbag
PythonFork of Calibre-Web Focused on UI and UX improvements.
awesome-selfhosted
A list of Free Software network services and web applications which can be hosted on your own servers
dao-code
TypeScriptOpen-source TypeScript terminal coding agent for DeepSeek-V4 — builds on DeepSeek's strong price-performance and ultra-cheap cache pricing, engineering byte-stable prefixes and cache-reusing forks so cross-session memory and a continuous self-correction layer add almost no token cost; 1M context, Skills/MCP/Hooks, Claude Code config compatible.
aval
TypeScriptA new open-source format for interactive video on the web, with a built-in state machine, frame-accurate transitions, and packed-alpha transparency.
mindwalk
GoA visualization tool that replays coding-agent sessions on a 3D map of your codebase.
waku-agent
PythonWaku Waku! Waku agent is your personal AI agent, on your own laptop, in code you can read in an afternoon — harness + loop + memory + eval
gh-dashboard
TypeScriptOpen-source Git dashboard built for GIthub and Forgejo on REST and GraphQL APIs: repositories, issues, pull requests, traffic, Actions, contributors, dependents, and a kanban board view.
httpinspect
JavaScripttop, but for the HTTP endpoints on your host — a live dashboard of the most active plaintext HTTP endpoints, right in the terminal.
Noustiny
TypeScriptAn agent native video creation pipeline that runs on top of Hermes Agent
sigwire
JavaScripttail -f for signals. Every signal any process on the box raises — who sent it, who it hit, which signal, how it was raised (kill(2), the kernel, a POSIX timer), whether the target caught it and how long its handler ran, whether it tore a blocked syscall out with EINTR.
PowerToys
CMicrosoft PowerToys is a collection of utilities that supercharge productivity and customization on Windows
rockbox-zig
CA modern, network-enabled music player platform built on Rockbox technology https://www.rockbox.org
AutoGPT
PythonAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
sidekick
GoBare metal to production ready in mins; your own fly server on your VPS.
agentic-inbox
TypeScriptA self-hosted email client with an AI agent, running entirely on Cloudflare Workers
beautiful-html-templates
HTMLA library of HTML slide templates designed so any coding agent can pick the right one and produce a beautiful deck on the user's behalf, automatically.
Audar-ASR-V1
PythonArabic-first generative speech recognition — Audar-ASR-V1 (Flash + Turbo). #1 on the Open Universal Arabic ASR Leaderboard. Model cards, benchmarks & inference.
f360-vision
PowerShellSelf-hosted 3D point cloud & panorama viewer for industrial environments - free desktop app, Docker/on-premise server, or use in your browser
bootstrap
MDXThe most popular HTML, CSS, and JavaScript framework for developing responsive, mobile first projects on the web.
HelloGitHub
Python:octocat: 分享 GitHub 上有趣、入门级的开源项目。Share interesting, entry-level open source projects on GitHub.
LocalAI
GoLocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Pythia
TypeScriptOne local API call gives your agent the entire live state of the planet — every major world event at once, plus forecasts. 40+ free keyless feeds, runs entirely on Ollama. No cloud, no cost. Keyless live feeds into one global view and forecasts what’s likely next. No cloud, no keys, no cost. 1d,1w,1m,1y predictions by Mirofish.
deja-vu
GoYour agents already solved this. deja finds it — memory operations for fifteen coding agents: retroactive search and MCP recall (84.9% R@1 on LongMemEval-S, no LLM), trust scopes, curated notes with tags and lifecycle states, measured impact. One zero-dep binary, fully local.
tuistore
Python🛍️ The TUI app store — browse, search & one-key-install hundreds of terminal apps. Built on ricekit, seeded from awesome-tuis.
viseron
PythonSelf-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.
tech-interview-handbook
TypeScriptCurated coding interview preparation materials for busy software engineers
awesome-llm-apps
Python100+ AI Agent & RAG apps you can actually run — clone, customize, ship.
agent-skills
PythonUseful skills for agents and claws.
Brand-building-skills
ShellBrand building skills for Claude Code and AI agents. strategy, naming, identity, voice, positioning, messaging, auditing, and launch
ollama
GoGet up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
ps5-linux-loader
CLinux payload implementing HV exploits to run a custom bootloader
launch-your-agent
HTMLClaude Code skills that take a founder from idea to a live Claude Managed Agent: interview, scope a v0, launch in their own account, grade it, iterate, and schedule it
nativ
SwiftLocal AI, native to your Mac. Chat, serve, monitor, and connect MLX models from one macOS app.
ai-trains-ai
PythonRL-training an AI agent to RL-train AI agents.
inky-bird-frame
PythonLocation-neutral bird field-journal plates for Pimoroni Inky displays