All topics

on-prem

Projects tagged with on-prem on GitHub.

103 projects

bindwidth logo

bindwidth

JavaScript
77

Evidence-aware on-prem LLM inference sizing and TCO calculator

1280Jan 21, 1970
f360-vision logo

f360-vision

PowerShell
68

Self-hosted 3D point cloud & panorama viewer for industrial environments - free desktop app, Docker/on-premise server, or use in your browser

19+30Jan 21, 1970
LocalAI logo

LocalAI

Go
95

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

48.1k+1790Jan 21, 1970
token-diet logo

token-diet

Shell
63

Always-on token-efficiency skill for coding agents (Claude Code, Codex, Cursor, Windsurf, Cline). ~31% lower bill on average, no loss of correctness.

5140Jan 21, 1970
VirtualMacOniPad logo

VirtualMacOniPad

Objective-C
77

People have dreamed of running macOS on iPad for more than a decade. Today, that dream comes true. With Virtual Mac, iPad finally breaks free from iPadOS, enabling pro apps like Xcode and Terminal to run directly on device. Requires iPad Pro (M1, M2) or iPad Air (M1) running iPadOS 16 up to 16.3.1.

4450Jan 21, 1970
dify logo

dify

TypeScript
95

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

151.5k+8850Jan 21, 1970
neovim logo

neovim

Vim Script
90

Vim-fork focused on extensibility and usability

101.4k0Jan 21, 1970
voidauth logo

voidauth

TypeScript
82

Single Sign-On for Your Self-Hosted Universe

2.4k+120Jan 21, 1970
MTPLX logo

MTPLX

Python
82

3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

1.1k+420Jan 21, 1970
deltafin logo

deltafin

Python
77

Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

5950Jan 21, 1970
world-model-optimizer logo

world-model-optimizer

Python
62

Build continually improving models on your agent traces by distilling frontier open models

320+250Jan 21, 1970
kiac logo

kiac

Go
82

Local Kubernetes on Apple's container framework - every node is its own lightweight VM. Metrics, storage, and LoadBalancer included.

306+420Jan 21, 1970
ntfsmac logo

ntfsmac

Swift
82

NTFS read/write on Apple Silicon macOS — no kernel extension, no SIP modification.

2750Jan 21, 1970
inference-school logo

inference-school

Swift
82

A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exercises, a native macOS Studio, and a complete companion book.

182+40Jan 21, 1970
KeibiDrop logo

KeibiDrop

Go
63

Share files between devices on demand. They show up as a folder on your computer, available instantly while downloading.

490Jan 21, 1970
clash-verge-rev logo

clash-verge-rev

TypeScript
95

A modern GUI client based on Tauri, designed to run in Windows, macOS and Linux for tailored proxy experience

135.5k+1.4k0Jan 21, 1970
numbat logo

numbat

Go
82

Visibility into AI agent activity on endpoints, with on-device detection, optional pre-action blocking, and forensic reconstruction.

5900Jan 21, 1970
shard logo

shard

Python
77

Pipeline-parallel LLM inference across GPUs on separate machines.

433+50Jan 21, 1970
camelAI logo

camelAI

TypeScript
77

camelAI — an AI coding assistant platform built on Cloudflare Workers and Durable Objects

3200Jan 21, 1970
sakura-crossing logo

sakura-crossing

JavaScript
77

An explorable Japanese suburban railway-crossing neighbourhood on a small planet, rendered 3D-to-2D as a cel-shaded anime background. Three.js, no image assets.

307+500Jan 21, 1970
bookbag logo

bookbag

Python
63

Fork of Calibre-Web Focused on UI and UX improvements.

61+10Jan 21, 1970
awesome-selfhosted logo

awesome-selfhosted

90

A list of Free Software network services and web applications which can be hosted on your own servers

310.8k+2.1k0Jan 21, 1970
aval logo

aval

TypeScript
87

A new open-source format for interactive video on the web, with a built-in state machine, frame-accurate transitions, and packed-alpha transparency.

1.3k0Jan 21, 1970
dao-code logo

dao-code

TypeScript
87

Open-source TypeScript terminal coding agent for DeepSeek-V4 — builds on DeepSeek's strong price-performance and ultra-cheap cache pricing, engineering byte-stable prefixes and cache-reusing forks so cross-session memory and a continuous self-correction layer add almost no token cost; 1M context, Skills/MCP/Hooks, Claude Code config compatible.

1.3k0Jan 21, 1970
mindwalk logo

mindwalk

Go
87

A visualization tool that replays coding-agent sessions on a 3D map of your codebase.

1.1k0Jan 21, 1970
waku-agent logo

waku-agent

Python
80

Waku Waku! Waku agent is your personal AI agent, on your own laptop, in code you can read in an afternoon — harness + loop + memory + eval

7360Jan 21, 1970
gh-dashboard logo

gh-dashboard

TypeScript
82

Open-source Git dashboard built for GIthub and Forgejo on REST and GraphQL APIs: repositories, issues, pull requests, traffic, Actions, contributors, dependents, and a kanban board view.

377+170Jan 21, 1970
MLX-LoRA-Studio logo

MLX-LoRA-Studio

Swift
77

A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

251+60Jan 21, 1970
httpinspect logo

httpinspect

JavaScript
72

top, but for the HTTP endpoints on your host — a live dashboard of the most active plaintext HTTP endpoints, right in the terminal.

222+30Jan 21, 1970
TurboVLA logo

TurboVLA

Python
82

TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM

2080Jan 21, 1970
Noustiny logo

Noustiny

TypeScript
59

An agent native video creation pipeline that runs on top of Hermes Agent

177+10Jan 21, 1970
sigwire logo

sigwire

JavaScript
63

tail -f for signals. Every signal any process on the box raises — who sent it, who it hit, which signal, how it was raised (kill(2), the kernel, a POSIX timer), whether the target caught it and how long its handler ran, whether it tore a blocked syscall out with EINTR.

1580Jan 21, 1970
wardnet logo

wardnet

Rust
63

Wardnet is a self-hosted network privacy gateway that runs on linux (docker or bare metal). It sits alongside an existing home or small-office router, and acts as the warden of every device's connection to the internet

22+70Jan 21, 1970
PowerToys logo

PowerToys

C
90

Microsoft PowerToys is a collection of utilities that supercharge productivity and customization on Windows

137.4k+7090Jan 21, 1970
nimbus logo

nimbus

TypeScript
82

Docs for humans and agents, built on Astro

8780Jan 21, 1970
rockbox-zig logo

rockbox-zig

C
73

A modern, network-enabled music player platform built on Rockbox technology https://www.rockbox.org

2860Jan 21, 1970
Token-Saver logo

Token-Saver

Python
77

A local Claude Desktop extension to query large PDFs with 92–98% fewer tokens. Performs local hybrid search, cites exact page numbers, and keeps your documents private on your machine

1090Jan 21, 1970
AutoGPT logo

AutoGPT

Python
95

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

185.8k+1120Jan 21, 1970
sidekick logo

sidekick

Go
77

Bare metal to production ready in mins; your own fly server on your VPS.

7.5k0Jan 21, 1970
agentic-inbox logo

agentic-inbox

TypeScript
77

A self-hosted email client with an AI agent, running entirely on Cloudflare Workers

6.7k+4140Jan 21, 1970
beautiful-html-templates logo

beautiful-html-templates

HTML
85

A library of HTML slide templates designed so any coding agent can pick the right one and produce a beautiful deck on the user's behalf, automatically.

4.0k+2560Jan 21, 1970
Audar-ASR-V1 logo

Audar-ASR-V1

Python
73

Arabic-first generative speech recognition — Audar-ASR-V1 (Flash + Turbo). #1 on the Open Universal Arabic ASR Leaderboard. Model cards, benchmarks & inference.

5610Jan 21, 1970
Soup logo

Soup

Python
72

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

3350Jan 21, 1970
yap logo

yap

Swift
82

Free, open source voice dictation for macOS. On-device transcription with Apple's Speech framework. No cloud, no API keys, no account.

3210Jan 21, 1970
opentax-engine logo

opentax-engine

JavaScript
82

The deterministic tax engine for AI agents. Highest score ever recorded on TaxCalcBench (96% exact returns)

1330Jan 21, 1970
Lexicon logo

Lexicon

JavaScript
68

The free open source Grammarly alternative offline writing assistant assist with grammar, rewriting & tone entirely on your machine.

840Jan 21, 1970
bootstrap logo

bootstrap

MDX
95

The most popular HTML, CSS, and JavaScript framework for developing responsive, mobile first projects on the web.

174.6k+240Jan 21, 1970
HelloGitHub logo

HelloGitHub

Python
85

:octocat: 分享 GitHub 上有趣、入门级的开源项目。Share interesting, entry-level open source projects on GitHub.

169.3k+1.1k0Jan 21, 1970
on-prem Open Source Projects | MushyBook