All topics

hardware-acceleration

Projects tagged with hardware-acceleration on GitHub.

16 projects

apex-inference-chip logo

apex-inference-chip

Python
68

An inference chip design that runs a real LLM (Qwen2.5-0.5B) on FPGA — one transformer decoder layer in RTL, every silicon value bit-exact against a golden model. 0.56 tok/s measured, a 140× climb, full evidence trail.

661+490Jan 21, 1970
viseron logo

viseron

Python
90

Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.

3.5k+400Jan 21, 1970
VirtualMacOniPad logo

VirtualMacOniPad

Objective-C
82

People have dreamed of running macOS on iPad for more than a decade. Today, that dream comes true. With Virtual Mac, iPad finally breaks free from iPadOS, enabling pro apps like Xcode, Terminal, Final Cut Pro, Logic Pro, and Pixelmator Pro to run directly on device. Requires iPad Pro (M1, M2) or iPad Air (M1) running iPadOS 14 up to 16.3.1.

1.4k+920Jan 21, 1970
Amagine3D logo

Amagine3D

Python
87

Amagine3D: From hardware requirements to editable 3D designs

1.4k0Jan 21, 1970
lora-speedrun logo

lora-speedrun

Python
73

Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

147+20Jan 21, 1970
LocalAI logo

LocalAI

Go
100

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

48.8k+1240Jan 21, 1970
local-llm logo

local-llm

Shell
70

Everything I know about running LLMs locally

1.8k+200Jan 21, 1970
AmberConsole logo

AmberConsole

JavaScript
72

A UI design system inspired by the 1970s

309+30Jan 21, 1970
bindwidth logo

bindwidth

JavaScript
72

Evidence-aware on-prem LLM inference sizing and TCO calculator

123+30Jan 21, 1970
vibepulse logo

vibepulse

C
72

ESP32-S3 AMOLED for Claude Code & Codex usage, live agent activity, and answerable NEEDS YOU alerts. Local-first macOS/Windows host; optional encrypted relays.

181+160Jan 21, 1970
Routario logo

Routario

Python
63

🛰️ Real-time fleet tracking, smart alerts, and sensor analytics

330Jan 21, 1970
linux logo

linux

C
90

Linux kernel source tree

245.5k+1.3k0Jan 21, 1970
MTPLX logo

MTPLX

Python
90

3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.

1.9k+4820Jan 21, 1970
try-omarchy logo

try-omarchy

Swift
92

Run Omarchy on MacOS without any setup.

1.1k0Jan 21, 1970
kiac logo

kiac

Go
82

Local Kubernetes on Apple's container framework - every node is its own lightweight VM. Metrics, storage, and LoadBalancer included.

358+90Jan 21, 1970
wardnet logo

wardnet

Rust
63

Wardnet is a self-hosted network privacy gateway that runs on linux (docker or bare metal). It sits alongside an existing home or small-office router, and acts as the warden of every device's connection to the internet

230Jan 21, 1970