gpu

shard

Python

72

Pipeline-parallel LLM inference across GPUs on separate machines.

reims-vgpu

Rust

77

reims-vgpu is an experimental virtual GPU for macOS guests

pytorch

Python

90

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Soup

Python

90

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

LocalAI

Go

100

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Wake

Rust

82

All your AI agent sessions in one place — browse, search, resume. Rust + GPUI.

snowflow_demo

JavaScript

75

A real-time procedural snow rendering demo built with WebGPU, Babylon.js and hand-written WGSL. Features GPU-generated terrain, snow deformation, procedural characters, cloth, surf wakes, water spells, atmosphere and post-processing—without textures, meshes, HDRIs or animation assets.

hayamimi

Python

72

早耳 - Real-time multilingual speech-to-text on CPU only. Live subtitles, browser dashboard, speaker labels, translation. No GPU, no cloud.

SiliconScope

Swift

82

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

diri

Rust

82

Native macOS orchestrator for coding agents — run Claude Code, Codex, Cursor, Gemini and shells in parallel across git worktrees and remote hosts

MoonEP

Python

85

MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts

local-llm

Shell

70

Everything I know about running LLMs locally

ai-trains-ai

Python

67

RL-training an AI agent to RL-train AI agents.

qwen-scribe

Python

73

Private, local transcription and system-wide dictation for Apple Silicon.

hermes-agent

Python

90

The agent that grows with you

pyre-code

Python

77

A self-hosted ML coding practice platform. 68 problems from ReLU to flow matching — attention, training, RLHF, diffusion, and more. Instant feedback in the browser.