vllm

tokenspeed

Python

90

TokenSpeed is a speed-of-light LLM inference engine.

pyre-code

Python

77

A self-hosted ML coding practice platform. 68 problems from ReLU to flow matching — attention, training, RLHF, diffusion, and more. Instant feedback in the browser.