Projects tagged with sizing on GitHub.
2 projects
Evidence-aware on-prem LLM inference sizing and TCO calculator
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.