Projects tagged with dpo on GitHub.
2 projects
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
