Commit Graph

58 Commits

Author SHA1 Message Date
Christian Medina
75aeeeb20a fix: use torchrun for distributed training, load model on CPU 2026-06-30 18:45:14 -04:00
Christian Medina
4f2f8ef03f feat: use DeepSpeed ZeRO-3 for optimal 2-GPU training 2026-06-30 18:26:48 -04:00
Christian Medina
a04bf4a9cf feat: add run_with_accelerate.sh helper script 2026-06-30 18:26:08 -04:00
Christian Medina
cd58ffd31e fix: use FSDP for 2-GPU training, reduce batch size 2026-06-30 18:23:34 -04:00
Christian Medina
ef42e67183 fix: use CompressedTensors for Ornith, add torch import, expand LoRA targets 2026-06-30 17:54:35 -04:00
Christian Medina
2074d3d993 feat: use Ornith-1.0-35B-FP8 with multi-GPU support 2026-06-30 15:57:54 -04:00
Christian Medina
3d2ae812a7 feat: add deploy-and-train.sh script for server deployment 2026-06-30 15:02:13 -04:00
Christian Medina
418a4cc76d init: add LoRA training infrastructure and 20k dataset 2026-06-30 14:49:44 -04:00