Christian Medina
|
6bd6662f5f
|
docs: rename config and docs to reflect Ornith-35B model
|
2026-06-30 20:41:53 -04:00 |
|
Christian Medina
|
6f31fa0197
|
feat: add --check-only flag to validate setup without training
|
2026-06-30 20:39:29 -04:00 |
|
Christian Medina
|
83ba987840
|
fix: tokenizer -> processing_class SFTTrainer API change
|
2026-06-30 20:38:31 -04:00 |
|
Christian Medina
|
9d5d4eebc7
|
fix: mixed_precision -> bf16/api change
|
2026-06-30 20:34:05 -04:00 |
|
Christian Medina
|
9280103260
|
fix: evaluation_strategy -> eval_strategy API change
|
2026-06-30 20:29:03 -04:00 |
|
Christian Medina
|
50fa171f68
|
fix: use local model path instead of HuggingFace download
|
2026-06-30 20:24:44 -04:00 |
|
Christian Medina
|
7f7467ef89
|
fix: remove max_seq_length from TrainingArguments (passed to SFTTrainer)
|
2026-06-30 20:17:04 -04:00 |
|
Christian Medina
|
7181acc580
|
fix: save train/test.jsonl to output_dir not parent
|
2026-06-30 20:01:05 -04:00 |
|
Christian Medina
|
bbdbe91871
|
fix: fix dataset path calculation
|
2026-06-30 19:01:39 -04:00 |
|
Christian Medina
|
97004261f5
|
fix: multiple bug fixes - remove unused imports, fix typo, fix dataset paths, add ai command fallback
|
2026-06-30 18:48:46 -04:00 |
|
Christian Medina
|
75aeeeb20a
|
fix: use torchrun for distributed training, load model on CPU
|
2026-06-30 18:45:14 -04:00 |
|
Christian Medina
|
4f2f8ef03f
|
feat: use DeepSpeed ZeRO-3 for optimal 2-GPU training
|
2026-06-30 18:26:48 -04:00 |
|
Christian Medina
|
a04bf4a9cf
|
feat: add run_with_accelerate.sh helper script
|
2026-06-30 18:26:08 -04:00 |
|
Christian Medina
|
cd58ffd31e
|
fix: use FSDP for 2-GPU training, reduce batch size
|
2026-06-30 18:23:34 -04:00 |
|
Christian Medina
|
ef42e67183
|
fix: use CompressedTensors for Ornith, add torch import, expand LoRA targets
|
2026-06-30 17:54:35 -04:00 |
|
Christian Medina
|
2074d3d993
|
feat: use Ornith-1.0-35B-FP8 with multi-GPU support
|
2026-06-30 15:57:54 -04:00 |
|
Christian Medina
|
3d2ae812a7
|
feat: add deploy-and-train.sh script for server deployment
|
2026-06-30 15:02:13 -04:00 |
|
Christian Medina
|
418a4cc76d
|
init: add LoRA training infrastructure and 20k dataset
|
2026-06-30 14:49:44 -04:00 |
|