Christian Medina
|
f651ca030c
|
fix: convert warmup_ratio to warmup_steps (fix deprecation warning)
|
2026-07-01 07:37:47 -04:00 |
|
Christian Medina
|
f47944ee75
|
fix: remove quantization_config after loading to bypass SFTTrainer check
|
2026-07-01 07:36:38 -04:00 |
|
Christian Medina
|
86b401c12f
|
fix: convert FP8 to bf16 for PEFT compatibility
|
2026-07-01 07:30:10 -04:00 |
|
Christian Medina
|
9d92531c55
|
fix: use Ornith-1.0-35B bf16 base model (PEFT compatible)
|
2026-07-01 07:28:21 -04:00 |
|
Christian Medina
|
05ace2d38f
|
fix: load NVFP4 as bf16 by overriding quantization config
|
2026-07-01 07:27:13 -04:00 |
|
Christian Medina
|
be7b589c6b
|
fix: use BitsAndBytes INT4 for PEFT compatibility
|
2026-07-01 00:34:34 -04:00 |
|
Christian Medina
|
d7301d37dd
|
fix: use float16 dtype to preserve NVFP4 quantization
|
2026-07-01 00:08:42 -04:00 |
|
Christian Medina
|
af09d47c6f
|
fix: load model to CPU first, let DeepSpeed distribute
|
2026-07-01 00:03:24 -04:00 |
|
Christian Medina
|
905c2ba30d
|
fix: preserve NVFP4 quantization, don't force bf16
|
2026-06-30 23:50:27 -04:00 |
|
Christian Medina
|
114e25fcfb
|
fix: use device_map=auto to distribute model across GPUs
|
2026-06-30 23:45:57 -04:00 |
|
Christian Medina
|
3bb7328e2a
|
fix: disable quantization config for fp8 model training
|
2026-06-30 22:41:28 -04:00 |
|
Christian Medina
|
d8ad31fd03
|
fix: remove max_seq_length from SFTTrainer (newer TRL API)
|
2026-06-30 20:59:24 -04:00 |
|
Christian Medina
|
8ad87f0e7e
|
fix: remove dataset_text_field (dataset pre-formatted)
|
2026-06-30 20:48:07 -04:00 |
|
Christian Medina
|
6f31fa0197
|
feat: add --check-only flag to validate setup without training
|
2026-06-30 20:39:29 -04:00 |
|
Christian Medina
|
83ba987840
|
fix: tokenizer -> processing_class SFTTrainer API change
|
2026-06-30 20:38:31 -04:00 |
|
Christian Medina
|
9d5d4eebc7
|
fix: mixed_precision -> bf16/api change
|
2026-06-30 20:34:05 -04:00 |
|
Christian Medina
|
9280103260
|
fix: evaluation_strategy -> eval_strategy API change
|
2026-06-30 20:29:03 -04:00 |
|
Christian Medina
|
7f7467ef89
|
fix: remove max_seq_length from TrainingArguments (passed to SFTTrainer)
|
2026-06-30 20:17:04 -04:00 |
|
Christian Medina
|
bbdbe91871
|
fix: fix dataset path calculation
|
2026-06-30 19:01:39 -04:00 |
|
Christian Medina
|
97004261f5
|
fix: multiple bug fixes - remove unused imports, fix typo, fix dataset paths, add ai command fallback
|
2026-06-30 18:48:46 -04:00 |
|
Christian Medina
|
75aeeeb20a
|
fix: use torchrun for distributed training, load model on CPU
|
2026-06-30 18:45:14 -04:00 |
|
Christian Medina
|
4f2f8ef03f
|
feat: use DeepSpeed ZeRO-3 for optimal 2-GPU training
|
2026-06-30 18:26:48 -04:00 |
|
Christian Medina
|
cd58ffd31e
|
fix: use FSDP for 2-GPU training, reduce batch size
|
2026-06-30 18:23:34 -04:00 |
|
Christian Medina
|
ef42e67183
|
fix: use CompressedTensors for Ornith, add torch import, expand LoRA targets
|
2026-06-30 17:54:35 -04:00 |
|
Christian Medina
|
2074d3d993
|
feat: use Ornith-1.0-35B-FP8 with multi-GPU support
|
2026-06-30 15:57:54 -04:00 |
|
Christian Medina
|
418a4cc76d
|
init: add LoRA training infrastructure and 20k dataset
|
2026-06-30 14:49:44 -04:00 |
|