cmedina/agenx-lora-training
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: disable gradient checkpointing (device mismatch with distributed MoE)

Browse Source
This commit is contained in:
Christian Medina
2026-07-02 17:29:19 -04:00
parent d9c3781242
commit 0456d55c8a
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
training/configs/ornith-35b-lora.yaml
View File

@@ -53,5 +53,5 @@ mixed_precision: bf16
# Evaluation (disable - no test split in dataset) # Evaluation (disable - no test split in dataset)
eval_strategy: "no" eval_strategy: "no"
# Gradient Checkpointing # Gradient Checkpointing (disable - causes device issues with distributed MoE)
gradient_checkpointing: true gradient_checkpointing: false