cmedina/agenx-lora-training
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: load bf16 model, quantize with BnB on CPU, move to GPU

Browse Source
This commit is contained in:
Christian Medina committed 2026-07-02 19:55:01 -04:00
1 parent a0f4f644b0
commit 3c31e4dfb0
2 files changed
+37 -10
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

training/configs/ornith-35b-lora.yaml
+1 -1
View File
@@ -1,7 +1,7 @@
# LoRA Training Configuration for Ornith-1.0-35B
# Dataset: cyron_summary_lora_dataset (20k examples)
base_model: /data/models/Ornith-1.0-35B-4bit
base_model: /data/models/Ornith-1.0-35B
model_type: Qwen3_5MoeForCausalLM
tokenizer_type: AutoTokenizer