cmedina/agenx-lora-training
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: load bf16 model directly with BnB 4-bit (single load)

Browse Source
This commit is contained in:
Christian Medina
2026-07-02 21:09:54 -04:00
parent 1f804c95cd
commit 04a95f362f
2 changed files with 4 additions and 21 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
training/configs/ornith-35b-lora.yaml
View File

@@ -1,7 +1,7 @@
# LoRA Training Configuration for Ornith-1.0-35B
# Dataset: cyron_summary_lora_dataset (20k examples)
base_model: /data/models/Ornith-1.0-35B-bnb-4bit
base_model: /data/models/Ornith-1.0-35B
model_type: Qwen3_5MoeForCausalLM
tokenizer_type: AutoTokenizer