cmedina/agenx-lora-training
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: convert warmup_ratio to warmup_steps (fix deprecation warning)

Browse Source
This commit is contained in:
Christian Medina
2026-07-01 07:37:47 -04:00
parent f47944ee75
commit f651ca030c
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
training/scripts/train.py
View File

@@ -86,7 +86,7 @@ def train(config_path):
learning_rate=config["train_params"]["learning_rate"], learning_rate=config["train_params"]["learning_rate"],
lr_scheduler_type=config["train_params"]["lr_scheduler_type"], lr_scheduler_type=config["train_params"]["lr_scheduler_type"],
weight_decay=config["train_params"]["weight_decay"], weight_decay=config["train_params"]["weight_decay"],
warmup_ratio=config["train_params"]["warmup_ratio"], warmup_steps=int(config["train_params"]["warmup_ratio"] * config["train_params"]["num_train_epochs"] * len(dataset["train"]) // config["train_params"]["per_device_train_batch_size"]),
logging_steps=config["train_params"]["logging_steps"], logging_steps=config["train_params"]["logging_steps"],
save_steps=config["train_params"]["save_steps"], save_steps=config["train_params"]["save_steps"],
save_total_limit=config["train_params"]["save_total_limit"], save_total_limit=config["train_params"]["save_total_limit"],