Christian Medina
|
e64515e3ca
|
refactor: switch from DeepSpeed ZeRO-3 to FSDP for QLoRA compatibility
|
2026-07-01 22:33:06 -04:00 |
|
Christian Medina
|
a655040db2
|
feat: use DeepSpeed ZeRO-3 for proper model sharding across GPUs
|
2026-07-01 22:08:37 -04:00 |
|
Christian Medina
|
9d8c2b6cf0
|
refactor: cleaner loading strategies with error tracking
|
2026-07-01 21:38:38 -04:00 |
|
Christian Medina
|
815115e97a
|
feat: add BnB 4-bit quantization strategy + use bf16 model
|
2026-07-01 21:14:31 -04:00 |
|
Christian Medina
|
e56ae5e002
|
fix: restore all strategies with CPU-first as primary
|
2026-07-01 18:16:51 -04:00 |
|
Christian Medina
|
f18a9f0973
|
fix: use aggressive CPU loading for memory optimization
|
2026-07-01 18:00:55 -04:00 |
|
Christian Medina
|
19f405255c
|
remove auto device map in training strategies
|
2026-07-01 16:50:48 -04:00 |
|
Christian Medina
|
cc353b3dea
|
refactor: restructure project - scripts at root level
|
2026-07-01 16:39:54 -04:00 |
|