4 Commits

Author	SHA1	Message	Date
Christian Medina	b624e90b02	fix: use BnB quantize_batch to actually quantize weights	2026-07-02 20:22:39 -04:00
Christian Medina	3716051abc	fix: remove PEFT prepare (causes OOM)	2026-07-02 20:17:23 -04:00
Christian Medina	ac891fe25b	fix: replace with proper BnB 4-bit quantization script	2026-07-02 20:13:19 -04:00
Christian Medina	76ff09b140	feat: add BnB 4-bit quantization script	2026-07-02 20:04:44 -04:00