4 Commits

Author	SHA1	Message	Date
Christian Medina	410718bc73	feat: add CPU offloading for 70GB → 17GB conversion	2026-07-02 22:33:36 -04:00
Christian Medina	bee6683396	feat: simple NF4 quantization with device_map=auto (proven method)	2026-07-02 22:32:38 -04:00
Christian Medina	52b93837f9	fix: use NF4 naming convention for quantized model	2026-07-02 22:00:15 -04:00
Christian Medina	2f997377f5	feat: add simple BnB 4-bit quantization script with device_map=auto	2026-07-02 21:57:02 -04:00