Commit Graph

3 Commits

Author SHA1 Message Date
Christian Medina
bee6683396 feat: simple NF4 quantization with device_map=auto (proven method) 2026-07-02 22:32:38 -04:00
Christian Medina
52b93837f9 fix: use NF4 naming convention for quantized model 2026-07-02 22:00:15 -04:00
Christian Medina
2f997377f5 feat: add simple BnB 4-bit quantization script with device_map=auto 2026-07-02 21:57:02 -04:00