Commit Graph

3 Commits

Author SHA1 Message Date
Christian Medina
b9f6ddaf50 fix: free GPU memory after each quantization 2026-07-02 22:41:52 -04:00
Christian Medina
1751d33f69 fix: load shard to CPU, quantize on GPU 2026-07-02 22:40:31 -04:00
Christian Medina
d769d39865 feat: add single shard test script 2026-07-02 22:39:25 -04:00