Christian Medina
|
b4538c013b
|
fix: use 1-indexing for shard names (model-00001-of-00016)
|
2026-07-03 00:15:39 -04:00 |
|
Christian Medina
|
50623cdcd0
|
fix: use 0-indexing consistently (shard 0-15)
|
2026-07-03 00:14:57 -04:00 |
|
Christian Medina
|
262b1181b7
|
fix: skip to first unsaved shard, fix GPU assignment
|
2026-07-02 23:39:24 -04:00 |
|
Christian Medina
|
b742b5549e
|
fix: alternate GPUs for each shard (0,1,0,1)
|
2026-07-02 23:32:38 -04:00 |
|
Christian Medina
|
78817532ad
|
fix: import concurrent.futures at top level
|
2026-07-02 23:27:14 -04:00 |
|
Christian Medina
|
bc3bc6d6eb
|
feat: process 8 shards at once (4 per GPU) with better logging
|
2026-07-02 23:24:48 -04:00 |
|
Christian Medina
|
9e2c7bec8d
|
fix: remove duplicate sequential code
|
2026-07-02 23:12:03 -04:00 |
|
Christian Medina
|
7040c84618
|
feat: process 2 shards at a time (one per GPU)
|
2026-07-02 23:05:57 -04:00 |
|
Christian Medina
|
d698a32f0f
|
feat: skip already processed shards (resume support)
|
2026-07-02 23:04:52 -04:00 |
|
Christian Medina
|
d1f0c81ac4
|
fix: remove quant_states reference
|
2026-07-02 22:52:49 -04:00 |
|
Christian Medina
|
18ef0f73ef
|
fix: don't save quant_state objects (BnB rebuilds on load)
|
2026-07-02 22:48:09 -04:00 |
|
Christian Medina
|
8c13be4d1f
|
fix: free GPU memory after each layer quantization
|
2026-07-02 22:43:27 -04:00 |
|
Christian Medina
|
0f624e1e75
|
fix: use bitsandbytes.functional for expert layer quantization
|
2026-07-02 22:36:02 -04:00 |
|
Christian Medina
|
bfa569f4e9
|
fix: remove streaming from output path name
|
2026-07-02 22:06:50 -04:00 |
|
Christian Medina
|
959c43d44c
|
feat: true streaming NF4 quantization with safetensors
|
2026-07-02 22:05:59 -04:00 |
|
Christian Medina
|
d41648d4fc
|
feat: load shards directly to GPU, no CPU bottleneck
|
2026-07-02 21:44:28 -04:00 |
|
Christian Medina
|
82677070ff
|
fix: weights_only=False for safetensors loading
|
2026-07-02 21:41:44 -04:00 |
|
Christian Medina
|
aec7f405fe
|
feat: use both GPUs in parallel for streaming quantization
|
2026-07-02 21:30:35 -04:00 |
|
Christian Medina
|
0ea51488a7
|
feat: add streaming quantization script (process one shard at a time)
|
2026-07-02 21:28:05 -04:00 |
|