4 Commits

Author	SHA1	Message	Date
Christian Medina	d41648d4fc	feat: load shards directly to GPU, no CPU bottleneck	2026-07-02 21:44:28 -04:00
Christian Medina	82677070ff	fix: weights_only=False for safetensors loading	2026-07-02 21:41:44 -04:00
Christian Medina	aec7f405fe	feat: use both GPUs in parallel for streaming quantization	2026-07-02 21:30:35 -04:00
Christian Medina	0ea51488a7	feat: add streaming quantization script (process one shard at a time)	2026-07-02 21:28:05 -04:00