Christian Medina
|
a55c39c818
|
fix: use device_map=cpu with BnB config for quantization
|
2026-07-02 13:54:19 -04:00 |
|
Christian Medina
|
3480dd9fbd
|
docs: add model inspection script and comment failing tests
|
2026-07-02 13:53:45 -04:00 |
|
Christian Medina
|
048e68f91a
|
refactor: comment out failing tests, add Test 7-10 variations
|
2026-07-02 13:45:17 -04:00 |
|
Christian Medina
|
e2b351e04c
|
fix: actually quantize model with quantize_4bit()
|
2026-07-02 13:34:33 -04:00 |
|
Christian Medina
|
aff91c990b
|
feat: add Test 6 - bf16 to CPU → BnB 4-bit quantize → GPU
|
2026-07-02 13:26:50 -04:00 |
|
Christian Medina
|
ffd1d29c35
|
fix: use bf16 model with BnB 4-bit (ON-THE-FLY quantization)
|
2026-07-02 13:20:26 -04:00 |
|
Christian Medina
|
48a2518b4c
|
feat: comprehensive test of 5 loading strategies
|
2026-07-02 12:32:59 -04:00 |
|
Christian Medina
|
3892ea7fec
|
feat: test with BnB 4-bit quantization to force proper loading
|
2026-07-02 12:23:34 -04:00 |
|
Christian Medina
|
c5a3b87eed
|
feat: test both strategies - device_map=auto and FSDP
|
2026-07-02 12:19:05 -04:00 |
|
Christian Medina
|
3e26d7d37e
|
fix: use already-quantized 4-bit model for test
|
2026-07-02 12:09:49 -04:00 |
|
Christian Medina
|
e3ea60e6c6
|
fix: clarify distribution pattern detection in test script
|
2026-07-02 12:04:54 -04:00 |
|
Christian Medina
|
3049aa9b0a
|
feat: add test script to verify model loading and GPU distribution
|
2026-07-02 12:04:04 -04:00 |
|