My "4-bit" quant was 6.2 bits per weight

 (koleslaw.ai)

3 points | by murphman 6 hours ago ago

1 comments