Bonsai 8B: a 1-bit LLM that fits in 1.15GB

2 comments

• $lifecodes 6 hours ago

  If this holds, does it unlock 100B+ models running locally in ~tens of GB RAM? Or does accuracy collapse before that point?

  [-]
  • $steveharing1 5 hours ago

    [dead]