Running 800B-parameter LLMs on consumer hardware with InferSSD

(wici.ai)

4 points | by andyxukq 5 hours ago ago