Run LLM Locally – which open model fits your GPU or Mac, and how fast

3 comments

• $micahdeath 5 hours ago

  Doesn't support my AMD Athlon 3000G w/ 64GB RAM =P -- nor my real consumer GPUs (older than 4 years)

  (And yes, I do run AI on my athlon... it is slow but works.)

• $cmdrmac 5 hours ago

  Another tool that isn't up to date on Apple processors...

• $schamy 5 hours ago

  [flagged]