ModelMesh – Native macOS app to shard models across Macs via Llama-RPC

2 comments

• $prologic 5 hours ago

  What's the performance like? Can you run larger frontier-sized models?

• $jasonhurt 5 hours ago

  [dead]