11 points | by mudkipdev 20 hours ago ago
4 comments
https://huggingface.co/xai-org/grok-2
> you will need 8 GPUs (each with > 40GB of memory).
oh joy
Hey a use for the a16z machine[0].
[0] https://news.ycombinator.com/item?id=44996892
that's bf16, you'll be running it at q4, so you'll be fine with 3 5090s
https://huggingface.co/xai-org/grok-2
> you will need 8 GPUs (each with > 40GB of memory).
oh joy
Hey a use for the a16z machine[0].
[0] https://news.ycombinator.com/item?id=44996892
that's bf16, you'll be running it at q4, so you'll be fine with 3 5090s