DeepSeek v4.1 Flash (518GB, 4-bit) on a 128GB MacBook: 2.7x prefill, 17 tok/s

(github.com)

1 points | by Argonautlabs 4 hours ago ago

3 comments

$Argonautlabs 3 hours ago

44 t/s prefill and 17 t/s decode on M5 Max 128gb Deep Seek V4.1 Flash (4 bit)
$ 4 hours ago

[deleted]
$Argonautlabs 3 hours ago

[flagged]