Speculative decoding makes LLMs go brrr

(leoniemonigatti.com)

1 points | by eigenBasis 5 hours ago ago