13 points | by ghuntley a day ago ago
4 comments
Here is the repo:
https://github.com/ytmytm/llama2.c64
0.002 tokens per second
It runs a model with 260K params, so hardly a "Large" LM. Nevertheless, a cool project.
And also not exactly a Commodore 64 is it, since it requires an addon with 30x the RAM. Still very cool and impressive though!
Here is the repo:
https://github.com/ytmytm/llama2.c64
0.002 tokens per second
It runs a model with 260K params, so hardly a "Large" LM. Nevertheless, a cool project.
And also not exactly a Commodore 64 is it, since it requires an addon with 30x the RAM. Still very cool and impressive though!