4 points | by Zombwaffle 9 hours ago ago
3 comments
The README claims that it costs 50-100 bytes per token when rendered to UTF8 text and wrapped in JSON. Citation needed please? JSON can be inefficient if you have lots of keys or use pretty whitespace. But UTF8 is very efficient. I don’t see it.
[flagged]
The README claims that it costs 50-100 bytes per token when rendered to UTF8 text and wrapped in JSON. Citation needed please? JSON can be inefficient if you have lots of keys or use pretty whitespace. But UTF8 is very efficient. I don’t see it.
[flagged]
[flagged]