Honestly, a local model that can run on CPU with reasonable speeds and have a good tool call success rate would be great to have. Think about it, I carry my laptop everywhere with me but I don't enable my Nvidia graphics card because I want to be able to use it for more than 30 minutes. I would love to have a model that can quickly put calendar entries, create todo lists and expand upon my Obsidian notes via Web Search, but unfortunately I have to rely on third party providers to achieve this for the time being. I don't expect local 1 bit models to ever code or do complex tasks but basic tool calls and language functionality would be awesome to have fully offline everywhere.
Honestly, a local model that can run on CPU with reasonable speeds and have a good tool call success rate would be great to have. Think about it, I carry my laptop everywhere with me but I don't enable my Nvidia graphics card because I want to be able to use it for more than 30 minutes. I would love to have a model that can quickly put calendar entries, create todo lists and expand upon my Obsidian notes via Web Search, but unfortunately I have to rely on third party providers to achieve this for the time being. I don't expect local 1 bit models to ever code or do complex tasks but basic tool calls and language functionality would be awesome to have fully offline everywhere.