10 points | by Exquisitian 6 hours ago ago
5 comments
What’s the latency overhead of routing through you versus calling a provider directly?
If you run it locally the overhead is within a few ms
How does this compare to just writing an MCP server per tool?
[dead]
What’s the latency overhead of routing through you versus calling a provider directly?
If you run it locally the overhead is within a few ms
How does this compare to just writing an MCP server per tool?
[dead]