1 points | by rafaelnexus 7 hours ago ago
3 comments
How do you prepare the fallback if it already took tokens to query the simpler model?
don't litellm and similar do this already?
How do you prepare the fallback if it already took tokens to query the simpler model?
don't litellm and similar do this already?