I hit rate limits recently after the Astra launch while using the goal feature, and I was surprised as it was an afternoon of work, something I hadn’t seen with Sol over much longer time horizons.
In this article, I found the supposed lacked of accounting for cached tokens interesting, as well as the wasteful goal/wait behavior, but I haven’t proven either.
Is "your small change to codex" available somewhere ?
Sorry, not my post, found via Reddit.
I hit rate limits recently after the Astra launch while using the goal feature, and I was surprised as it was an afternoon of work, something I hadn’t seen with Sol over much longer time horizons.
In this article, I found the supposed lacked of accounting for cached tokens interesting, as well as the wasteful goal/wait behavior, but I haven’t proven either.