ShadowPrefill: Keeping Your Next Model Warm for Model Routing in Agentic Serving

 (arxiv.org)

2 points | by matt_d 6 hours ago ago

No comments yet.