The real story here is replacing Ray Core's actor task dispatch with direct gRPC for the hot path.
Essentially admitting that the general-purpose actor model was the bottleneck for inference
workloads. Smart move — let Ray handle orchestration and get out of the way for actual data flow.
The real story here is replacing Ray Core's actor task dispatch with direct gRPC for the hot path. Essentially admitting that the general-purpose actor model was the bottleneck for inference workloads. Smart move — let Ray handle orchestration and get out of the way for actual data flow.