I rent and manage GPUs on sites like vast.ai and clore.ai. The prices are all over the place. You will see 5090s from $0.30/hr to $5/hr, plus bandwidth which is set by the gpu owner and can range from $0.4 per TB up to $12.00 per TB.
This is a concept for what an order book would look like for GPU compute instead of the current listing model. It would use standardized SKUs so users know what they are getting. Its pre product, I'm curious to know what people think.
I rent and manage GPUs on sites like vast.ai and clore.ai. The prices are all over the place. You will see 5090s from $0.30/hr to $5/hr, plus bandwidth which is set by the gpu owner and can range from $0.4 per TB up to $12.00 per TB.
This is a concept for what an order book would look like for GPU compute instead of the current listing model. It would use standardized SKUs so users know what they are getting. Its pre product, I'm curious to know what people think.