Hi HN, I'm Dhaval, one of the founders of MakerMaker.ai We made a game out of the fast-growing inference business. See if you can run the most profitable inference business in this market, or at least not go bankrupt.
You start with $10k and no GPUs. You rent GPUs, pick which open-weights models to serve on which of them, guess where the market is going, and take over the world, er, market share. Spare GPUs go to Elise, our research agent, who finds speedups for the engine that you then install. Your score is the capital you end the year with.
We made it because the job of Elise, one of our research agent, is tuning inference engines like vLLM on AMD and NVIDIA GPUs, and it's a lot more fun to explain that to friends and family with a game than with our report: https://makermaker.ai/breakthroughs/inference/ (the code and baselines are there if you want the long version).
Hi HN, I'm Dhaval, one of the founders of MakerMaker.ai We made a game out of the fast-growing inference business. See if you can run the most profitable inference business in this market, or at least not go bankrupt.
You start with $10k and no GPUs. You rent GPUs, pick which open-weights models to serve on which of them, guess where the market is going, and take over the world, er, market share. Spare GPUs go to Elise, our research agent, who finds speedups for the engine that you then install. Your score is the capital you end the year with.
We made it because the job of Elise, one of our research agent, is tuning inference engines like vLLM on AMD and NVIDIA GPUs, and it's a lot more fun to explain that to friends and family with a game than with our report: https://makermaker.ai/breakthroughs/inference/ (the code and baselines are there if you want the long version).
The game is open source https://github.com/MakerMakerMakerMakerMaker/Inference-Machi.... Bug reports welcome there, or run your own copy.