I just checked your github and it is amazing. The code is flawless along with the research. You have essentially created a simple one-click infrastructure that is very helpful for anyone in AI research.
You can also checkout our research paper in zenodo. Also, make sure to try using it on a CPU. Our main goal is to help advance the AI community so that people spend less time configuring vLLM and more on actual testing and dev.
I just checked your github and it is amazing. The code is flawless along with the research. You have essentially created a simple one-click infrastructure that is very helpful for anyone in AI research.
You can also checkout our research paper in zenodo. Also, make sure to try using it on a CPU. Our main goal is to help advance the AI community so that people spend less time configuring vLLM and more on actual testing and dev.