1 points | by this_was_posted 11 hours ago ago
2 comments
Just posting this here as it helped me get incredible performance out of my 2x r9700 setup that I didn't think were possible when using llama.cpp and vllm
I wonder how it compares to Hipfire: https://github.com/warpfront/hipfire
Just posting this here as it helped me get incredible performance out of my 2x r9700 setup that I didn't think were possible when using llama.cpp and vllm
I wonder how it compares to Hipfire: https://github.com/warpfront/hipfire