Out-of-core LLM inference engine written from scratch in Rust

 (github.com)

4 points | by Vage91 21 hours ago ago

1 comments