DeepInfer, our in-house inference framework, now open source

3 comments

• $ 5 hours ago
  [deleted]
• $awasum_yannick 4 hours ago

  This probably makes enterprise private inference cheaper. Wonder if this can be generalized to server other LLMs not just DeepSeek...should not be too hard

• $pluc 4 hours ago

  https://news.ycombinator.com/item?id=50163277