Extending Raschka's GPT-2: an MoE trained from scratch on an RTX 3090

(gilesthomas.com)

1 points | by gpjt 6 hours ago ago