Extending Raschka's GPT-2: an MoE trained from scratch on an RTX 3090

(gilesthomas.com)

2 points | by ibobev 6 hours ago ago