Pretraining progress is mostly coming from data

(dwarkesh.com)

1 points | by gmays 10 hours ago ago