Pretraining Under Infinite Compute

1 comments

• $jedharris 14 hours ago

  "Our results show that simple algorithmic improvements can enable significantly more data-efficient pre-training in a compute-rich future."