AI for Learning
Meta paper argues compute-optimal scaling should count bytes, not…
Meta researchers say tokenization changes scaling behavior and report results suggesting compute-optimal training should track data in bytes, not tokens.
Source checked
Primary source
8 days
Source ↗Full Brief →