(1/8) What would happen when we are running out of tokens? (Actually this is happening) Can we use the pretraining tokens repeatedly to further scale LLMs? Super excited to share our new paper: To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis https://t.co/yJk386181Z (View Tweet)