See, LLMs don’t magically get skills out of thin air, as some papers suggest. This is a very nice paper taking a deep dive into one of them (translation skill) and it clearly comes from it being in the data. I think that’s great and a good motivator for training on everything!