CS336: Language Models from Scratch

Highly recommend for studying LLMs fundamentals.

I think it’s never too late to learn something new.

After working more than 2 years in Gemini Post-Training I wanted to refresh my knowledge and fill gaps in LLMs fundamentals, especially in pre-training. I’ve checked different resources, but this CS336 course on YouTube was by far the most useful for me. I highly recommend it to anyone interested in this field.

PS: Please don’t skip the homeworks, it’s the most useful material from the course

Note: I admire Stanford for the quality of their courses and the fact that they release them to public for free!