CS336: Language Modeling from Scratch
155 points by kristianpaul 4 hours ago | 15 comments
skerit 2 hours ago
> GPU compute for self-study
replyThose suggestions they make for a B200 start at $4.99 an hour.
Is that really required, for starting out? I've been tinkering with my own from-scratch LLM, but in the early phases I don't need anything more than a 4090 on Vast.ai
sonabinu 35 minutes ago
I brought a group together to do this class using the YouTube videos and course materials available online. It is challenging but rewarding. We tackled it one lecture video per week. Started with over 30 learners and by last session we were down to 8.
replyairstrike 2 hours ago
I wonder if people prefer to learn this on their own or if building a community around open learning is something that others are interested in
replydominotw 12 minutes ago
i recently started reading "build reasoning model from scratch" then i realized that i am not really interested in building part and just want to understand theory and practice behind it.
replyA want like a casual lesswrong style from ground up explanation.
storus 3 hours ago
Thanks for releasing this again! What are this year's changes to prior offerings?
replytmule 2 hours ago
Are video lectures available online?
replyBilal_io 2 hours ago
Youtube playlist link from the page
https://www.youtube.com/watch?v=JuoVZkPBiKk&list=PLoROMvodv4...
reply
[1] https://cs224d.stanford.edu