fast.ai also does autograd from scratch - and goes further than Karpathy since i... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		jph00 on Sept 1, 2024 \| parent \| context \| favorite \| on: Building LLMs from the Ground Up: A 3-Hour Coding ... fast.ai also does autograd from scratch - and goes further than Karpathy since it even does matrix multiplication from scratch. But it doesn’t start there. It uses top-down pedagogy, instead of bottom up.

BaculumMeumEst on Sept 1, 2024 [–]

Oh that’s interesting to know! I guess I gel better with bottom up. As soon as I start seeing API functions I don’t understand I immediately want to know how they work!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact