Lecture 02: Development Infrastructure & Tooling (FSDL 2022)

New course announcement ✨
We're teaching an in-person LLM bootcamp in the SF Bay Area on November 14, 2023. Come join us if you want to see the most up-to-date materials building LLM-powered products and learn in a hands-on environment.
www.scale.bythebay.io/llm-wor...
Hope to see some of you there!
--------------------------------------------------------------------------------------------- In this video, we cover what you need to develop deep learning models, from software engineering to distributed training to experiment management.
00:00 Development Infrastructure & Tooling
01:39 Software Engineering
09:02 Deep Learning Frameworks
14:47 Meta-frameworks and model zoos
16:52 Distributed Training
28:32 GPUs
39:09 Compute Resource Management
46:35 Experiment Management
Subscribe to our channel and sign up at fullstackdeeplearning.com/cou... to follow along with the 2022 course!
Lecture Notes: fullstackdeeplearning.com/cou...
Slides: fsdl.me/2022-lecture-02-slides

[@The_Full_Stack]

47:40 Minor correction on the free tier for Weights & Biases: all personal use is free, not just when projects are public.

[@zakariasaif_AI]

I can't believe this high information thanks legend

[@burhanrashidhussein6037]

amazing!!!!!

[@nj8048]

We need the assistant at every lecture!!

[@haugkjet1]

Great lecture!

[@ReneeSLiu-zx5tj]

The assistant!!!

[@user-wr4yl7tx3w]

How about Vertex AI?

[@user-wr4yl7tx3w]

why is Jax for researchers? Isn't Jax for HPC?

[@smartpencs]

Greate Lecture, Can I translate it to vietnamese