Teaching
Fall 2024
I am giving a couple of guest lectures for CS 2281R, taught by Prof. Sham Kakade:
- Hardware, DDP, checkpointing, and compute primitives
- Parallelization (FSDP, Pipeline, Tensor, Sequential)
I also co-taught a workshop on building transformers from scratch with Ella Batty: