Teaching

Fall 2024

I am giving a couple of guest lectures for CS 2281R, taught by Prof. Sham Kakade:

• Hardware, DDP, checkpointing, and compute primitives
• Parallelization (FSDP, Pipeline, Tensor, Sequential) (TK)