Build PyTorch to Understand PyTorch - Vijay Janapa Reddi & Andrea Mattia Garavagno

This talk features Vijay Janapa Reddi from Harvard University and Andrea Mattia Garavagno from the University of Genoa discussing TinyTorch, an open-source curriculum designed to deepen understanding of PyTorch and machine learning frameworks. The speakers explain how the curriculum enables students to construct essential PyTorch components like tensors, autograd, and optimizers in pure Python, fostering a comprehensive understanding of the framework. By utilizing progressive disclosure and systems-first profiling, TinyTorch guides learners from foundational concepts through significant milestones, culminating in hands-on experience with modern ML breakthroughs. This initiative aims to cultivate the next generation of PyTorch engineers who can contribute to and innovate within the framework.