Industry Panel: Power & Energy in Production ML

Panel

Bhargava Gopireddy NVIDIA Cooper Elsworth Google Tentative Tentative (tentative) Jae-Won Chung (Moderator) University of Michigan

Abstract

Join industry leaders from NVIDIA, Google, and Tentative as they discuss the real-world challenges and solutions for power and energy management in production ML systems. Learn about infrastructure planning, operational strategies, and what every ML practitioner should know about power constraints.

Panel Outline

How is the power bottleneck manifesting in infra planning and operation?
Short- and long-term projections for power/energy issues.
If you can make one change magically in the ML stack for power/energy, what would it be?
What about power/energy should every ML researcher and practitioner know?