Magneton: Optimizing Energy Efficiency of ML Systems via Differential Energy Debugging
Magneton is a novel energy profiler that detects and diagnoses software energy waste in ML systems by comparing similar systems at the operator level. It works by finding differences in how same tasks are implemented across different models, pinpointing inefficient operators, and tracing the root cause back to specific code or configuration choices.