Name
When unsafe code is slow - Automatic Differentiation in Rust
Session Type
Technical Talk
Date & Time
Thursday, October 24, 2024, 1:15 PM - 1:45 PM
Abstract/s
Automatic Differentiation was accepted as an experimental Rust feature for HPC, ML, and Scientific Computing applications. We present Rust-Enzyme, an LLVM-based autodiff tool and show that differentiating idiomatic Rust can lead to significantly better performance than differentiating similar C++ code. We will discuss rustc, LLVM, JAX, Enzyme and C++ limitations to explain benchmark differences and prove that old performance assumptions for libraries and languages won't hold when compiler-based automatic differentiation is applied.
Location Name
Grand Ballroom