The Hidden Cost of Fast Gradients: Newton-Krylov Downdates for Adjoints
You're staring at a gradient plot that should be smooth, but it's not. The forward solver ran in three minutes. The adjoint solve took four. And now the Newton-Krylov downdate is eating another two. Nobody tells you about the downdate when you learn adjoint methods—it just shows up in your memory profile like an uninvited guest. This article is about that guest. Not the elegant math of Krylov subspaces, not the beauty of adjoint equations, but the ugly practical cost of keeping those subspaces consistent when you need gradients for every design iteration. We'll see where the time and memory actually go—and what you can trim without breaking the solve. Why Downdates Matter Now More Than Ever The rise of PDE-constrained optimization in engineering design Every major aircraft wing, turbine blade, or automotive chassis you have seen in the last decade passed through a gradient-based optimizer.