The Other Half
If differentiation pulls slopes out of curves, integration pushes accumulated change back into a quantity. Differentiation answers "how fast?"; integration answers "how much, over time?"
The Fundamental Theorem of Calculus says these two are inverse operations. Integrate a derivative and you get the original function back (up to a constant). They unwind each other.
The Area-Under-the-Curve Picture
The integral equals the area under the curve from to . Why? Because integration is "accumulating tiny rectangles of width and height and summing them up." Take the limit as and you get exact area.
Why AI Cares Less About Integration
Most ML loss functions are sums (already discrete) or already-averaged. We rarely need to compute symbolic integrals. Where integration shows up:
- Probability distributions — a continuous probability density integrates to 1.
- Variational inference — approximating intractable integrals over latent variables.
- Continuous-time models — neural ODEs, diffusion models. These do involve real integration.
- Reward accumulation in reinforcement learning — discounted sum of future rewards, the discrete version of an integral.