Activation functions give neural networks the power to learn non-linear patterns. This guide breaks down Sigmoid, Tanh, ReLU, and modern variants like Leaky ReLU, ELU, and SELU—explaining how they work, why they matter, and how they impact training performance.