Backpropagation in RNNs is often confusing because a single weight affects the loss through multiple time-dependent paths. In this post, I break down Backpropagation Through Time step by step using a small toy dataset, clearly showing how gradients flow across timesteps and why unfolding the network is necessary.