What is the derivative and why do you need it in physics? Here is a very quick introduction to derivatives to get you through your first physics course.

Gradient descent algorithms take the loss function and use partial derivatives to determine what each variable (weights and biases) in the network contributed to the loss value.