What is the role of an 'optimizer' in neural network training?

Quiz Options

• To generate random data
• To define the network architecture
• To modify the network's weights and biases based on the loss function
• To visualize the training process

Explanation & Context

Optimizers are algorithms used in deep learning to update the model's parameters (weights and biases) in order to minimize the loss function, such as Adam or SGD.