Question

The trend suggests that as you increase the width of a neural network, the accuracy increases till a certain threshold value, and then starts decreasing. What could be the possible reason for this decrease

Answer 1

Hi, you've asked an incomplete question. Here's the remaining part of the questions:

What could be the possible reason for this decrease?

A. Even if number of kernels increase, only few of them are used for prediction

B. As the number of kernels increase, the predictive power of neural network decrease

C. As the number of kernels increase, they start to correlate with each other which in turn helps overfitting

D. None of these

Answer:

C. As the number of kernels increase, they start to correlate with each other which in turn helps overfitting

Explanation:

Remember, Kernels refer to computer programs that occupy part of the operating system memory.

By looking closely at the graph we could notice that the positive trend of the test accuracy couldn't be sustained as a result of a constant increase in the width of the neural network.