Neural network and deep learning

1234567891011121314151617181920
Across
  1. 6. What does the term "Attention Mechanism" refer to in the context of RNNs
  2. 8. What does the term "Weight Sharing" refer to in neural networks?
  3. 12. Any activation function that removes negative values and keep positive ones
  4. 13. What is the purpose of a Learning Rate in training a neural network
  5. 14. Define Convolution in the context of Convolutional Neural Networks.
  6. 15. solution for vanishing gradient problem in RNN
  7. 16. solution for exploding gradient problem in RNN
  8. 17. What is the role of "Dropout" in a Convolutional Neural Network
  9. 19. what is filter in a CNN
  10. 20. What is the purpose of the Bias term in a neural network
Down
  1. 1. Define the term "Embedding Layer" in natural language processing
  2. 2. What is the role of the "Hidden State" in a Recurrent Neural Network
  3. 3. What does the term "DropConnect" refer to in deep learning
  4. 4. What is the role of the Loss Function in training a neural network?
  5. 5. What is the role of the Learning Rate Decay in training deep neural networks
  6. 7. What is the purpose of an Optimizer in training a neural network
  7. 9. What is the role of a Softmax activation in the output layer
  8. 10. any activation function that converts given value between 0 and 1
  9. 11. What is the purpose of the term "Epochs" in training deep neural networks
  10. 18. An agent can improve his performance by