_______occurs when the gradients become very small and tend towards zero.a.Gated Recurrent Unit Networks.b.Long Short Term Memory Networksc.Vanishing Gradientsd.Exploding Gradients

Why are RNNs susceptible to issues with their gradients?1 pointGradients can grow exponentiallyGradients can quickly drop and stabilize at near zeroPropagation of errors due to the recurrent characteristicNumerical computation of gradients can drive into instabilitiesAll of the above

Why is exploding gradient occurred?1 pointComputing gradient wrt hidden states requires many factors of weights and repeated gradient computationComputing gradient wrt inputs requires many factors of outputs and repeated gradient computationComputing gradient wrt weights requires many factors of hidden states and repeated gradient computationNone of the above

You are training an RNN, and find that your weights and activations are all taking on the value of NaN (“Not a Number”). Which of these is the most likely cause of this problem?Question 8Answera. Exploding gradient problem.b.Vanishing gradient problem.c. ReLU activation function g(.) is used to compute g(z), where z is too large.d.  Sigmoid activation function g(.) is used to compute g(z), where z is too large.

Which problem arises when training RNNs on long sequences?All of the given optionsUnderfittingVanishing or exploding gradientsOverfittingHigh bias

Vanishing gradients is observed in RNN.1 pointTrueFalse