What is the purpose of the attention mechanism in an encoder-decoder model?To translate text from one language to another.To extract information from the image.To allow the decoder to focus on specific parts of the image when generating text captions.To generate text captions for the image.

How does an attention model differ from a traditional model?The decoder only uses the final hidden state from the encoder.Attention models pass a lot more information to the decoder.The traditional model uses the input embedding directly in the decoder to get more context.The decoder does not use any additional information.

What is the advantage of using the attention mechanism over a traditional recurrent neural network (RNN) encoder-decoder?The attention mechanism is more cost-effective than a traditional RNN encoder-decoder.The attention mechanism is faster than a traditional RNN encoder-decoder.The attention mechanism requires less CPU threads than a traditional RNN encoder-decoder.The attention mechanism lets the decoder focus on specific parts of the input sequence, which can improve the accuracy of the translation.

What is the purpose of the attention weights?To generate the output word based on the input data alone.To assign weights to different parts of the input sequence, with the most important parts receiving the highest weights.To incrementally apply noise to the input data.To calculate the context vector by averaging words embedding in the context.

What is the attention mechanism?A way of determining the similarity between two sentencesA way of determining the importance of each word in a sentence for the translation of another sentenceA way of predicting the next word in a sentenceA way of identifying the topic of a sentence

What is the main role of the decoder in a Transformer model?Question 14Answera.To generate output tokens based on the final encoder representation.b.To compute attention scores between input and output tokens.c.Learning positional encodings.d.To encode the input sequence.