What is the main role of the decoder in a Transformer model?Question 14Answera.To generate output tokens based on the final encoder representation.b.To compute attention scores between input and output tokens.c.Learning positional encodings.d.To encode the input sequence.

What are the encoder and decoder components of a transformer model?The encoder ingests an input sequence and produces a sequence of tokens. The decoder takes in the tokens from the encoder and produces an output sequence.The encoder ingests an input sequence and produces a single hidden state. The decoder takes in the hidden state from the encoder and produces an output sequence.The encoder ingests an input sequence and produces a sequence of hidden states. The decoder takes in the hidden states from the encoder and produces an output sequence.The encoder ingests an input sequence and produces a sequence of images. The decoder takes in the images from the encoder and produces an output sequence.

What is the purpose of the decoder in an encoder-decoder architecture?To generate the output sequence from the vector representationTo convert the input sequence into a vector representationTo learn the relationship between the input and output sequencesTo predict the next word in the output sequence

In the context of Transformers, what is the role of positional encoding?Question 8Answera.Capture the order of words in a sequence.b.Represent the meaning of individual words.c.None of thesed.Improve the efficiency of the self-attention mechanism.

In a Transformer decoder, what is the purpose of the masked self-attention layer?Question 2Answera.Assign weights to relevant parts of the input sequence.b.None of thesec.Generate a representation of the entire output sequence.d.Allow the model to "attend" to previously generated tokens.

What is the purpose of the attention mechanism in an encoder-decoder model?To translate text from one language to another.To extract information from the image.To allow the decoder to focus on specific parts of the image when generating text captions.To generate text captions for the image.