Crowdly

Add to Chrome

What does one row of a self-attention matrix represent?

✅ The verified answer to this question is available below. Our community-reviewed solutions help you understand the material better.

What does one row of a self-attention matrix represent?

The probabilities of all possible next tokens in the vocabulary.

0%

The importance of each training example for the current prediction.

0%

How strongly one query token attends to each key token when forming its updated representation.

100%

The similarity between the final output embeddings of all words in the vocabulary.

0%

More questions like this

Want instant access to all verified answers on moodle.jku.at?

Get Unlimited Answers To Exam Questions - Install Crowdly Extension Now!

Add to Chrome

Telegram Instagram TikTok Question Bank

Terms of Use Contact Us