Imagine that the following simplified equation is used to implement self-attention:
,
where the symbols Q, K and V have the same meaning as in our lectures.
The question is about learnable parameters. Select one option that is correct.

Question

Imagine that the following simplified equation is used to implement self-attention: 
  , 
 where the symbols Q, K and V have the same meaning as in our lectures. 
 The question is about learnable parameters. Select one option that is correct.

Accepted Answer

Q, K and V are computed using input data and some learnable parameters.

Answer

Only Q and K are computed using input data and some learnable parameters.

Answer

Only V is computed using input data and some learnable parameters.

Answer

All other answers are incorrect.

Crowdly

Imagine that the following simplified equation is used to implement self-attenti...

Want instant access to all verified answers on moodle.kent.ac.uk?