Attention lab

Attention lab

Drag a query and some keys, and watch the dot products, the softmax and the blended output change. This tool needs JavaScript, so turn it on to use it. Everything you need to answer the exam question is explained in the text above.