Two Forms of the Dot Product
gregorygundersen.com
Two Forms of the Dot Product
木二土的这个Flux模型真的很棒！VectorJourney，将真实的场景和矢量人物结合的相得益彰！快去试用一下吧！https://t.co/FPLDe1pqoG... See more
Self-Attention in Detail
Let’s first look at how to calculate self-attention using vectors, then proceed to look at how it’s actually implemented – using matrices.
The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a ... See more
Let’s first look at how to calculate self-attention using vectors, then proceed to look at how it’s actually implemented – using matrices.
The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a ... See more
Jay Alammar • The Illustrated Transformer
figure 2: the two types of why - https://miro.medium.com/max/700/1... See more