What is the purpose of the transformer model's self-attention mechanism?

Question

Accepted Answer

Self-attention computes relationships between all pairs of tokens in a sequence, enabling parallelization and better long-range dependency capture than RNNs.