What are positional encodings, and why are they used?

Question

MLQuiz · Accepted Answer

Transformers lack inherent order awareness; positional encodings (sinusoidal or learned) inject token position information, critical for understanding sequence.