What is next sentence prediction (NSP), and how does it enhance LLMs?

Question

MLQuiz · Accepted Answer

NSP (used in BERT) trains on 50% sequential and 50% random sentence pairs, improving coherence in dialogue and summarization tasks by understanding sentence relationships.