What is the key difference between BERT and XLNet?

Question

MLQuiz · Accepted Answer

XLNet generalizes autoregressive models by permuting the factorization order, allowing bidirectional context without the pretrain-finetune discrepancy of BERT's mask.