What is the main idea behind self-supervised learning?

Question

Accepted Answer

Self-supervised learning defines pretext tasks (e.g., inpainting, colorization) that generate labels from unlabeled data, then fine-tunes on downstream tasks.