What is the difference between parametric and non-parametric methods?

Question

Accepted Answer

Parametric methods (linear regression) are simpler but may underfit. Non-parametric (KNN, decision trees) are more flexible but require more data and can overfit.