Theory Practice

Reason about bias, variance, overfitting, generalization, and evaluation splits.

Recommended resources

Instructions

  1. Use observed train-validation patterns rather than vague model-size rules.

Ordered items

  1. Diagnose train and validation errorTheory · 6 min
  2. L1 versus L2 regularizationOptimization · 6 min
  3. Read a finite-class generalization boundTheory · 7 min
  4. Generalization and overfitting knowledge checkTheory · 10 min

Completion

Recommend a defensible response to one bias and one variance failure mode.