Lessons

1Bias-variance & generalization48 min read

The decomposition with the actual math, the three terms and what drives each, why the modern interview asks it as a sizing question (“which hyperparameter first?”), and diagnosing under/overfitting from a learning curve instead of a single number.

  • →Generalization Diagnosis
Read lesson
2Loss functions & optimization47 min read

Why the loss is the algebraic commitment: MSE for real targets, cross-entropy for classes and why (convex Hessian, non-saturating gradient). Then the dynamics — batch vs SGD, Adam’s per-coordinate scaling, when Adam hurts generalization, and the learning-rate regimes.

  • →Loss and Optimization
Read lesson
3Regularization & calibration49 min read

The variance dial: L1/L2/elastic-net geometry and when each wins, dropout’s implicit ensemble, early stopping as spectral regularization. Then the orthogonal problem — why probabilities miscalibrate, Platt vs isotonic (the 1000-sample rule), and ECE/reliability diagrams.

  • →Regularization and Calibration
Read lesson
4Model selection in practice47 min read

The decision is a function of data shape, volume, latency, interpretability, and cost — not a leaderboard. Logistic regression vs gradient-boosted trees vs neural nets vs LLMs, with named case studies where the “smaller” model won, and the real cost/latency numbers.

  • →Model Selection and Evaluation
Read lesson
5Evaluation metrics done right49 min read

Constraints first, metric second. The accuracy paradox, precision/recall/F1, ROC-AUC vs PR-AUC on imbalance and why the choice flips, thresholds via calibrated cost (not Youden), and the silent killer — data leakage, with the named case studies and the CV protocols that prevent it.

  • →Model Selection and Evaluation
  • →Generalization Diagnosis
Read lesson
6Mock modeling interview45 min read

A timed rapid-fire gauntlet across the whole track — bias-variance, loss/optimization, regularization, calibration, model selection, metrics, leakage. Practitioner framing (process over answer), the khangich/alirezadir question banks, and five scenario checkpoints under pressure.

  • →Generalization Diagnosis
  • →Loss and Optimization
  • →Model Selection and Evaluation
Read lesson

Skills in this course

  1. 01Generalization DiagnosisDiagnose bias, variance, leakage, and learning-curve behavior.
  2. 02Loss and OptimizationChoose suitable losses and optimization responses from model and gradient behavior.
  3. 03Regularization and CalibrationControl variance and produce probabilities that support sound decisions.
  4. 04Model Selection and EvaluationSelect practical models, metrics, thresholds, and validation designs for the task.