Section 3

Classification, logistic regression and overfitting

Predicting categories instead of numbers. Why a straight line fails for yes-or-no answers, the sigmoid and logistic regression, decision boundaries, the log loss and how gradient descent trains it, then the central problem of machine learning: fitting the data without memorising it, and how regularisation helps. Ends with a lab where you build logistic regression in NumPy.

  • 8 lessons
  • 2 h 18 min

0 of 8 lessons complete

Lessons

  1. 1

    Classification: why a straight line fails for yes or no

    Lesson · 12 min

  2. 2

    The sigmoid and logistic regression

    Lesson · 15 min

  3. 3

    Decision boundaries

    Lesson · 14 min

  4. 4

    The log loss: why not squared error?

    Lesson · 16 min

  5. 5

    Gradient descent for logistic regression

    Lesson · 16 min

  6. 6

    Underfitting and overfitting

    Lesson · 14 min

  7. 7

    Regularisation

    Lesson · 16 min

  8. 8

    Lab: logistic regression in NumPy + section quiz

    Lab · 35 min