Objectives

This module is the beginning of our journey into the world of machine learning – learning complex patterns and relations from data that model continuous random variables.

You will:

Learn the theory of linear regression models
Learn how to use regression models in practice, using the scikit-learn library
Understand what is the over-fitting problem, and the role of regularisation in combating this problem
Report and plot the results of regression models

–

Mapping to course descriptor

The following table associates the learning objectives of this lecture (1-4 above) with the learning outcomes of this course.

Objective (#)	Knowledge & understanding				Subject-specific skills			Transferable skills
Objective (#)	K1	K2	K3	K4	S1	S2	S3	T1	T2	T3
1	✓				✓
2		✓		✓		✓	✓			✓
3	✓			✓	✓					✓
4			✓				✓	✓	✓	✓

–

Topics covered

Curve fitting
Linear regression
Regularisation
Support Vector Machines
Clustering – k-nearest neighbours & k-means clustering
Principal Component Analysis