IT5036 MACHINE LEARNING LT PC
30 0 3
OBJECTIVES:
• To understand the basic concepts of machine learning and probability
theory.
• To appreciate supervised learning and their applications.
• To understand unsupervised learning like clustering and EM algorithms.
• To understand the theoretical and practical aspects of probabilistic
graphical models.
• To learn other learning aspects such as reinforcement learning,
representation learning, deep learning, neural networks and other
technologies.
UNIT I INTRODUCTION 9
Machine Learning – Types of Machine Learning – Supervised Learning –
Unsupervised Learning – Basic Concepts in Machine Learning – Machine
Learning Process – Weight Space – Testing Machine Learning Algorithms – A
Brief Review of Probability Theory – Turning Data into Probabilities – The Bias-
Variance Tradeoff.
Suggested Activities:
• Flipped classroom on Artificial Intelligence and Expert Systems.
• Practical - Installing Python and exploring the packages required for
machine learning including numpy, scikit-learn, and matplotlib, IPython
hmmpytk and pgmpy.
UNIT II SUPERVISED LEARNING 9
Linear Models for Regression – Linear Basis Function Models – The Bias-
Variance Decomposition – Bayesian Linear Regression – Common Regression
Algorithms – Simple Linear Regression – Multiple Linear Regression – Linear
Models for Classification – Discriminant Functions – Probabilistic Generative
Models – Probabilistic Discriminative Models – Laplace Approximation –
Bayesian Logistic Regression – Common Classification Algorithms – k-Nearest
Neighbors – Decision Trees – Random Forest model – Support Vector Machines.
Suggested Activities:
• Flipped classroom on basics about classification and regression.
• Practical - Collection of data from different recourses and summarize the
data.
• Practical - Build linear, multi-linear, logistic regression model to predict the
data.
UNIT III UNSUPERVISED LEARNING 9
Mixture Models and EM – K-Means Clustering – Dirichlet Process Mixture
Models – Spectral Clustering – Hierarchical Clustering – The Curse of
Dimensionality – Dimensionality Reduction – Principal Component Analysis –
Latent Variable Models(LVM) – Latent Dirichlet Allocation (LDA).
Suggested Activities:
• Flipped classroom on mixture models.
• External learning - Improving performance of the model using kernel
methods.
UNIT IV GRAPHICAL MODELS 9
Bayesian Networks – Conditional Independence – Markov Random Fields –
Learning – Naive Bayes Classifiers – Markov Model – Hidden Markov Model.
Suggested Activities:
• Flipped classroom on Bayesian and Markov models.
• Practical - Implementation of Naive Bayes classifier for credit card
analysis.
• Practical - Implement HMM for an application.
• External learning - Gaussian Processes and Topic Modeling.
UNIT V ADVANCED LEARNING 9
Reinforcement Learning – Representation Learning – Neural Networks – Active
Learning – Ensemble Learning – Bootstrap Aggregation – Boosting – Gradient
Boosting Machines – Deep Learning.
Suggested Activities:
• Flipped classroom on neural networks.
• Practical - Implement bagging approach for credit card analysis.
• External learning - Deep networks.
