Introduction
Machine learning studies computer algorithms for learning to do stuff( such as learning to
complete a task, or to make accurate predictions or to behave intelligently).The learning that is
being done is always based on some sort of observations or data, such as examples (the most
common case in this course), direct experience, or instruction.
So in general, machine learning is about learning to do better in the future based on what was
experienced in the past
Objectives
By the end of this topic you should be able to:
i. Describe Pattern Recognition
ii. Explain how machine learning Helps analyse data and identify trends
iii. Explain types of artificial neurons
iv. Explain Data mining
Learning activities
Learning Activity 1.1: Task
Explain patterns in data and then make predictions based on it, often, complex patterns to answer
business questions, and help solve problems.
Learning Activity 1.2: application of machine learning
Assessment
Activities 1.1 and 1.2.will be graded.
Topic Resources
1. P. Winston, "Learning by Managing Multiple Models", in P. Winston, Artificial
Intelligence, Addison-Wesley Publishing Company, 1992, pp. 411-422.
2. Roller, D., Weber, J., Huang, T., Malik, J., Ogasawara,G., Rao, B., and Russell, S.
(1994). Towards robust automatic traffic scene analysis in real-time. In Proceedings of
the International Conference on Pattern Recognition, Israel.
3. Lefkovitz, D. (1960). A strategic pattern recognition program for the game Go. Technical
Note 60-243, Wright Air Development Division, Universityof Pennsylvania, The Moore
School of ElectricalEngineering.
URL Links
http://www2.cs.uregina.ca/~dbd/cs831/notes/ml/vspace/3_vspace.html
https://leonardoaraujosantos.gitbooks.io/artificial-inteligence/content/machine_learning.html
https://www.datasciencecentral.com/profiles/blogs/twelve-types-of-artificial-intelligence-ai-
problems
https://en.wikipedia.org/wiki/Data_mining
https://en.wikipedia.org/wiki/Decision_support_system#Applications
https://en.wikipedia.org/wiki/Expert system#Applications
Topic 6 Notes
Models
Decision tree methods
decision tree takes as input an object or situation described by a set of properties, and outputs a
yes/no "decision." Decision trees therefore represent Boolean functions. Functions with a larger
range of outputs can also be represented, but for simplicity we will usually stick to the Boolean
case. Each internal node in the tree corresponds to a test of the value of one of the properties, and
the branches from the node are labelled with the possible values of the test. Each leaf node in the
tree specifies the Boolean value to be returned if that leaf is reached.Decisiontree: -use a
restricted representation of logical sentences specifically designed for learning,
Version spaces
A version space is a hierarchial representation of knowledge that enables you to keep track of all
the useful information supplied by a sequence of learning examples without remembering any of
the examples. The version space method is a concept learning process accomplished by
managing multiple models within a version space.
ANNs
Artificial neural networks (ANN) or connectionist systems are computing systems vaguely
inspired bythe biological neural networks that constitute animal brains.
An ANN is based on a collection of connected units or nodes called artificial neurons, which
loosely model the neurons in a biological brain. Each connection, like the synapses in a
biological brain, can transmit a signal from one artificial neuron to another. An artificial neuron
that receives a signal can process it and then signal additional artificial neurons connected to it.
Applications
Pattern Recognition
Family of models that takes a very “loose” inspiration from the brain, used to approximate
functions that depends on a large number of inputs. (Is a very good Pattern recognition model).
Neural networks are examples of Non-Linear hypothesis, where the model can learn to classify
much more complex relations. Also it scale better than Logistic Regression for large number of
features.
It's formed by artificial neurons, where those neurons are organised in layers. We have 3 types of
layers:
Input layer
Hidden layers
Output layer
We classify the neural networks from their number of hidden layers and how they connect, for
instance the network above have 2 hidden layers. Also if the neural network has/or not loops we
can classify them as Recurrent or Feed-forward neural networks.Neural networks from more
than 2 hidden layers can be considered a deep neural network. The advantage of using more deep
neural networks is that more complex patterns can be recognised.
Pattern Recognition in facial recognition, optical character recognition, character recognition,
handwriting recognition.etc.The first modern mobile robot was the "Hopkins Beast," built in the
early 1960s at Johns Hopkins University. It had pattern-recognition hardware and could
recognize the cover plate of a standard AC power outlet. It was capable of searching foroutlets,
plugging itself in, and then recharging its batteries! Still, the Beast had a limited repertoire of
skills. The first general-purpose mobot was "Shakey," developed at SRI International from 1966
through 1972 (Nilsson, 1984).
Data mining
Data mining is the process of discovering patterns in large data sets involving methods at the
intersection of machine learning, statistics, and database systems. Data mining is
an interdisciplinary subfield of computer science with an overall goal to extract information
(with intelligent methods) from a data set and transform the information into a comprehensible
structure for further use. Data mining is the analysis step of the "knowledge discovery in
databases" process, or KDD. Aside from the raw analysis step.
Decision support;
It is an information system that supports business or organizational decision-making activities.
DSSs serve the management, operations and planning levels of an organization (usually mid and
higher management) and help people make decisions about problems that may be rapidly
changing and not easily specified in advance—i.e. unstructured and semi-structured decision
problems.
One example is the decision support system for medical diagnosis. There are four stages in the
evolution of clinical decision support system (DSS): the primitive version is standalone and does
not support integration; the second generation supports integration with other medical systems;
the third is standard-based, and the fourth is service model-based.
DSS is extensively used in business and management. Executive dashboard and other business
performance software allow faster decision making, identification of negative trends, and better
allocation of business resources. Due to DSS all the information from any organization is
represented in the form of charts, graphs i.e. in a summarized way, which helps the management
to take strategic decision. For example, one of the DSS applications is the management and
development of complex anti-terrorism systems.Other examples include a bank loan officer
verifying the credit of a loan applicant or an engineering firm that has bids on several projects
and wants to know if they can be competitive with their costs.
