lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

UNIT - 1
INTRODUCTION TO MACHINE LEARNING
Machine learning is a subfield of artificial intelligence (AI) that focuses on the
development of algorithms and statistical models that enable computers to
perform tasks without explicit programming instructions. The primary goal of
machine learning is to allow computers to learn from data and make predictions
or decisions based on that learning.

Here's a brief overview of key concepts and approaches in machine learning:

Types of Machine Learning:

1. Supervised Learning: In supervised learning, the algorithm learns from
labeled data, where each input-output pair is provided during the training
phase. The algorithm aims to learn the mapping from input to output.
2. Unsupervised Learning: Unsupervised learning involves training
algorithms on data without labeled responses. The algorithm tries to find
patterns or structures within the data.
3. Semi-supervised Learning: This approach combines both labeled and
unlabeled data for training. It's particularly useful when labeled data is
scarce.
4. Reinforcement Learning: Reinforcement learning involves training
algorithms to make sequential decisions. The algorithm learns to interact
with an environment by receiving feedback in the form of rewards or
penalties.

Key Algorithms:
1. Linear Regression: A basic algorithm used for modeling the
relationship between a dependent variable and one or more independent
variables.
2. Logistic Regression: Used for binary classification problems, logistic
regression estimates the probability that an instance belongs to a
particular class.
3. Decision Trees: Decision trees recursively split the data based on
features, resulting in a tree-like structure used for classification or
regression tasks.

Page 1 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

4. Random Forests: An ensemble learning method that constructs

multiple decision trees during training and outputs the mode of the
classes (classification) or the average prediction (regression).
5. Support Vector Machines (SVM): SVM finds the optimal hyper plane
that best separates classes in high-dimensional space.
6. Neural Networks: Inspired by the human brain, neural networks
consist of interconnected layers of nodes (neurons) that process input
data. Deep neural networks (DNNs) are neural networks with multiple
hidden layers.
7. Clustering Algorithms: Such as K-means, hierarchical clustering, etc.,
used in unsupervised learning to group similar data points together.
8. Dimensionality Reduction Techniques: Like Principal Component
Analysis (PCA) and t-distributed Stochastic Neighbor Embedding (t-
SNE), used to reduce the number of features in a dataset while
preserving its essential characteristics.

Evaluation Metrics:
1. Various metrics are used to assess the performance of machine learning
models, including accuracy, precision, recall, F1-score, ROC-AUC,
mean squared error (MSE), etc.

Model Training and Evaluation:

1. Data preprocessing involves tasks such as cleaning, normalization, and
feature engineering to prepare the data for training.
2. Models are trained using optimization algorithms that minimize a loss
function, which quantifies the model's error.
3. After training, models are evaluated on a separate test set to assess their
generalization performance. Cross-validation techniques can also be
used to assess performance more reliably.

Machine learning finds applications across various domains, including but not
limited to healthcare, finance, marketing, image recognition, natural language
processing, and autonomous vehicles. It continues to evolve rapidly with
advancements in algorithms, computing power, and data availability.

Definition of learning systems

Page 2 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

What is Learning System?

➢ A learning system is essentially a collection of artifacts that are ‘brought
together’, in an appropriate way, in order to create an environment that will
facilitate various types of learning process.
➢ Learning systems can take a variety of different forms - for example, a
book, a mobile form, a computer, an online forum, a school and a
university.
➢ Most learning systems will provide various types of learning resource and
descriptions of procedures for using these to achieve particular learning
outcomes.
➢ “Machine Learning enables a Machine to automatically learn from
Data, improve performance from an Experience and predict things
without explicitly programmed.”
➢ In Simple Words, when we fed the Training Data to Machine Learning
Algorithm, this algorithm will produce a mathematical model and with the
help of the mathematical model, the machine will make a prediction and
take a decision without being explicitly programmed.
➢ Also, during training data, the more machine will work with it the more it
will get experience and the more efficient result is produced

Example: Predicting Student Grades

Imagine you're a teacher and you want to predict the final grades of your students
based on their study hours. You collect data on past students, including the
number of hours they studied and their final grades. This dataset serves as your
labeled training data.
1. Data Collection:
➢ You record the number of hours each student spends studying and
their corresponding final grades.

2. Data Representation:

Page 3 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

➢ Each student's data point consists of two features: the number of

hours studied (input) and the final grade achieved (output).
3. Model Selection:
➢ You decide to use a simple linear regression model for this task.
Linear regression is a straightforward supervised learning algorithm
used for predicting numerical values based on input features.
4. Training:
➢ You split your dataset into a training set and a test set. Let's say you
allocate 80% of the data for training and 20% for testing.
➢ You train the linear regression model on the training data. The model
learns to fit a straight line to the data, minimizing the difference
between the predicted grades and the actual grades in the training
set.
5. Evaluation:
➢ After training, you evaluate the performance of the model using the
test set. You calculate metrics such as mean squared error (MSE) to
quantify how close the predicted grades are to the actual grades.
➢ A low MSE indicates that the model's predictions are close to the
true values, suggesting good performance.
6. Prediction:
➢ Once you're satisfied with the model's performance, you can use it
to predict the grades of new students based on their study hours.
➢ Given the number of study hours for a new student, the model can
provide an estimate of their final grade.

Designing a Learning System in Machine Learning:

According to Tom Mitchell, “A computer program is said to be learning from
experience (E), with respect to some tasks (T). Thus, the performance measure
(P) is the performance at task T, which is measured by P, and it improves with
experience E.”

Example: In Spam E-Mail detection

➢ Task, T: To classify mails into Spam or Not Spam.
➢ Performance measure, P: Total percent of mails being correctly classified
as being “Spam” or
➢ “Not Spam”.

Page 4 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

➢ Experience, E: Set of Mails with label “Spam”

Machine learning allows computers to learn by themselves, without needing

direct instructions. To understand how it works, we can look at its lifecycle—a
repeating process used to create successful machine learning projects. The main
goal of this lifecycle is to solve problems or complete projects efficiently.

Machine learning life cycle involves seven major steps, which are given
below:
1. Gathering Data
2. Data preparation
3. Data Wrangling
4. Analyze Data
5. Train the model
6. Test the model
7. Deployment

The most important thing in the complete process is to understand the problem
and to know the purpose of the problem. Therefore, before starting the life cycle,
we need to understand the problem because the good result depends on the better
understanding of the problem.
In the complete life cycle process, to solve a problem, we create a machine
learning system called "model", and this model is created by providing "training".
But to train a model, we need data; hence, life cycle starts by collecting data.

Page 5 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

1. Gathering Data:
➢ The first step in the machine learning journey is gathering data. This
means finding and collecting all the information we need.
➢ In this step, we look for data in different places like files, databases, the
internet, or even from mobile devices.
➢ This step is super important because the amount and quality of data we
collect determine how well our predictions will work. The more data
we have, the better our predictions will be.
➢ We do a few things in this step:
• Figure out where to get data from
• Collect the data
• Put all the data together from different places into one big set
called a dataset.
Once we've got our dataset, we can move on to the next steps in our machine
learning adventure!

2. Data preparation
After we've collected our data, the next step is getting it ready for the rest of the
machine learning process. This step is called data preparation.

Here's what we do in data preparation:

1. Put Data Together and Randomize: First, we gather all our data into one
place and mix it up so it's not in any particular order.

2. Data Exploration:
➢ We take some time to really understand the data we have. This
means looking at what kind of data it is, how it's structured, and if
there are any mistakes or missing pieces.
➢ Understanding our data well helps us get better results later on.
During this stage, we try to find patterns, trends, and any unusual
bits of data.
3. Data Pre-processing:
➢ Once we know our data inside out, we get it ready for analysis.

So, in simple terms, data preparation involves getting all our data organized,
understanding it, and then getting it ready to be analyzed by our machine learning
system.

Page 6 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

3. Data Wrangling
Data wrangling is all about getting your data into shape so it's ready for analysis.
This process involves cleaning up the data, selecting the important parts, and
transforming it into a format that's easy to work with in the next steps.

Here's why data wrangling is so important:

1. Cleaning Data: Sometimes, the data we collect isn't perfect. It might have
missing values, duplicates, invalid entries, or even random noise. Data
wrangling helps us identify and fix these issues to make our data more
reliable.

2. Selecting Variables: Not all the data we collect will be useful for our
analysis. Data wrangling allows us to pick out the important variables that
we actually need.

By using various techniques like filtering, we can clean up our data and make
sure it's in good shape for the next stages of our project. This is crucial because
the quality of our data directly impacts the quality of our final results.

Example
Let's say you're planning a picnic with your friends, and you need to prepare the
food. Data wrangling is like preparing the ingredients for your picnic dishes.
1. Cleaning Data: Imagine you're making a fruit salad, but some of the fruits
have bruises or are overripe. You'd want to clean them up or discard them
before adding them to your salad. Similarly, in data wrangling, you clean
up any messy or irrelevant data, like removing duplicate names or fixing
typos in your guest list.
2. Selecting Variables: For your picnic, you might decide to make
sandwiches, salads, and drinks. You wouldn't need to bring every
ingredient from your kitchen—just the ones you'll use for these specific
dishes. In data wrangling, you select the important pieces of information,
or variables, that you'll need for your analysis, like choosing the names of
the guests and their dietary preferences.

Once you've finished data wrangling, you have a neatly organized set of
ingredients ready to create your picnic dishes—or in this case, to analyze and
draw insights from your data!

4. Data Analysis

Page 7 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

Now that we've got our data all cleaned up and ready to go, it's time to start
analyzing it. This step involves a few key tasks:

1. Choosing Analysis Techniques: Just like picking the right tools for a job,
we need to select the best techniques for analyzing our data. This might
involve methods like sorting, categorizing, or finding patterns.

2. Building Models: Think of this like building a blueprint for a house. We

use our data to create models that help us understand and predict outcomes.
We might use different types of models depending on the problem we're
trying to solve.

3. Reviewing Results: Once our models are built, we take a look at what they
tell us. Are they giving us the insights we expected? Do they accurately
represent our data? This step helps us fine-tune our analysis and make any
necessary adjustments.

So, in simple terms, in this step, we take our cleaned-up data and use special
algorithms to build models that help us understand it better.

5. Train Model
In the "Train Model" step, we teach our model to get better at its job. Here's how
it works:

1. Training the Model: Just like teaching a student, we show our model lots
of examples from our datasets. This helps it learn different patterns, rules,
and features in the data.
2. Using Machine Learning Algorithms: Think of these as different
teaching methods. We use various algorithms to train our model, each one
helping it understand the data in a different way.

The goal here is to improve the model's performance so that it can give us better
results when we apply it to real-world problems.

6. Test Model
In the "Test Model" step, we evaluate how well our trained machine learning
model performs. Here's what happens:

Page 8 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

1. Testing the Model: After we've trained our model on a specific dataset,
we give it a different dataset to see how well it performs. This dataset is
called a test dataset.

2. Checking Accuracy: We measure how accurate our model is by

comparing its predictions with the actual outcomes in the test dataset. This
gives us a percentage that shows how well the model performs according
to the project's requirements or the problem we're trying to solve.

The goal of this step is to ensure that our model is reliable and gives accurate
predictions when applied to new data.

7. Deployment
In the "Deployment" phase, we put our machine learning model to work in the
real world. Here's how it unfolds:

1. Real-world Implementation: After ensuring our model delivers accurate

results at an acceptable speed, we integrate it into the actual system where
it will be used.

2. Performance Monitoring: Before fully deploying the project, we

continue to monitor the model's performance with real-world data. This
ensures that it maintains its accuracy and effectiveness over time.

Think of the deployment phase as finalizing and presenting our project's findings.
It's the culmination of all the hard work put into developing and refining the
machine learning model.

Applications of Machine learning

Machine learning is a buzzword for today's technology, and it is growing very
rapidly day by day. We are using machine learning in our daily life even without
knowing it such as Google Maps, Google assistant, Alexa, etc. Below are some
most trending real-world applications of Machine Learning

Page 9 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

1. Image Recognition:

Image recognition, a key application of machine learning, helps computers

identify objects, people, places, and more in digital images. One popular example
is automatic friend tagging on Facebook:

When we upload a photo with our friends on Facebook, the platform

automatically suggests tagging them by name. This is made possible by machine
learning algorithms that detect and recognize faces.

Behind the scenes, Facebook uses a project called "Deep Face" for face
recognition and identifying people in photos. It's all about making it easier for us
to tag our friends in pictures without having to manually do it ourselves.

2. Speech Recognition:
Speech recognition, a common use of machine learning, powers features like
"Search by voice" in Google.

It works by converting spoken words into text, also known as "Speech to text."
Many applications, like Google Assistant, Siri, Cortana, and Alexa, use
machine learning algorithms for speech recognition. They understand and
respond to voice commands, making it easier for users to interact with technology
using their voice.

Page 10 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

3. Traffic prediction:
When we use Google Maps to navigate to a new destination, it not only shows us
the shortest route but also predicts the traffic conditions along the way.

This prediction is based on two main factors:

1. Real-time data: Google Maps gathers information about the current

location of vehicles through its app and various sensors. It tracks the
movement of cars on the roads to determine if traffic is flowing smoothly,
moving slowly, or heavily congested.

2. Historical data: Google Maps also considers past traffic patterns for the
same route and time of day. By analyzing data from previous days, it
estimates how long it typically takes to travel the route at that particular
time.

By combining real-time and historical data, Google Maps can provide accurate
predictions about traffic conditions, helping users plan their journeys more
efficiently.

4. Product recommendations:
Many e-commerce and entertainment companies like Amazon and Netflix use
machine learning to recommend products to users.

For example, when we search for a product on Amazon, we might start seeing
ads for similar products while browsing the internet. This is because Amazon's
machine learning algorithms understand our interests and suggest relevant
products.

Similarly, when we use Netflix, we receive recommendations for movies and TV

shows based on our viewing history. Machine learning helps Netflix understand
our preferences and suggests content we're likely to enjoy.

5. Self-driving cars:

Page 11 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

Self-driving cars represent one of the most fascinating applications of machine

learning. Tesla, a leading car manufacturer, is at the forefront of developing self-
driving technology.

In self-driving cars, machine learning algorithms play a crucial role in enabling

vehicles to navigate and make decisions autonomously. Tesla utilizes
unsupervised learning methods to train its car models to detect and recognize
people, objects, and obstacles while driving.

This technology allows self-driving cars to perceive their surroundings, make

real-time decisions, and safely navigate roads without human intervention. It's an
exciting advancement that holds the promise of revolutionizing transportation and
improving road safety in the future.

6. Email Spam and Malware Filtering:

When we receive emails, they're automatically sorted into important ones, regular
ones, and spam. This sorting is done using machine learning technology.

Gmail, for example, uses various filters to identify spam emails:

1. Content Filter
2. Header Filter
3. Blacklists
4. Rules-based Filters
5. Permission Filters

Machine learning algorithms like Multi-Layer Perception, Decision Trees, and

Naïve Bayes Classifier are employed to analyze emails and determine if they're
spam or not. These algorithms learn from patterns and characteristics of known
spam emails to make accurate predictions and keep our inboxes safe from
unwanted messages and malware threats.

7. Virtual Personal Assistant:

Virtual personal assistants like Google Assistant, Alexa, Cortana, and Siri are like
our digital helpers. We can ask them questions or give them commands using our
voice.

Page 12 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

They use machine learning to understand and respond to our voice instructions.
Here's how it works:

1. We speak to the assistant, giving it a command or asking a question.

2. The assistant records our voice and sends it to a server on the cloud.
3. Machine learning algorithms analyze our voice and decode what we said.
4. Based on what it understands, the assistant takes action, like playing music,
making a call, opening an email, or scheduling an appointment.
So, thanks to machine learning, these assistants can understand our voice
instructions and help us with various tasks quickly and efficiently.

8. Online Fraud Detection:

Machine learning is helping keep our online transactions safe from fraud. When
we make a transaction online, there are various ways fraudsters can try to steal
money, like using fake accounts or stealing information during the transaction.

To detect fraud, we use a type of machine learning algorithm called Feed Forward
Neural Networks. These algorithms analyze patterns in our transactions to
determine if they're genuine or fraudulent.

Here's how it works:

1. Each genuine transaction is converted into hash values, which are unique
identifiers.
2. These hash values are used as inputs for the next round of transactions.
3. Machine learning algorithms look for patterns in these transactions.
Genuine transactions have a specific pattern that changes for fraudulent
ones.
4. If the algorithm detects a pattern that suggests fraud, it alerts us, helping
keep our online transactions secure.

So, thanks to machine learning, our online transactions are safer and more secure,
protecting us from potential fraudsters.

9. Stock Market trading:

Machine learning is heavily utilized in stock market trading to predict market

trends. The stock market is known for its fluctuations, so to forecast these
changes, machine learning algorithms like Long Short-Term Memory (LSTM)
neural networks are employed.

Page 13 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

Here's how it works:

1. Historical data on stock prices, trading volumes, and other relevant factors
are collected.
2. This data is fed into machine learning algorithms like LSTM neural
networks.
3. The algorithms analyze patterns and trends in the data to predict future
stock market movements.
4. Based on these predictions, traders can make informed decisions about
buying, selling, or holding stocks.

By using machine learning, traders can better understand market dynamics and
make more effective investment choices, mitigating risks and maximizing
returns.

10. Medical Diagnosis:

Machine learning is revolutionizing medical diagnosis by helping doctors detect

diseases more accurately and efficiently. One example is in the field of neurology,
where machine learning techniques are used to diagnose brain tumors and other
brain-related conditions.

Here's how it works:

1. Medical professionals collect various types of data, such as medical images

(like MRI or CT scans) and patient medical history.
2. Machine learning algorithms analyze this data to identify patterns and
abnormalities that may indicate the presence of diseases, such as brain
tumors.
3. By processing large amounts of data, these algorithms can make
predictions and assist doctors in making accurate diagnoses.
4. Additionally, machine learning can aid in the creation of 3D models that
help visualize the exact location and extent of lesions or abnormalities in
the brain.
Overall, machine learning in medical diagnosis enhances the speed and accuracy
of identifying diseases, leading to better patient outcomes and improved medical
treatments.

11. Automatic Language Translation:

Page 14 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

Machine learning has made language translation easier than ever before. When
we visit a new place and don't know the language, we can rely on automatic
translation tools to help us communicate.

Google's GNMT (Google Neural Machine Translation) is one such tool. It uses a
type of machine learning called a sequence-to-sequence learning algorithm to
translate text from one language to another.

Here's how it works:

1. We input text in a language we don't understand.

2. The machine learning algorithm processes this text and translates it into a
language we're familiar with.
3. This translation happens in real-time, allowing us to understand and
communicate effectively even if we don't know the local language.

Overall, automatic language translation powered by machine learning makes it

easier for people to connect and communicate across different languages and
cultures.

Concept Learning
✓ Inducing general functions from specific training examples is a main issue
of machine learning.

Imagine you have a big box of LEGO bricks, and your task is to build a specific
type of vehicle, let's say a car. You've never built this exact car before, but you
have a few examples of cars that others have built using LEGO bricks. Now, you
want to figure out how to build your own car using those examples.

Here's how this relates to machine learning:

1. Training Examples (LEGO Cars): You have some examples of cars that
others have built using LEGO bricks. Each car is built in a specific way,
with certain types of bricks arranged in a particular order.

2. General Functions (Building Instructions): Your goal is to figure out a

set of building instructions or rules that can help you build any car, not just
the ones you've seen before. These instructions should be general enough
to apply to any car design.

Page 15 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

3. Inducing from Examples (Learning): You start by studying the cars you
have as examples. You look at how they're built, what types of bricks are
used, and how they're arranged. By observing these examples, you try to
induce or infer general rules or patterns that explain how cars are built.

4. Machine Learning (Learning from Data): In machine learning, this

process of learning from examples to induce general rules or functions is
similar. Instead of LEGO cars, you have training examples of data, like
images of cars or numerical data about cars. The machine learning
algorithm learns from these examples to generalize and make predictions
or classifications on new, unseen data.

So, the main issue in machine learning is figuring out how to generalize from
specific training examples to create models or functions that can accurately make
predictions or classifications on new, unseen data. Just like in the LEGO car
example, it's about learning from what you've seen to make educated guesses
about what you haven't seen yet.

✓ Concept Learning: Acquiring the definition of a general category from

given sample positive and negative training examples of the category.

Imagine you have a collection of fruits on a table, and you're trying to learn what
makes a fruit an "apple" based on examples.

1. Positive Examples (Apples): You have some apples in your collection.

These are the fruits that you know are definitely apples because they have
all the characteristics you associate with apples – they're red, round, and
have a stem on top.

2. Negative Examples (Non-Apples): You also have some other fruits like
oranges, bananas, and pears in your collection. These are the fruits that you
know are definitely not apples because they lack some of the characteristics
you associate with apples – they're not red, they're not round, or they don't
have a stem like apples do.

3. Learning the Concept (Defining an Apple): Based on these examples,

you start to form a concept or definition of what makes a fruit an apple.
You observe that apples are typically red or green, round in shape, and have
a stem on top. These characteristics help you distinguish apples from other
fruits in your collection.

Page 16 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

4. Generalizing the Concept: After observing several examples of apples

and non-apples, you generalize the concept to apply beyond the specific
examples you've seen. You come up with a general definition of an apple
that includes its typical color, shape, and other distinguishing features.

5. Testing the Concept: Finally, to validate your concept, you may encounter
new fruits that you haven't seen before. Using the concept you've learned,
you can now make predictions about whether these new fruits are apples
or not based on their characteristics.

In concept learning, the goal is to learn the defining characteristics of a category

(in this case, apples) from examples, both positive (apples) and negative (non-
apples), and then generalize that knowledge to classify new instances. This
process is similar to how humans learn and categorize objects based on their
features and characteristics.

✓ Concept Learning can seen as a problem of searching through a

predefined space of potential hypotheses for the hypothesis that best fits
the training examples.

Imagine you're trying to find a missing puzzle piece that fits into a puzzle you're
working on.

1. The Puzzle Pieces (Potential Hypotheses): You have a collection of

puzzle pieces, each with a different shape and pattern. These pieces
represent potential hypotheses about what the missing piece might look
like. Each piece is a candidate solution, or hypothesis, to complete the
puzzle.

2. The Missing Piece (Best Fit): You're searching for a specific puzzle piece
that fits perfectly into the gap in your puzzle. This missing piece represents
the hypothesis that best fits the training examples you have.

3. Searching for the Missing Piece (Searching for the Best Hypothesis):
You start by examining each puzzle piece in your collection, trying to find
the one that fits the gap in your puzzle. Similarly, in concept learning, you
search through a predefined space of potential hypotheses (possible
definitions or rules) to find the one that best fits the training examples.

4. Evaluating the Fit (Matching Training Examples): As you examine

each puzzle piece, you compare it to the gap in your puzzle to see how well

Page 17 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

it fits. Similarly, in concept learning, you evaluate each hypothesis by

comparing it to the training examples. The hypothesis that best matches or
fits the examples is the one you're looking for.

5. Selecting the Best Fit (Selecting the Best Hypothesis): After examining
all the puzzle pieces, you select the one that fits the gap in your puzzle the
best. This piece represents the hypothesis that best fits the training
examples. In concept learning, you select the hypothesis that best fits the
examples based on certain criteria, such as accuracy or simplicity.

6. Using the Selected Piece (Using the Best Hypothesis): Once you've
found the missing puzzle piece that fits the gap in your puzzle, you place
it in the puzzle to complete it. Similarly, in concept learning, you use the
selected hypothesis to classify or make predictions about new instances
based on the learned concept.

In summary, concept learning as a search problem involves searching through a

predefined space of potential hypotheses to find the hypothesis that best fits the
training examples. It's akin to searching for a missing puzzle piece that completes
a puzzle, where each piece represents a possible solution, and the best fit is
selected based on how well it matches the training examples.

✓ The hypothesis space has a general-to-specific ordering of hypotheses,

and the search can be efficiently organized by taking advantage of a
naturally occurring structure over the hypothesis space.

Imagine you're playing a guessing game where you have to figure out what kind
of thing your friend is thinking of. They'll give you hints, but you have to guess
based on those hints.

1. Hypothesis Space: Think of this as your list of guesses about what your
friend might be thinking of. Each guess is a different idea, like "animal,"
"vehicle," "food," etc.

2. General-to-Specific Ordering: Your guesses are organized from broad to

specific. For example, "thing" is a very broad guess, while "cat" or "car"
are more specific guesses.

3. Efficient Search: Instead of randomly guessing, you start with broad

guesses first, like "thing" or "object," and see if they match the hints your

Page 18 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

friend gives. Then, based on the feedback, you can make more specific
guesses until you figure out what your friend is thinking of.

So, by organizing your guesses from general to specific and searching efficiently,
you can quickly determine what your friend is thinking of in the game. This is
similar to how machine learning algorithms work when trying to classify or
identify things based on given information.

A Formal Definition for Concept Learning

Inferring a Boolean-valued function from training examples of its input and

output.

Imagine you have a magical box that can predict whether it will rain or not based
on certain clues, like the temperature, humidity, and wind speed. Your goal is to
figure out how this magical box makes its prediction by observing examples of
when it has correctly predicted rain or no rain.

1. Boolean-valued Function: Think of this as a special rule or formula inside

the magical box. It takes in certain inputs, like temperature, humidity, and
wind speed, and gives a simple "yes" (rain) or "no" (no rain) answer.

2. Training Examples: These are like past instances where you know the
inputs (like temperature, humidity, etc.) and the corresponding outputs
(whether it rained or not). For example, you might have data for days when
it was sunny and the magical box said "no rain," and for days when it was
cloudy and the box said "rain."

3. Inferring: Your task is to figure out the secret rule or formula inside the
magical box based on these examples. You want to learn how it decides
whether it will rain or not based on the inputs it receives.

So, inferring a Boolean-valued function from training examples is like trying to

understand the hidden logic behind a magic box that predicts rain. By looking at
past examples where the box made correct predictions, you're trying to uncover
the simple rule it follows to make those predictions. Once you understand the
rule, you can use it to predict future outcomes.

Page 19 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

Last Update Mark Point

https://www.javatpoint.com/applications-of-machine-learning

and Book on PDF –UNIT-1

Important URL while making Notes on ML

https://medium.com/datadriveninvestor/3-steps-introduction-to-machine-learning-and-design-of-a-
learning-system-bd12b65aa50c

https://chat.openai.com/c/17d7fdc7-58a3-4409-b4c0-a9b77a9ed0e2

Page 20 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

Page 21 of 22
 lOMoARcPSD|37347388

NCB UNIT-1. Introduction to Machine Learning

Page 22 of 22