Send the link below via email or IMCopy
Present to your audienceStart remote presentation
- Invited audience members will follow you as you navigate and present
- People invited to a presentation do not need a Prezi account
- This link expires 10 minutes after you close the presentation
- A maximum of 30 users can follow your presentation
- Learn more about this feature in our knowledge base article
Copy of Machine learning Lec
Transcript of Copy of Machine learning Lec
Machine learning definition.
Why machine learning.
Applications of ML.
Machine learning definition
Applications of ML
1- supervised learning
a- Regression example.
Arthur Samuel (1959) defined ML as the field of study that gives computers the ability to learn without being explicitly programmed.
Tom Mitchell (1998) defined well posed learning problem as : A computer program is said to learn from
with respect to some
performance measure P
, if its performance on
as measured by
improves with experience
Suppose your email program watches which email you do or do not mark as spam, and based on that learns how to better filter spam. What is the task T in this setting?
Classifying emails as spam or not spam.
Watching you label emails as spam or not spam.
The number (or fraction) of emails correctly classified as spam/not spam.
None of the above this is not a machine learning problem.
Why machine learning ?
Need to make machines think and learn from mistakes like human.
To notice similarities between things and so generate new ideas.
Attempt to work out why things went wrong (Explanation).
Natural language processing
Stock market analysis
1- Supervised learning
2- Unsupervised Learning
3- Reinforcement learning
- Learning to predict houses prices.
Suppose you collect statistics about how much houses cost according to the square footage of the house.
Size in (feet)^2
Price in 1000's
1- Supervised learning
Data set (input & output)
---> the output you are trying to predict is a
value of the price.
b- Classification example.
- Let's say you collect a dataset on a cancer tumor and you want the program output to predict whether the certain tumor is malignant or benign.
More generally there's other examples that use more than 1 input variable (multi-i/p).
we can predict whether the tumor is malignant or benign through patient age, tumor size ..... so on.
You’re running a company, and you want to develop learning algorithms to address each of two problems.
You have a large inventory of identical items. You want to predict how many of these items will sell over the next 3 months.
You’d like software to examine individual customer accounts, and for each account decide if it has been hacked/compromised.
Should you treat these as classification or as regression problems?
Treat both as classification problems.
Treat problem 1 as a classification problem, problem 2 as a regression problem.
Treat problem 2 as a classification problem, problem 1 as a regression problem.
Treat both as regression problems.
2- Unsupervised learning
Given : Inputs only
Required: Cluster data into groups
Understanding genes data
Social network analysis
Astronomical data analysis
Cocktail party problem
Of the following examples, which would you address using an unsupervised learning algorithm? (Check all that apply.)
Given email labeled as spam/not spam, learn a spam filter.
Given a set of news articles found on the web, group them into set of articles about the same story.
Given a database of customer data, automatically discover market segments and group customers into different market segments.
Given a dataset of patients diagnosed as either having diabetes or not, learn to classify new patients as having diabetes or not.
3- Reinforcement learning
No data set
Have only critic
Credit assignment problem
If you write a program to make an autonomous helicopter to fly, you notice that if you make a wrong decision on a helicopter, the consequence of crashing it may not happen until much later.
Linear regression with one variable
Training set of housing prices
Number of training examples.
In order to design a learning algorithm, the first thing we have to decide is how we want to represent the hypothesis.
Using linear representation for the hypothesis as :
Ɵ + Ɵ
Adding another input(feature)
h(x)= Ɵ + Ɵ X+ Ɵ X
h(x)=∑ Ɵ X
h(x) :- Actual output
Ɵ ,Ɵ ,Ɵ :- Learning algorithm parameters
n:- Number of features (input)
for simplicity, let X =1 ,so
How do we choose the parameter theta so that our hypothesis will make accurate prediction?
we want to make that squared difference between the predicted price and the actual price (cost function) as small as possible
J(Ɵ)=1/2∑(h (x )-y)
Our goal is to minimize the cost function. The algorithm for minimizing is
gradient descent algorithm.
Next Section :)
The checkers example,
is playing checkers
if you win or not
---> output here is
values 0 or 1