Applied Machine Learning
CT046-3-M
Topic 1 Intro to Data Science &
Machine Learning
Outline
Why Data Science?
What is Data Science?
What are some prominent examples of
Data Science?
How to become a Data Scientist?
Who are hiring Data Scientists Now?
CE52604-5-Object Oriented Methods
Module Introduction
Why Data
Science?
CE52604-5-Object Oriented Methods
Module Introduction
The Dawn of Big Data
Google, Yahoo today
Web Search and Computational advertising
Google: 35,000 searches/sec
Yahoo! scale: 600 million users per month, 4
billion clicks per day, 25 terabytes of data
collected every day
Netflix 2007
Movie recommendations, netflix prize
100 million ratings, 500,000 users, 18,000
movies
Amazon 2003
Product recommendations, reviews
29 million customers, millions of products
CE52604-5-Object Oriented Methods
Module Introduction
How Big is Your Data?
Kilobyte (1000 bytes)
Megabyte (1 000 000 bytes)
Gigabyte (1 000 000 000 bytes)
Terabyte (1 000 000 000 000 bytes)
Petabyte (1 000 000 000 000 000 bytes)
Exabyte (1 000 000 000 000 000 000 bytes)
Zettabyte (1 000 000 000 000 000 000 000
bytes)
Yottabyte (1 000 000 000 000 000 000 000 000
bytes)
7
CE52604-5-Object Oriented Methods
Module Introduction
5 Vs of Big Data
Raw Data: Volume
Change over time: Velocity
Data types: Variety
Data Quality: Veracity
Information for Decision Making:
Value
CE52604-5-Object Oriented Methods
Module Introduction
Cloud Computing
The practice of using a network of remote
servers hosted on the Internet to store, manage,
and process data, rather than a local server or a
personal computer-- Gartner IT Glossary
Cloud Computing is a new term for a longheld dream of computing as a utility
-- Above the Clouds, 2009
CE52604-5-Object Oriented Methods
Module Introduction
Cloud Computing = Cloud +
SaaS
Cloud computing refers to both:
Cloud: The hardware and system software in
the datacenters that provide those services.
Public Cloud (Utility Computing) vs. Private Cloud
SaaS: Describes any cloud service where
consumers are able to access software applications
over the internet. (e.g facebook,twitter..)
Cloud Computing started around 2006
Big Data and Data Science (Big Data
Analytics) started around 2011
CE52604-5-Object Oriented Methods
Module Introduction
10
Current Trends
Applications has bigger data and
need
more advanced analysis
Example: Web, Corporate documents
and Emails
Natural Language Processing
Example: Social Media
Network/Graph Analysis
IT Infrastructure moving to Cloud
Computing
Data Science arise given this
application pull and technology
push
CE52604-5-Object Oriented Methods
Module Introduction
11
What is Data
Science?
CE52604-5-Object Oriented Methods
Module Introduction
12
Data Science A Definition
Data Science is the science which uses
computer science, statistics and machine
learning, visualization and human- computer
interactions
to collect, clean, integrate, analyze,
visualize, interact with data to create data
products.
CE52604-5-Object Oriented Methods
Module Introduction
13
Goal of Data Science
Turn data into data
products.
Data to Data Products
Transaction Databases Fraud Detection
Wireless Sensor Data Smart Home
Text Data, Social Media Data
Product Review and Consumer
Satisfaction
Software Log Data Automatic Trouble
Shooting
CE52604-5-Object Oriented Methods
Module Introduction
What are some prominent
examples of
Data Science?
CE52604-5-Object Oriented Methods
Module Introduction
17
Data Products Google
Web Search
Google Ads
News Recommendation
Engine
Google Maps
Currently one of the best if not the best
IT company to work for. (Google event
on Jan 21/22)
CE52604-5-Object Oriented Methods
Module Introduction
Data Products Netflix
Personalized Movie Ratings
Movie Recommendations
Similar Movies
Movie Categories (e.g., 80s movie
with a strong female lead, Kung
Fu movies)
BlockBuster is out of the business
CE52604-5-Object Oriented Methods
Module Introduction
Data Products
LinkedIn/Facebook
People you may know
Applications you may like
Jobs/Events you might be
interested
Classifier for bad users and bad
content
With high accuracy, Facebook can
guess whether you are single or
married
CE52604-5-Object Oriented Methods
Module Introduction
Data Products Twitter
Text Analysis Spam
Filter/Similarity
Search
User
Sentiment/Satisfaction/Feedback
News Breakout
Trend and Topics
200 million users as of 2011,
generating
CE52604-5-Object Oriented Methods
Module Introduction
Data Products Splunk
Degradation, Failure Detection
Identify Security Breach
Event Monitoring
Troubleshoot Tools
Cross-platform Event Correlation
Splunk is an American multinational corporation headquartered
in San Francisco, California, which produces software for
searching, monitoring, and analyzing machine-generated big
data, via a web-style interface.
CE52604-5-Object Oriented Methods
Module Introduction
How to become a Data
Scientist?
CE52604-5-Object Oriented Methods
Module Introduction
23
The Life of Data
Users
Collect
Clean
Integrat Analys
e
is
Data
Sources
CE52604-5-Object Oriented Methods
Module Introduction
Interfac
e
Visualizati
on
Challenges in Data Science
Preparing Data (Noisy, Incomplete,
Diverse, Streaming )
Analyze Data (Scalable, Accurate,
Real- time, Advanced Methods,
Probabilities and Uncertainties ...)
Represent Analysis Results (i.e. data
product) (Story-telling, Interactive,
explainable)
CE52604-5-Object Oriented Methods
Module Introduction
Skill Set of a Data
Scientist
Data Management
Data collection, storage, cleaning, filtering,
integration
Large-scale Parallel Data Processing
Parallel computing
Statistics and Machine Learning
Data modeling, inference, prediction,
pattern recognition
Interface and Data Visualization
HCI design, visualization, story-telling
CE52604-5-Object Oriented Methods
Module Introduction
Who are hiring Data Scientists
Now?
CE52604-5-Object Oriented Methods
Module Introduction
27
Sexy Job in the next 10 years
The sexy job in the next ten years
will be
The ability to take datato be
able to understand it, to process it,
to extract value from it, to
visualize it, to communicate it
thats going to be a hugely
important skill.
-- Hal Varian, Google Chief
CE52604-5-Object Oriented Methods
Module Introduction
Whos hiring Data Scientist?
IT companies: Google, Twitter,
Lexis/Nexis, Facebook.
Media and Financial sectors Fox,
CNN, NYT, Bloomburg,
Research: Biology, Medicine,
Physics,
Psychology,
Information office in government
and corporations
Law firms: e-discovery tools
CE52604-5-Object Oriented Methods
Module Introduction
Books on Data Science
CE52604-5-Object Oriented Methods
Module Introduction
30
Additional Reading Pointers
Data Science Summit (Strata)
(
http://www.datascientistsummit.co
m/
)
Kaggle Competitions (
http://www.kaggle.com/)
Data Science course at Berkeley &
Corsera (http://datascienc.es/ )
CE52604-5-Object Oriented Methods
Module Introduction
31
Summary
Why now: Dawn of Big Data, Need for
Advanced Analytics and Cloud Computing
What is it: Data Data Product, many
examples incl. Google, Netflix, Splunk,
LinkIn
How to become: Data management, parallel
computing and data processing, statistical
machine learning, and visualization skills
Life of Data
Who are hiring: Data Scientists are in great
demands, from industry to government to
science.
CE52604-5-Object Oriented Methods
Module Introduction
32
Question & Answer Session
Q&A
CE52604-5-Object Oriented Methods
Module Introduction
