KEMBAR78
ML Model Deployment Guide | PDF | Proprietary Software | Computing
Scribd
Upload
20 views14 pages

ML Model Deployment Guide

The document discusses model deployment, which is the process of publishing a machine learning model from local development to a larger user base. It covers serializing models, exposing models through REST APIs, packaging models for reproducibility, creating ML pipelines, and scaling models. Methods discussed include batch and real-time prediction, model serialization, creating REST APIs with Flask, using Docker for portability, and using Kubernetes for fault tolerance, auto-scaling, load balancing and rolling updates.

Uploaded by

ph8ks7p89g
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
20 views14 pages

ML Model Deployment Guide

The document discusses model deployment, which is the process of publishing a machine learning model from local development to a larger user base. It covers serializing models, exposing models through REST APIs, packaging models for reproducibility, creating ML pipelines, and scaling models. Methods discussed include batch and real-time prediction, model serialization, creating REST APIs with Flask, using Docker for portability, and using Kubernetes for fault tolerance, auto-scaling, load balancing and rolling updates.

Uploaded by

ph8ks7p89g
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 14

prajwalarora4@gmail.

com
V8KLJAWU90
Model Deployment
Putting your ML system into production

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Agenda
- Serializing machine learning models
- Exposing the model through Rest APIs
- Packaging for reproducibility
- Create ML pipeline
prajwalarora4@gmail.com
- Scaling the model
V8KLJAWU90

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
What is model deployment?
ML model deployment is the process of publishing your model, which is currently
in your local machine, to a larger user base.

prajwalarora4@gmail.com
V8KLJAWU90

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
ML Process Overview

prajwalarora4@gmail.com
V8KLJAWU90

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Modes of training and serving the models

- Train: one off, batch and real-time/online training

prajwalarora4@gmail.com
V8KLJAWU90

- Serve: batch, real-time (web service, in-app, database trigger)

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Batch prediction

prajwalarora4@gmail.com
V8KLJAWU90

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Real-time prediction

prajwalarora4@gmail.com
V8KLJAWU90

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
prajwalarora4@gmail.com
V8KLJAWU90 Model serialization aka pickling

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
prajwalarora4@gmail.com
V8KLJAWU90 Create REST API using flask

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Docker - what problem it solves?
- Build once and run anywhere with Docker
- No environment issues
- No OS issues
- Preconfigured environment
prajwalarora4@gmail.com
V8KLJAWU90

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Kubernetes - why to use?
Kubernetes is an orchestration platform
which enables -
- Fault tolerance
- Auto-Scale
prajwalarora4@gmail.com
- Load Balancing
V8KLJAWU90

- Rolling service updates

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
Deploy and scale docker with kubernetes
prajwalarora4@gmail.com
V8KLJAWU90

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
prajwalarora4@gmail.com
V8KLJAWU90
Any Questions?

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.
prajwalarora4@gmail.com
V8KLJAWU90
Thank you!
Happy Learning :)

This file is meant for personal use by prajwalarora4@gmail.com only.


Sharing or publishing
Proprietary content. © Great the contents
Learning. in partUnauthorized
All Rights Reserved. or full isuse
liable for legal
or distribution action.
prohibited.

You might also like