Recap
13 May 2024 08:10
Session 29 - MLOps Tools Overview Page 1
Core Aspects [Revision]
13 May 2024 08:11
Session 29 - MLOps Tools Overview Page 2
Benefits of MLOps
13 May 2024 16:06
1. Data Management
1. Scalability
2. Development Practices
2. Improved performance
3. Version Control
3. Reproducibility
4. Experiment Tracking/Model Registry
4. Collaboration and efficiency
5. Model Serving and CI/CD
5. Risk reduction
6. Automation
6. Cost Savings
7. Monitoring and Retraining
7. Faster time to market
8. Infrastructure Management
8. Better compliance and governance
9. Collaboration and Operations
10. Governance and Ethics
Session 29 - MLOps Tools Overview Page 3
Challenges
13 May 2024 16:06
1. Complexity of ml models [variability, black box nature]
2. Multitude of models
3. Quality of data
4. Cost and resource constraints
5. Handling scale
6. Security risks
7. Compliance and regulatory concerns
8. Integration with existing systems
9. Limited Expertise/Skill gap
Session 29 - MLOps Tools Overview Page 4
Prerequisites
13 May 2024 16:07
1. Basic understanding of ML
a. Cleaning and preprocessing
b. Feature engineering
c. Model building
2. Software development skills
a. Python
b. Git
c. Software development best practices [OOP, Design Patterns]
3. Data Engineering
a. SQL
b. Big Data Tech [Spark, Kafka]
c. Data Storage Solutions [Databases, Data Warehouses, Data lakes]
4. DevOps Principles and Tools
a. CI/CD Pipeline
b. Automation
5. Familiarity with cloud platforms
a. AWS, GCP and Azure
6. Containerization technologies
a. Docker
b. Kubernetes
7. Networking Principles
a. Distributed computing
8. Security Fundamentals
a. Cybersecurity fundamentals
9. Soft Skills
Session 29 - MLOps Tools Overview Page 5
MLOps Tools Stack
14 May 2024 09:23
An MLOps tool stack refers to the set of tools and technologies used together to
facilitate the practice of Machine Learning Operations (MLOps). This involves
managing the lifecycle of machine learning models from development through
deployment and maintenance, incorporating principles from DevOps in the
machine learning context. The goal of an MLOps tool stack is to streamline the
process of turning data into actionable insights and models into reliable, scalable,
and maintainable production systems.
Session 29 - MLOps Tools Overview Page 6
Session 29 - MLOps Tools Overview Page 7
1. End to End MLOps Platforms
13 May 2024 08:16
Advantages Disadvantages
Easy to setup and use Cost
Standardization and consistency across projects Vendor lock-in
Good for quick experimentation Limited options to customize
Reduced IT overheads Privacy concerns
Enhanced security
Better support
Session 29 - MLOps Tools Overview Page 8
2. Data Management Tools
13 May 2024 18:23
Data Ingestion Data Transformation
Overall Tools
Data Validation
Data Pipeline
Data Versioning Data Annotation
Feature Stores
Data Observability
Data Governance
Data Security
Session 29 - MLOps Tools Overview Page 9
Data Observability Data Governance
1. Data drift • Data Cataloguing: Helps organizations
2. Pipeline failure organize and access their data assets.
3. Monitoring resource usage • Policy Management: Allows the
4. Throughput creation and enforcement of data
5. Latency governance policies.
• Automated Data Lineage: Tracks the
origin, movement, and transformation
Data Security of data.
• Privacy and Security: Helps
1. Data Encryption at rest, in organizations comply with data
transit and in use protection regulations like GDPR.
2. Role based access control
3. Data masking and
anonymization
4. Audit Trails - Keeping
detailed logs of all data
access and changes to track
how data is used and by
whom.
5. Backup and Disaster
recovery
Session 29 - MLOps Tools Overview Page 10
Session 29 - MLOps Tools Overview Page 11
3. Model Building
13 May 2024 23:55
Session 29 - MLOps Tools Overview Page 12
4. Model Deployment
13 May 2024 23:56
Session 29 - MLOps Tools Overview Page 13
5. Post Deployment
13 May 2024 23:56
Session 29 - MLOps Tools Overview Page 14
6. Orchestrators
14 May 2024 01:42
Session 29 - MLOps Tools Overview Page 15
MLOps Maturity Levels
13 May 2024 16:06
Session 29 - MLOps Tools Overview Page 16
How to select a MLOps tool?
13 May 2024 08:18
Session 29 - MLOps Tools Overview Page 17
