NeMo Microservices Documentation#
Welcome to the NeMo Microservices documentation.
Introduction to NeMo Microservices#
Learn about the NeMo microservices, how it works at a high-level, and the key features.
Learn about the NeMo Microservices Platform.
Learn about the key features of the NeMo microservices platform.
Learn about the concepts used across the NeMo microservices platform.
Release notes for the NeMo microservices.
Tutorials#
Get started with the NeMo microservices by following the tutorials.
Platform End-to-End Tutorials#
Try out the following tutorials to explore the end-to-end capabilities of the NeMo microservices platform.
Get started with the end-to-end tutorials for the NeMo microservices.
Get started with the Jupyter notebooks for the NeMo microservices.
Quickstart Using Docker Compose#
Try out the following NeMo microservices for local testing using Docker Compose. This is a quick way to explore the capabilities of each functional NeMo microservice as a central service before deploying them on a Kubernetes cluster.
Try out the NeMo Auditor microservice using Docker Compose for local testing.
Try out the NeMo Data Designer microservice using Docker Compose for local testing.
Try out the NeMo Evaluator microservice using Docker Compose for local testing.
Try out the NeMo Guardrails microservice using Docker Compose for local testing.
Install the NeMo Safe Synthesizer locally using Docker Compose and try out private synthetic data generation.
Operation Guides#
Learn how to use each microservice at every stage of the NeMo data flywheel.
Organize and manage AI workloads in the NeMo platform by using namespaces, projects, datasets, and models through the NeMo Entity Store microservice.
Design synthetic data from scratch or seeds to train large language models.
Create private versions of sensitive datasets with PII replacement and synthetic data generation.
Fine-tune your models using customization jobs to improve their performance.
Set evaluation targets, define evaluation configs, and run evaluation jobs to measure your model’s performance.
Audit the safety of your models.
Deploy and proxy NIM for inference.
Manage guardrails to moderate user input and model responses.
Helm Installation Guide for Production#
Install the NeMo microservices using the NeMo Microservices Helm Chart for production.
Use the admin setup guide to learn about deploying the NeMo microservices to Kubernetes.