Guardrail Tutorials#
Use the following tutorials to learn how to accomplish common guardrail tasks using the NeMo Guardrails microservice.
Tip
The tutorials reference an GUARDRAILS_BASE_URL whose value will depend on the ingress in your particular cluster. If you are using the minikube demo installation, it will be http://nemo.test. Otherwise, you will need to consult with your own cluster administrator for the ingress values.
Integrate NeMo Guardrails with NemoGuard NIMs using Helm
Set up NeMo Guardrails with a LLM NIM and NemoGuard NIMs with KV cache reuse enabled.
Parallel Rails
Configure parallel rails for input and output guardrails.
Multi-modal Data
Safety checks for multimodal data with NeMo Guardrails microservice.
Injection Detection
Configure checks for SQL, XSS, template, and code injection.
Custom HTTP Headers
Add custom HTTP headers to requests
Custom LLM Providers
Send requests to custom LLM providers