NeMo Agent Toolkit Examples

Each NVIDIA NeMo Agent toolkit example demonstrates a particular feature or use case of the NeMo Agent toolkit library. Most of these contain a custom workflow along with a set of custom tools (functions in NeMo Agent toolkit). These examples can be used as a starting off point for creating your own custom workflows and tools. Each example contains a README.md file that explains the use case along with instructions on how to run the example.

Examples Repository

In addition the examples in this repository, there are examples in the NeMo-Agent-Toolkit-Examples repository.

The difference between the examples in this repository and the NeMo-Agent-Toolkit-Examples repository is that the examples in this repository are maintained, tested, and updated with each release of the NeMo Agent toolkit. These examples have high quality standards and demonstrate a capability of the NeMo Agent toolkit.

The examples in the NeMo-Agent-Toolkit-Examples repository are community contributed and are tied to a specific version of the NeMo Agent toolkit, and do not need to demonstrate a specific capability of the library.

Table of Contents

Installation and Setup
Example Categories
Documentation Guide Files
- Locally Hosted LLMs
- Workflow Artifacts

Installation and Setup

To run the examples, install the NeMo Agent toolkit from source, if you haven't already done so, by following the instructions in Install From Source.

Example Categories

Getting Started

scaffolding: Workflow scaffolding and project generation using automated commands and intelligent code generation
simple_web_query: Basic LangSmith documentation agent that searches the internet to answer questions about LangSmith.
simple_calculator: Mathematical agent with tools for arithmetic operations, time comparison, and complex calculations

Agents

mixture_of_agents: Multi-agent system with ReAct agent coordinating multiple specialized Tool Calling agents
react: ReAct (Reasoning and Acting) agent implementation for step-by-step problem-solving
rewoo: ReWOO (Reasoning WithOut Observation) agent pattern for planning-based workflows
tool_calling: Tool-calling agent with direct function invocation capabilities

Advanced Agents

AIQ Blueprint: Blueprint documentation for the official NVIDIA AIQ Blueprint for building an AI agent designed for enterprise research use cases.
alert_triage_agent: Production-ready intelligent alert triage system using LangGraph that automates system monitoring diagnostics with tools for hardware checks, network connectivity, performance analysis, and generates structured triage reports with root cause categorization
profiler_agent: Performance profiling agent for analyzing NeMo Agent toolkit workflow performance and bottlenecks using Phoenix observability server with comprehensive metrics collection and analysis
vulnerability_analysis_blueprint: Blueprint documentation for vulnerability analysis agents

Control Flow

router_agent: Configurable Router Agent that analyzes incoming requests and directly routes them to the most appropriate branch (other agents, functions or tools) based on request content
sequential_executor: Linear tool execution pipeline that chains multiple functions together where each function's output becomes the input for the next function, with optional type compatibility checking and error handling

Custom Functions

automated_description_generation: Intelligent system that automatically generates descriptions for vector database collections by sampling and summarizing documents
plot_charts: Multi-agent chart plotting system that routes requests to create different chart types (line, bar, etc.) from data

Evaluation and Profiling

email_phishing_analyzer: Evaluation and profiling configurations for the email phishing analyzer example
simple_calculator_eval: Evaluation and profiling configurations based on the basic simple calculator example
simple_web_query_eval: Evaluation and profiling configurations based on the basic simple web query example
swe_bench: Software engineering benchmark system for evaluating AI models on real-world coding tasks

Frameworks

adk_demo: Minimal example using Google Agent Development Kit showcasing a simple weather time agent that can call tools (a function tool and an MCP tool)
agno_personal_finance: Personal finance planning agent built with Agno framework that researches and creates tailored financial plans
haystack_deep_research_agent: Deep research agent using Haystack framework that combines web search and Retrieval Augmented Generation (RAG) capabilities with SerperDev API and OpenSearch
multi_frameworks: Supervisor agent coordinating LangChain/LangGraph, LlamaIndex, and Haystack agents for research, RAG, and chitchat tasks
semantic_kernel_demo: Multi-agent travel planning system using Microsoft Semantic Kernel with specialized agents for itinerary creation, budget management, and report formatting, including long-term memory for user preferences

Front Ends

simple_auth: Simple example demonstrating authentication and authorization using OAuth 2.0 Authorization Code Flow
simple_calculator_custom_routes: Simple calculator example with custom API routing and endpoint configuration

Human In The Loop (HITL)

por_to_jiratickets: Project requirements to Jira ticket conversion with human oversight
simple_calculator_hitl: Human-in-the-loop version of the basic simple calculator that requests approval from the user before allowing the agent to make additional tool calls

Memory

redis: Basic long-term memory example using redis

Model Context Protocol (MCP)

simple_auth_mcp: Demonstrates how to use the NVIDIA NeMo Agent toolkit with MCP servers that require authentication using OAuth2 flows
simple_calculator_mcp: Demonstrates Model Context Protocol support using the basic simple calculator example

Notebooks

Building an Agentic System: Series of notebooks demonstrating how to build, connect, evaluate, profile and deploy an agentic system using the NeMo Agent toolkit

Getting Started - Getting started with the NeMo Agent toolkit
Bringing Your Own Agent - Bringing your own agent to the NeMo Agent toolkit
Adding Tools and Agents - Adding tools to your agentic workflow
Multi-Agent Orchestration - Setting up a multi-agent orchestration workflow
Observability, Evaluation, and Profiling - Instrumenting with observability, evaluation and profiling tools

Brev Launchables

GPU Cluster Sizing: GPU Cluster Sizing with NeMo Agent Toolkit

Object Store

user_report: User report generation and storage system using object store (S3, MySQL, and/or memory)

Observability

simple_calculator_observability: Basic simple calculator with integrated monitoring, telemetry, and observability features

Retrieval Augmented Generation (RAG)

simple_rag: Complete RAG system with Milvus vector database, document ingestion, and long-term memory using Mem0 platform

UI

UI: Guide for integrating and using the web-based user interface of the NeMo Agent toolkit for interactive workflow management.

Documentation Guide Files

Locally Hosted LLMs

nim_config: Configuration for locally hosted NIM LLM models
vllm_config: Configuration for locally hosted vLLM models

Workflow Artifacts

custom_workflow: Artifacts for the Custom Workflow tutorial
text_file_ingest: Artifacts for the Text File Ingest tutorial