Academy
CUMULUS LINUX OVERVIEW Academy
UNIT 1
Outline Academy
Academy
Unit Outline
Open Ethernet Initiative
Cumulus Linux Overview
Cumulus Linux Architecture
Cumulus Linux Configuration Tools
NVIDIA Networking Switch Systems
Academy
Academy OPEN ETHERNET
Open Ethernet Initiative Academy
Traditionally, Ethernet switches were a “locked” solution. Hardware and software were
provided by the same vendor. The Open Ethernet initiative allows a complete separation
of the switch hardware from the switch software.
By eliminating this dependency, Open Ethernet allows any software to run on any hardware:
Freedom of choice
Flexibility. Either hardware or software can be replaced or upgraded without changing the
other components.
Open-source solution
Traditional Ethernet Switch Open Ethernet Switch
HW SW HW SW
4
4
Open Ethernet Architecture Academy
The solution offers:
The freedom to choose each of the following
components: Protocol Stack
Switch silicon
Switch system
NOS (Network Operating System) NOS
Software stack
Open Network Install Environment (ONIE): System
Defines an open “install environment” so that bare metal
network switches can be installed with different network Silicon
operating systems.
Applies a similar approach to OS installation on a server.
5
What is Cumulus Linux? Academy
An OS for Open Ethernet switches
Native Linux distribution
Open and proven, not proprietary, not “Linux-like”
Based on Debian-Buster
Makes a switch behave like a Linux server with many ports
Provides Linux tools for switches:
Server provisioning/management tools work on the switch
Cumulus Linux benefits:
Same NOS runs on switches from multiple vendors
Linux admins can run the network
Linux across the data center: server, storage & network
6
Cumulus Linux Architecture Academy
7
7
Cumulus Linux Architecture Academy
Components
Configuration and Management
Almost any Linux tool can be leveraged for configuration and management
Cumulus Linux includes traditional user space tools like iproute2, brctl,
bridge, iptables, as well as Cumulus Linux authored tools such as ifupdown2
and NCLU
NCLU
Network Protocols FRRouting
User space tools are available for Linux hosts, such as:
FRRouting protocol suite for all routing functions
mstpd for Spanning Tree Protocol
lldpd for Link Layer Discovery Protocol
Linux kernel LACP for Link Layer Aggregation Protocol
8
Cumulus Linux Components Academy
Networking Model
The Linux kernel provides all of the constructs and operating principles Linux
for all networking functions, such as:
Routing tables, ARP/neighbor table, bridges, bonding, VLANs , interfaces,
packet filtering (ACLs)
Everything else!
Device Driver switchd
A service called switchd peers with the kernel and its operational file system
(/proc, /sys, /etc) and the networking ASICs by including ASIC partner Software
Design Kits (SDKs)
Networking ASICs
Cumulus Linux supports Networking ASICs from different vendors
9
Cumulus Linux Configuration Tools Academy
Linux non modal CLI
cumulus@leaf1:mgmt:~$ ifconfig swp1 172.16.12.1/24
Industry standard modal CLI
cumulus@leaf1:mgmt:~$ sudo vtysh
leaf1# configure terminal
leaf1(config)# interface swp1
leaf1(config-if)# ip address 172.16.12.1/24
NCLU - Network Command Line Utility
cumulus@leaf1:mgmt:~$ net add interface swp1 ip address 172.16.12.1/24
10
Cumulus Linux Configuration Files Academy
Interfaces configuration file
cumulus@leaf1:mgmt:~$ cat /etc/network/interfaces
auto eth0
iface eth0 inet dhcp
auto swp1
iface swp1
address 172.16.12.1/24
Routing protocols configuration file
cumulus@leaf1:mgmt:~$ sudo cat /etc/frr/frr.conf
frr version 4.0+cl3u3
frr defaults datacenter
username cumulus nopassword
!
router ospf
ospf router-id 172.16.100.1
network 172.16.12.0/24 area 0.0.0.0
!
11
Cumulus VX – Try On Your Own Academy
Cumulus VX is a free virtual appliance which enables cloud admins and
network engineers to preview and test Cumulus Linux technology at
zero cost.
Cumulus VX benefits:
▪ Runs on your computer - it's easy to quickly get up and running.
▪ Compatible with popular hypervisors - VMware, KVM, VirtualBox and
Vagrant.
▪ Preview Cumulus Linux - uses the same tools that you would in
production.
▪ Test the technology - cloud admins and network engineers can test our
technology at zero cost.
https://cumulusnetworks.com/products/cumulus-vx/
Cumulus VX
12
Cumulus In The Cloud Virtual Data Center Academy
Cumulus in the Cloud (CITC) is a free, virtual, pre-built data center.
Simply access from your web browser.
CITC benefits:
▪ Try for free - Try open networking at no cost, and preview Cumulus Linux and Cumulus NetQ.
▪ Get your hands dirty - Access all the open networking tools you need to do a virtual proof of
concept for your web-scale network.
▪ Explore - Get a guided tour of open networking technology or experiment with features to your
heart’s content.
https://cumulusnetworks.com/products/cumulus-in-the-cloud/
13
Academy
Academy SN2000 Switch Family
Spectrum - 1/10/25/40/50/100GbE
TM Academy
▪ Leading performance: Ethernet
Consortium
▪ Non-blocking 6.4Tbps switching
▪ Sub-300ns port-to-port latency
▪ Zero packet loss Open Ethernet
▪ Predictable Performance
Open Compute
▪ Fair traffic distribution for cloud Project
▪ Best-in-class throughput, latency, power
consumption
Energy Efficient
Open Source API
SAI
15
29
SN2000 Switch Systems Academy
SN2700 - 32 ports of 100GbE
Ideal ToR / aggregation
Spine or leaf
SN2410 - 8 ports of 100GbE and 48 ports of
25GbE Leaf or ToR
SN2100 – 16 ports of 100GbE
Ideal storage/database switch
Highest 25GbE density per rack unit
SN2010 – 4 ports of 100GbE and 18 ports of
25GbE Ideal ToR solution for hyper converged
and storage deployments
16
Breakout Ports Academy
Cumulus Linux running on NVIDIA switches supports splitting ports connected with Nvidia
break out cables.
A single physical 100G port can be divided into 2x50G or 4x25G ports
A single physical 200G port can be divided into 2x100G or 4x50G ports
Each sub-physical port is then handled as an individual port
100G
25G
25G
25G
17
25G
SN2100 Split Options Academy
▪ Possible “split 4” options: Split 4 1 3 5 7 9 11 13 15 1 3 5 7 9 11 13 15
2 4 6 8 16
10 12 14 16 18 2 4 6 8 10 12 14 16 18
▪ Each 100GbE port can be split into
four 25GbE sub-ports
100GbE (4x25GbE) 25GbE (1x25GbE)
▪ Splitting has no impact on other ports
25GbE (1x25GbE)
▪ 64x25GbE ports in a half width switch 25GbE (1x25GbE)
25GbE (1x25GbE)
▪ 128x25GbE ports in 1U
128x25GbE ports in 1U
18
Academy
Academy SN3000 Switch Family
SpectrumTM2 – 200/400GbE Ethernet Switch ASIC Academy
Leading performance:
Non-blocking 12.8Tbps switching
Sub-425ns port-to-port latency
Zero packet loss
Predictable performance
Fair traffic distribution for cloud
Advanced telemetry with WJHį
20
29
SN3000 Switch Systems Academy
SN3700C – 32 ports of 100GbE
Up to 128x10/25GbE ports with breakout cables
Ideal spine
SN3700 – 32 ports of 200GbE
Ideal spine/super spine
SN3510 – 6 ports of 400GbE and 48 ports of
50GbE Spine/ToR PAM4, 50G 400G
SN3420 – 12 ports of 100GbE and 48 ports of
25GbE non-blocking ToR, 25G 100G
21
SN3700C Split Options Academy
▪ Possible “split 4” options: SN3700C - Split 4
▪ Each 100GbE port can be split into 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31
2 4 6 8 10 12 14 16
16 18 20 22 24 26 28 30 32
four 25GbE sub-ports
▪ Splitting has no impact on other ports
100GbE (4x25GbE) 25GbE (1x25GbE)
▪ 128x25GbE ports in 1U
25GbE (1x25GbE)
25GbE (1x25GbE)
25GbE (1x25GbE)
128x25GbE ports in 1U
22
Academy
Academy SN4000 Switch Family
SpectrumTM3 – 200/400GbE Ethernet Switch ASIC Academy
Leading performance:
Non-blocking 25.6Tbps switching
Sub-600ns port-to-port latency
Zero packet loss
Predictable performance
Fair traffic distribution for cloud
Advanced telemetry with WJHį
24
29
SN4000 Switch Systems Academy
SN4700 - 32 ports of 400GbE in 2U
400G Spine
SN4600C – 64 ports of 100GbE in 2U
100G Spine
SN4600 – 64 ports of 200GbE in 2U
200G Spine, ToR AI
SN4800 – Modular chassis with 8 line cards
Up to 128x100G or 64x200G or 32x400G
2
Outline Academy
Academy
Unit Summary
Open Ethernet Initiative
Cumulus Linux Overview
Cumulus Linux Architecture
Cumulus Linux Configuration Tools
NVIDIA Networking Switch Systems
