Software Defined Storage

Overview
August 2019

Juan Jose Floristan

Cloud Specialist Solution Architect

1
 AGENDA

1. Why Red Hat Storage?

2. Red Hat Ceph Storage

3. Red Hat Gluster Storage

4. Red Hat Openshift Container Storage

2
 Why Red Hat
Storage?

3
 Why Red Hat Storage?

STORAGE IS EVOLVING
TRADITIONAL STORAGE OPEN, SOFTWARE-DEFINED STORAGE
Complex proprietary silos Standardized, unified, open platforms

USER USER USER

USER ADMIN

Open Source
Control Plane (API, GUI)

Software
ADMIN ADMIN ADMIN

Ceph Gluster +++

Custom GUI Custom GUI Custom GUI

Hardware
Standard
Proprietary Hardware Proprietary Hardware Proprietary Hardware
Standard Computers
and Disks
Proprietary Proprietary Proprietary
Software Software Software

4
 Why Red Hat Storage?

WHY THIS MATTERS

PROPRIETARY Common,
Lower cost, standardized supply chain
HARDWARE off-the-shelf hardware

SCALE-UP Scale-out
ARCHITECTURE Increased operational flexibility
architecture

HARDWARE-BASED Software-based More programmability, agility,

INTELLIGENCE intelligence and control

CLOSED DEVELOPMENT Open development More flexible, well-integrated

PROCESS process technology

5
 Why Red Hat Storage?

A RISING TIDE
SDS-P MARKET SIZE BY SEGMENT
Software-Defined Storage is leading $1,395M
a shift in the global storage industry, Block Storage
File Storage $1,195M
with far-reaching effects.
Object Storage $1,029M
Hyperconverged
$859M
“By 2020, between 70%-80% of unstructured
$705M
data will be held on lower-cost storage managed
$592M
by SDS.” $475M
Innovation Insight: Separating Hype From Hope for Software-Defined Storage

“By 2019, 70% of existing storage array products

will also be available as software-only versions.” 2013 2014 2015 2016 2017 2018

Innovation Insight: Separating Hype From Hope for Software-Defined Storage 2019 Source: IDC

6
 Why Red Hat Storage?

THE RED HAT STORAGE MISSION

To offer a unified, open software-defined storage

portfolio that delivers a range of data services
for next generation workloads, thereby accelerating
the transition to modern IT infrastructures.

7
 Red Hat Ceph
Storage

8
 Red Hat Ceph Storage

BUSINESS BENEFITS

OPEN SOURCE

No proprietary lock-in, with a large commercial ecosystem and broad community

PEACE OF MIND

Over a decade of active development, proven in production and backed by Red Hat

LOWER COST

More economical than traditional NAS/SAN, particularly at petabyte scale

9
 Red Hat Ceph Storage

RED HAT CEPH STORAGE

Distributed, enterprise-grade object storage, proven at web scale

Open, massively-scalable, software-defined

Flexible, scale-out architecture on clustered standard hardware

Single, efficient, unified storage platform (object, block, file)

User-driven storage lifecycle management with 100% API coverage

S3 compatible object API

Designed for modern workloads like cloud infrastructure and data lakes

10
 Red Hat Ceph Storage

ARCHITECTURAL COMPONENTS

APP HOST/VM CLIENT

RGW RBD CEPHFS

A web services gateway for object A reliable, fully distributed block A distributed file system with POSIX
storage, compatible with S3 and device with cloud platform semantics & scale-out metadata
Swift integration
LIBRADOS
A library allowing apps to directly access RADOS (C, C++, Java, Python, Ruby)

RADOS
A software-based reliable, autonomous, distributed object store comprised of
self-healing, self-managing, intelligent storage nodes and lightweight monitors
11
 Red Hat Ceph Storage

COMPLETE OPENSTACK STORAGE

• Deeply integrated with modular OPENSTACK

architecture and components for
Keystone API Swift API Glance API Manila API Cinder API Nova API
ephemeral & persistent storage

➢ Nova, Cinder, Manila, Glance,

HYPERVISOR
Keystone, Ceilometer, Swift, CEPH OBJECT GATEWAY CephFS
(LibRBD)
Gnocchi

• 64 TB bundled ’once’ in Red Hat

OpenStack Platform for evaluation

RED HAT CEPH STORAGE

12
 Red Hat Ceph Storage

ADVANTAGES FOR OPENSTACK USERS

• Instantaneous booting of 1 or 100s VM
of VMs

• Instant backups via seamless data

migration between Glance, Cinder,
Nova HYPERVISOR

• Tiered I/O performance within

single cluster

• Multi-site replication for disaster

recovery or archiving
RED HAT CEPH STORAGE

13
 Red Hat Ceph Storage

TARGET USE CASES

• Private Cloud - enterprise deployments growing for test & dev and production
application deployments. FSI, retail and technology sectors.
• Archive & Backup: object storage as a replacement for tape and expensive dedicated
appliances. Hybrid cloud compatibility critical.
• NFVi (new) - OpenStack with Ceph dominant reference platform for next-generation
telco networks. Global demand for Ceph now standalone and hyperconverged.
• Enterprise Virtualization (new): legacy protocol support for legacy VM storage to be
managed on same platform as modern, private cloud storage.
• Big Data (new) - object storage providing common, data lake for multiple analytics
applications for greater efficiencies and better business insights

14
 Red Hat Gluster
Storage

15
 Red Hat Gluster

RED HAT GLUSTER STORAGE ADVANTAGES

OPEN • Based on GlusterFS open source community project
Open, software-defined distributed • Uses proven local file system (XFS)
file and object storage system • Data is stored in native format

• Uses an elastic hashing algorithm for data placement

SCALABLE
• Uses local filesystem’s xattrs to store metadata
No Metadata Server
• Nothing shared scale-out architecture

• Global namespace
ACCESSIBLE
• NFS, SMB, object, Gluster native protocol
Multi-Protocol the Same Data
• Posix compliant

• GlusterFS is based on filesystem in userspace (FUSE)

MODULAR
• Modular stackable arch allows easy addition of features
No Kernel Dependencies
...without being tied to any kernel version

ALWAYS-ON • Synchronous replication with self-healing for server failure

High-Availability across data,
systems and applications
• Asynchronous geo-replication for site failure

16
 Red Hat Gluster

GLUSTER ARCHITECTURE

NFS CIFS FUSE

SERVERS WITH LOCAL DISKS

Aggregates systems to one cohesive unit

and presents using common protocols
17
 Red Hat Gluster

WHAT IS A SYSTEM?

PHYSICAL VIRTUAL CLOUD

SERVER
(CPU/MEM)

18
 Red Hat Gluster

VOLUMES

CLIENTS
Bricks taken from multiple hosts
become one addressable unit

SERVER SERVER

BRICK BRICK BRICK BRICK

19
 Red Hat Gluster

VOLUMES

STORAGE NODE STORAGE NODE STORAGE NODE

/export1 /export6 /export11

/export2 /export7 /export12

/export3 /export8 /export13

/export4 /export9 /export14

/export5 /export10 /export15

/scratchspace /homeshare

20
 Red Hat Gluster

NFS

Better performance reading many small files from a single client

21
 Red Hat Gluster

SAMBA/CIFS

Samba uses RHGS gfapi library to communicate directly

with GlusterFS server process without going through FUSE

22
 Red Hat Gluster

OBJECT ACCESS

Implements objects as files and directories

under the container (”Swift on File”)

23
 Red Hat Gluster

GEO-REPLICATION

One to One replication

Site A Site B

Cascading replication

Site B

Site A Site C

24
 Red Hat Openshift
Container Storage

25
 Red Hat Openshift Container Storage

WHAT STORAGE OPTIONS DO YOU HAVE FOR YOUR

CONTAINERS?

PORTABLE STORAGE ACROSS

ON-PREM / PUBLIC CLOUDS
SILOED OR POINT PLAY
OUTDATED STORAGE
STORAGE SOLUTIONS
ARRAYS AND APPLIANCES

• No hybrid cloud support • Runs to all 3 public clouds

• Scalability and high availability
fall short of customer needs • No unified control plane (K8s) • Single Vendor Support model
• Vendor lock in and high TCO • Lack of automated or dynamic • Seamless user experience for
provisioning of storage developers and DevOps
• Monolithic appliance model

26
Red Hat Openshift Container Storage

WHAT IS OPENSHIFT CONTAINER STORAGE?

● Highly scalable, enterprise-grade storage
● 2 Deployment options: independent and
converge mode
● Native integration with OpenShift APPLICATION APPLICATION APPLICATION
CONTAINER CONTAINER CONTAINER
● Unified Orchestration using Kubernetes for
STORAGE STORAGE STORAGE
CONTAINER CONTAINER CONTAINER
applications and storage
● Greater control & ease of use for developers DISTRIBUTED, SECURE, SCALE-OUT STORAGE
CLUSTER
● Developed, maintained, and deployed in synch
with Red Hat OpenShift releases
● Single vendor Support
 Red Hat Openshift Container Storage

STORAGE SUPPORT BEFORE OCS

NFS*

GlusterFS GCE Persistent Disk **/***

Azure File *

VMDK ***

Azure Block **/***

Cinder ***

AWS EBS **/***

Ceph RBD ***

28

* No dynamic provisioning ** No Cross-Availability Zone Support *** No Shared-Storage

 Red Hat Openshift Container Storage

STORAGE SUPPORT AFTER OCS

Scalable Automated
(1000+ volumes) (Dynamic Provisioning)

Highly-Available Integrated
(across availability zones) (installs with / runs on OpenShift)

Persistent, resilient and … that travels with the

elastic storage... platform.

29

* No dynamic provisioning ** No Cross-Availability Zone Support *** No Shared-Storage

 Red Hat Openshift Container Storage

TWO FLAVORS OF CONTAINER STORAGE

OPENSHIFT CONTAINER STORAGE OPENSHIFT CONTAINER STORAGE

INDEPENDENT MODE CONVERGED MODE
Use existing investment in traditional storage, Highly scalable, enterprise-grade storage,
managed by storage admin – attach to standalone storage fully integrated into OpenShift Container Platform

30
 Red Hat Openshift Container Storage

CONVERGED MODE
OPENSHIFT NODE 1

APP CONTAINER

Co-Locate Storage and Apps

OPENSHIFT NODE 2 OPENSHIFT NODE 3

APP Container APP Container

MASTER Dynamic Provisioning
OCS Container OCS Container

Managed by OpenShift

Infrastructure-Agnostic

OCS Container

OPENSHIFT NODE 4

31
 Red Hat Openshift Container Storage

STORAGE CONSOLIDATION IN THE CLOUD

vs.
EBS sc1

EBS gp2

EBS gp2

EBS st1

EBS io1

32
 Red Hat Openshift Container Storage

STORAGE CONSOLIDATION ON PREM

PERSISTENT VOLUMES PROVIDED BY OPENSHIFT CONTAINER STORAGE

OPENSHIFT OPENSHIFT OPENSHIFT OPENSHIFT OPENSHIFT

CONTAINER CONTAINER CONTAINER CONTAINER CONTAINER
STORAGE POD STORAGE POD STORAGE POD STORAGE POD STORAGE POD

BLOCK
DEVICE BLOCK BLOCK BLOCK
DEVICE BLOCK DEVICE DEVICE
DEVICE

FIBRE-CHANNEL ISCSI SAN SHARED SAS

ARRAY
33
 Thank you
Red Hat is the world’s leading provider of enterprise

open source software solutions. Award-winning support,

training, and consulting services make Red Hat a trusted

adviser to the Fortune 500.

linkedin.com/company/red-hat facebook.com/redhatinc

youtube.com/user/RedHatVideos twitter.com/RedHat

34