KEMBAR78
Ceph and Apache CloudStack | PDF
Ceph and Apache CloudStack
David Nalley
ke4qqq@apache.org
@ke4qqq
#whoami
Distributed storage junkie
Recovering sysadmin
Member, Apache Software Foundation
PMC Member, Apache CloudStack
Employed by Citrix in the Open Source Business Office
Setting the stage
Apache CloudStack is...
● an open source IaaS platform
● proven in production at massive scale
● awesome
Gorgeous UI
API
● Native: http://cloudstack.apache.org/docs/api
● EC2
A brief history of cloud-y storage
● Most would say it started early 2006 with S3 launch
● This really set the stage and everyone's assumptions.
● Cloud-y storage == S3 == Object Storage
● Incredibly useful - typically able to scale well past
traditional filesystem levels
● Super simple - to consume.
A brief history of cloud-y storage
● Since then, we've had a number of open source and
proprietary object storage alternatives emerge:
– OpenStack Swift
– Riak CS
– Ceph (has an object storage option)
– Caringo
But we have largely ignored....
● EC2 - used ephemeral storage initially
● Introduced EBS
– Apparently zone-wide block storage
So object storage is nice but...
● Doesn't fill the void for EBS-like storage
● Neither does traditional storage
● NAS/SANs aren't economically scalable
Rados Block Device
● Ceph provides RBD
● Exposes a block storage device - like a SAN
● Easily scales for both performance and capacity
Rados Block Device - Features
● Thin-provisioning
● Snapshotting
● Caching
Let's talk about today
● CloudStack primarily is a consumer of storage
● Historically we've made storage the fault line
– Concerns were IOPS, SPOF, Cost
– Typically no more than 16 hypervisors per a single storage resource
– So you needed lots of storage resources.....or just use local disk
● Distributed storage gives better scalability.
– Mimics EBS requires data-center wide capabilities
– Reduces costs, and constraints.
What else is coming..
●
Support for format 2 RBD
●
Snapshots
●
Datacenter wide storage resources.
●
Removal of need for legacy storage
What else is coming..
XenServer support
http://xenserver.org/blog/entry/tech-preview-of-xenserver-libvirt-ceph.html
Resources
● http://ceph.com/docs/master/rbd/rbd-cloudstack/
● http://blog.widodh.nl/
Questions
Contact
● Project
– http://cloudstack.apache.org
– #cloudstack on irc.freenode.net
● Me
– ke4qqq on irc.freenode.net
– ke4qqq@apache.org
– @ke4qqq on Twitter

Ceph and Apache CloudStack

  • 1.
    Ceph and ApacheCloudStack David Nalley ke4qqq@apache.org @ke4qqq
  • 2.
    #whoami Distributed storage junkie Recoveringsysadmin Member, Apache Software Foundation PMC Member, Apache CloudStack Employed by Citrix in the Open Source Business Office
  • 3.
    Setting the stage ApacheCloudStack is... ● an open source IaaS platform ● proven in production at massive scale ● awesome
  • 4.
  • 5.
  • 6.
    A brief historyof cloud-y storage ● Most would say it started early 2006 with S3 launch ● This really set the stage and everyone's assumptions. ● Cloud-y storage == S3 == Object Storage ● Incredibly useful - typically able to scale well past traditional filesystem levels ● Super simple - to consume.
  • 7.
    A brief historyof cloud-y storage ● Since then, we've had a number of open source and proprietary object storage alternatives emerge: – OpenStack Swift – Riak CS – Ceph (has an object storage option) – Caringo
  • 8.
    But we havelargely ignored.... ● EC2 - used ephemeral storage initially ● Introduced EBS – Apparently zone-wide block storage
  • 9.
    So object storageis nice but... ● Doesn't fill the void for EBS-like storage ● Neither does traditional storage ● NAS/SANs aren't economically scalable
  • 10.
    Rados Block Device ●Ceph provides RBD ● Exposes a block storage device - like a SAN ● Easily scales for both performance and capacity
  • 11.
    Rados Block Device- Features ● Thin-provisioning ● Snapshotting ● Caching
  • 12.
    Let's talk abouttoday ● CloudStack primarily is a consumer of storage ● Historically we've made storage the fault line – Concerns were IOPS, SPOF, Cost – Typically no more than 16 hypervisors per a single storage resource – So you needed lots of storage resources.....or just use local disk ● Distributed storage gives better scalability. – Mimics EBS requires data-center wide capabilities – Reduces costs, and constraints.
  • 13.
    What else iscoming.. ● Support for format 2 RBD ● Snapshots ● Datacenter wide storage resources. ● Removal of need for legacy storage
  • 14.
    What else iscoming.. XenServer support http://xenserver.org/blog/entry/tech-preview-of-xenserver-libvirt-ceph.html
  • 15.
  • 16.
  • 17.
    Contact ● Project – http://cloudstack.apache.org –#cloudstack on irc.freenode.net ● Me – ke4qqq on irc.freenode.net – ke4qqq@apache.org – @ke4qqq on Twitter