KEMBAR78
How to Monitor and Size Workloads on AWS i3 instances | PDF
Glauber Costa Eyal Gutkind
ScyllaDB webinar
How to Monitor and Size Workloads on
AWS i3 Instances
+ Intro: Who we are, what we do, who uses it
+ Getting started with Scylla
+ Using monitoring data to understand bottlenecks
+ Data model and operation impacts
+ Scylla compatibility
+ Q&A
Today we will cover:
What we do: Scylla, towards the best NoSQL
+ > 1 million OPS per node
+ < 1ms 99% latency
+ Auto tuned
+ Scale up and out
+ Open source
+ Large community (piggyback on Cassandra)
+ Blends in the ecosystem: Spark, Presto, time series, search ...
Where Scylla is deployed?
Scylla benchmark by Samsung
op/s
+ Intro: Who we are, what we do, who uses it
+ Using monitoring data to understand bottlenecks
+ Why AWS i3 Instances and Scylla?
+ Data model and operation impacts
+ Scylla compatibility
+ Q&A
Today we will cover:
Monitoring: Prometheus + Grafana
- Container based installation
- Simple and clean
- https://github.com/scylladb/scylla-grafana-monitoring
- Installs on a different machine
- Possible to install w/o docker
- Bring your own Prometheus and Grafana
- Use provided yml, ini and json files to enable monitoring
How to Understand Scylla Performance
What to look for? Customize for workload
Setting up the monitor
+ Intro: Who we are, what we do, who uses it
+ Using monitoring data to understand bottlenecks
+ Why AWS i3 Instances and Scylla?
+ Data model and operation impacts
+ Scylla compatibility
+ Q&A
Today we will cover:
Powerful software for powerful instances
Threads Shards
System got muscle?, use it! : Shard per core
Powerful software for powerful instances
Don’t leave RAM behind: Unified cache
Cassandra Scylla
Key cache
Row cache
On-heap /
Off-heap
Linux page cache
SSTables
Unified cache
SSTables
Complex
Tuning
Unified cache vs Cassandra cache plethora
Cassandra Scylla
Key cache
Row cache
On-heap /
Off-heap
Linux page cache
SSTables
Unified cache
SSTables
SSTable page (4k)
Your data (300b)
Parasitic
Rows - 300b/4kb
Cassandra Scylla
Key cache
Row cache
On-heap /
Off-heap
Linux page cache
SSTables
Unified cache
SSTables
App
thread
Kernel
SSD
Page fault
Suspend
thread
Initiate I/O
Context switch
I/O
completes
Interrupt
Context
switch
Map page
Resume
thread
Page
fault
Unified cache vs Cassandra cache plethora
Show CPU and memory workload on the
monitor
Powerful software for powerful instances
Exploiting NVMe performance: Scylla I/O Scheduling
Query
Commitlog
Compaction
Queue
Queue
Queue
Userspace
I/O
Scheduler
Disk
Max useful disk concurrency
I/O queued in FS/deviceNo queues
Show I/O workload on the monitor
Powerful software for powerful instances
When to use i3 instances
+ Intro: Who we are, what we do, who uses it
+ Getting started with Scylla
+ Using monitoring data to understand bottlenecks
+ Data model and operation impacts
+ Scylla compatibility
+ What’s Next?
+ Q&A
Today we will cover:
Prevent Hot Spots
CREATE TABLE sensordata (s1data text,s2data text,timestmp timestamp,sregion
text,stype text, PRIMARY KEY (s1data, s2data,timestmp));
CREATE TABLE sensordata (s1data text,s2data text,timestmp timestamp,sregion
text,stype text, PRIMARY KEY ((s1data, timestmp), s2data));
Partitions size
+ Intro: Who we are, what we do, who uses it
+ Getting started with Scylla
+ Using monitoring data to understand bottlenecks
+ Data model and operation impacts
+ Scylla compatibility
+ Let’s show you how to do it (Demo time)
+ Q&A
Today we will cover:
+ SSTable file format
+ Configuration file format
+ CQL language
+ CQL native protocol
+ JMX management protocol
+ Management command line
Compatibility
+ Intro: Who we are, what we do, who uses it
+ Getting started with Scylla
+ Using monitoring data to understand bottlenecks
+ Data model and operation impacts
+ Scylla compatibility
+ Q&A
Today we will cover:
Q&A
Resources
slideshare.net/ScyllaDB
glauber@scylladb.com
eyal@scylladb.com
@scylladb
http://bit.ly/2oHAfok
youtube.com/c/scylladbscylladb.com/blog
NoSQL GOES NATIVE
Thank you.

How to Monitor and Size Workloads on AWS i3 instances

  • 1.
    Glauber Costa EyalGutkind ScyllaDB webinar How to Monitor and Size Workloads on AWS i3 Instances
  • 2.
    + Intro: Whowe are, what we do, who uses it + Getting started with Scylla + Using monitoring data to understand bottlenecks + Data model and operation impacts + Scylla compatibility + Q&A Today we will cover:
  • 3.
    What we do:Scylla, towards the best NoSQL + > 1 million OPS per node + < 1ms 99% latency + Auto tuned + Scale up and out + Open source + Large community (piggyback on Cassandra) + Blends in the ecosystem: Spark, Presto, time series, search ...
  • 4.
    Where Scylla isdeployed?
  • 5.
    Scylla benchmark bySamsung op/s
  • 6.
    + Intro: Whowe are, what we do, who uses it + Using monitoring data to understand bottlenecks + Why AWS i3 Instances and Scylla? + Data model and operation impacts + Scylla compatibility + Q&A Today we will cover:
  • 7.
    Monitoring: Prometheus +Grafana - Container based installation - Simple and clean - https://github.com/scylladb/scylla-grafana-monitoring - Installs on a different machine - Possible to install w/o docker - Bring your own Prometheus and Grafana - Use provided yml, ini and json files to enable monitoring
  • 8.
    How to UnderstandScylla Performance
  • 9.
    What to lookfor? Customize for workload
  • 10.
  • 11.
    + Intro: Whowe are, what we do, who uses it + Using monitoring data to understand bottlenecks + Why AWS i3 Instances and Scylla? + Data model and operation impacts + Scylla compatibility + Q&A Today we will cover:
  • 12.
    Powerful software forpowerful instances
  • 13.
    Threads Shards System gotmuscle?, use it! : Shard per core
  • 14.
    Powerful software forpowerful instances
  • 15.
    Don’t leave RAMbehind: Unified cache Cassandra Scylla Key cache Row cache On-heap / Off-heap Linux page cache SSTables Unified cache SSTables Complex Tuning
  • 16.
    Unified cache vsCassandra cache plethora Cassandra Scylla Key cache Row cache On-heap / Off-heap Linux page cache SSTables Unified cache SSTables SSTable page (4k) Your data (300b) Parasitic Rows - 300b/4kb
  • 17.
    Cassandra Scylla Key cache Rowcache On-heap / Off-heap Linux page cache SSTables Unified cache SSTables App thread Kernel SSD Page fault Suspend thread Initiate I/O Context switch I/O completes Interrupt Context switch Map page Resume thread Page fault Unified cache vs Cassandra cache plethora
  • 18.
    Show CPU andmemory workload on the monitor
  • 19.
    Powerful software forpowerful instances
  • 20.
    Exploiting NVMe performance:Scylla I/O Scheduling Query Commitlog Compaction Queue Queue Queue Userspace I/O Scheduler Disk Max useful disk concurrency I/O queued in FS/deviceNo queues
  • 21.
    Show I/O workloadon the monitor
  • 22.
    Powerful software forpowerful instances
  • 23.
    When to usei3 instances
  • 24.
    + Intro: Whowe are, what we do, who uses it + Getting started with Scylla + Using monitoring data to understand bottlenecks + Data model and operation impacts + Scylla compatibility + What’s Next? + Q&A Today we will cover:
  • 25.
    Prevent Hot Spots CREATETABLE sensordata (s1data text,s2data text,timestmp timestamp,sregion text,stype text, PRIMARY KEY (s1data, s2data,timestmp)); CREATE TABLE sensordata (s1data text,s2data text,timestmp timestamp,sregion text,stype text, PRIMARY KEY ((s1data, timestmp), s2data));
  • 26.
  • 27.
    + Intro: Whowe are, what we do, who uses it + Getting started with Scylla + Using monitoring data to understand bottlenecks + Data model and operation impacts + Scylla compatibility + Let’s show you how to do it (Demo time) + Q&A Today we will cover:
  • 28.
    + SSTable fileformat + Configuration file format + CQL language + CQL native protocol + JMX management protocol + Management command line Compatibility
  • 29.
    + Intro: Whowe are, what we do, who uses it + Getting started with Scylla + Using monitoring data to understand bottlenecks + Data model and operation impacts + Scylla compatibility + Q&A Today we will cover:
  • 30.
  • 31.