Downloaded 212 times
![Cassandra Write Path
write[0]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-7-320.jpg)
![Cassandra Write Path
•
write[0]
Writes written to both the commit log and
memtable.
commitlog
memtable](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-8-320.jpg)
![Cassandra Write Path
•
•
write[0]
Writes written to both the commit log and
memtable.
Memtable is sorted.
commitlog
memtable](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-9-320.jpg)
![Cassandra Write Path
•
write[0]
Memtable flushed out to sstables.
commitlog
memtable
sstable[0]
sstable[2]
sstable[1]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-10-320.jpg)
![Cassandra Write Path
•
write[0]
Compaction helps keep the read latency
low.
commitlog
memtable
sstable[0]
sstable[2]
sstable[1]
sstable[n]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-11-320.jpg)
![ByteBuffer randomBytes = ByteBufferUtil.bytes(randomAscii(1024));
KeyGenerator keyGen = new KeyGenerator();
long dataSize = 0;
writer = new SSTableSimpleUnsortedWriter(…);
while (dataSize < max_data_bytes) {
writer.newRow(key);
for (int j=0; j<num_cols; j++) {
ByteBuffer colName = ByteBufferUtil.bytes("col_" + j);
ByteBuffer colValue = ByteBuffer.wrap(new byte[20]);
randomBytes.get(colValue.array());
colValue.position(0);
writer.addColumn(colName, colValue, timestamp);
if (randomBytes.remaining() < colValue.limit()) {
randomBytes.position(0);
}
else {
randomBytes.position(randomBytes.position() + colValue.limit());
}
}
}
}](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-23-320.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d localhost
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1]
progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-25-320.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d localhost
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1]
progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-26-320.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d localhost
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1]
progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-27-320.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d localhost
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1]
progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-28-320.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d
cass1,cass2,cass3
!
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2,
cass3,cass4,cass5,cass6]
!
progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0
(0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-37-320.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d
cass1,cass2,cass3
!
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2,
cass3,cass4,cass5,cass6]
!
progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0
(0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-38-320.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d
cass1,cass2,cass3
!
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2,
cass3,cass4,cass5,cass6]
!
progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0
(0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/85/Bulk-Loading-Data-into-Cassandra-39-320.jpg)
![Cassandra Write Path
write[0]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-7-2048.jpg)
![Cassandra Write Path
•
write[0]
Writes written to both the commit log and
memtable.
commitlog
memtable](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-8-2048.jpg)
![Cassandra Write Path
•
•
write[0]
Writes written to both the commit log and
memtable.
Memtable is sorted.
commitlog
memtable](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-9-2048.jpg)
![Cassandra Write Path
•
write[0]
Memtable flushed out to sstables.
commitlog
memtable
sstable[0]
sstable[2]
sstable[1]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-10-2048.jpg)
![Cassandra Write Path
•
write[0]
Compaction helps keep the read latency
low.
commitlog
memtable
sstable[0]
sstable[2]
sstable[1]
sstable[n]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-11-2048.jpg)
![ByteBuffer randomBytes = ByteBufferUtil.bytes(randomAscii(1024));
KeyGenerator keyGen = new KeyGenerator();
long dataSize = 0;
writer = new SSTableSimpleUnsortedWriter(…);
while (dataSize < max_data_bytes) {
writer.newRow(key);
for (int j=0; j<num_cols; j++) {
ByteBuffer colName = ByteBufferUtil.bytes("col_" + j);
ByteBuffer colValue = ByteBuffer.wrap(new byte[20]);
randomBytes.get(colValue.array());
colValue.position(0);
writer.addColumn(colName, colValue, timestamp);
if (randomBytes.remaining() < colValue.limit()) {
randomBytes.position(0);
}
else {
randomBytes.position(randomBytes.position() + colValue.limit());
}
}
}
}](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-23-2048.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d localhost
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1]
progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-25-2048.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d localhost
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1]
progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-26-2048.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d localhost
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1]
progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-27-2048.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d localhost
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1]
progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-28-2048.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d
cass1,cass2,cass3
!
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2,
cass3,cass4,cass5,cass6]
!
progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0
(0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-37-2048.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d
cass1,cass2,cass3
!
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2,
cass3,cass4,cass5,cass6]
!
progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0
(0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-38-2048.jpg)
![$ bin/sstableloader Keyspace1/ColFam1
patricia@dev:~/…/cassandra-2.0.4$ bin/sstableloader mykeyspace/mycf -d
cass1,cass2,cass3
!
Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2,
cass3,cass4,cass5,cass6]
!
progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0
(0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]](https://image.slidesharecdn.com/bulk-loadingdataintocassandra-140307160517-phpapp02/75/Bulk-Loading-Data-into-Cassandra-39-2048.jpg)
Uploaded byDataStax
Bulk Loading Data into Cassandra
The document discusses bulk loading data into Apache Cassandra, highlighting its benefits such as performance improvement and historical data migration. It covers key concepts like the Cassandra write path, data storage mechanisms, and practical case studies related to data generation and management. Additionally, it provides examples of commands for setting up keyspaces, column families, and techniques for data streaming using sstableloader.
More Related Content
Similar to Bulk Loading Data into Cassandra
![UiPath Automation Suite Installation (Hands-On) [2/3]](https://cdn.slidesharecdn.com/ss_thumbnails/automationsuitecommunitysession2-251015095633-a6d862f1-thumbnail.jpg?width=600ounds&width=560&fit=bounds)
Bulk Loading Data into Cassandra
- 1. Planet Cassandra 2014 Bulk-LoadingData into Cassandra Patricia Gorla @patriciagorla Cassandra Consultant www.thelastpickle.com
- 2. About Us • Work withclients to deliver and improve Apache Cassandra services • Apache Cassandra committer, Datastax MVP, Hector maintainer, Apache Usergrid committer • Based in New Zealand & USA
- 3. Why is bulkloading useful? • Performance tests
- 4. Why is bulkloading useful? • Performance tests • Migrating historical data
- 5. Why is bulkloading useful? • Performance tests • Migrating historical data • Changing topologies
- 6. ! • How Data isStored • Case Studies - Generating Dummy Data - Backfilling Historical Data - Changing Topologies • Conclusion
- 7.
- 8. Cassandra Write Path • write[0] Writeswritten to both the commit log and memtable. commitlog memtable
- 9. Cassandra Write Path • • write[0] Writeswritten to both the commit log and memtable. Memtable is sorted. commitlog memtable
- 10. Cassandra Write Path • write[0] Memtableflushed out to sstables. commitlog memtable sstable[0] sstable[2] sstable[1]
- 11. Cassandra Write Path • write[0] Compactionhelps keep the read latency low. commitlog memtable sstable[0] sstable[2] sstable[1] sstable[n]
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18. ! • How Data isStored • Case Studies - Generating Dummy Data - Backfilling Historical Data - Changing Topologies • Conclusion
- 19. create keyspace test withplacement_strategy = 'org.apache.cassandra.locator.SimpleStrategy' and strategy_options = {replication_factor:1}; ! create column family test with comparator = 'AsciiType' and default_validation_class = 'AsciiType' and key_validation_class = 'AsciiType'; Set up keyspace and column family
- 20. AbstractSSTableSimpleWriter writer =new SSTableSimpleUnsortedWriter( directory, partitioner, keyspace, columnFamily, AsciiType.instance, null, // subcomparator for super columns size_per_sstable_mb ); SStableGen.java
- 21. AbstractSSTableSimpleWriter writer =new SSTableSimpleUnsortedWriter( directory, partitioner, keyspace, columnFamily, AsciiType.instance, null, // subcomparator for super columns size_per_sstable_mb ); SStableGen.java
- 22. AbstractSSTableSimpleWriter writer =new SSTableSimpleUnsortedWriter( directory, partitioner, keyspace, columnFamily, AsciiType.instance, null, // subcomparator for super columns size_per_sstable_mb ); SStableGen.java
- 23. ByteBuffer randomBytes =ByteBufferUtil.bytes(randomAscii(1024)); KeyGenerator keyGen = new KeyGenerator(); long dataSize = 0; writer = new SSTableSimpleUnsortedWriter(…); while (dataSize < max_data_bytes) { writer.newRow(key); for (int j=0; j<num_cols; j++) { ByteBuffer colName = ByteBufferUtil.bytes("col_" + j); ByteBuffer colValue = ByteBuffer.wrap(new byte[20]); randomBytes.get(colValue.array()); colValue.position(0); writer.addColumn(colName, colValue, timestamp); if (randomBytes.remaining() < colValue.limit()) { randomBytes.position(0); } else { randomBytes.position(randomBytes.position() + colValue.limit()); } } } }
- 24. patricia@dev:~/../data$ total 64 -rw-r--r-- 1patricia -rw-r--r-- 1 patricia -rw-r--r-- 1 patricia -rw-r--r-- 1 patricia -rw-r--r-- 1 patricia -rw-r--r-- 1 patricia -rw-r--r-- 1 patricia ls -lh mykeyspace/mycf staff staff staff staff staff staff staff 43B 79K 16B 36B 4.3K 80B 79B Feb Feb Feb Feb Feb Feb Feb 2 2 2 2 2 2 2 15:31 15:31 15:31 15:31 15:31 15:31 15:31 mykeyspace-mycf-jb-1-CompressionInfo.db mykeyspace-mycf-jb-1-Data.db mykeyspace-mycf-jb-1-Filter.db mykeyspace-mycf-jb-1-Index.db mykeyspace-mycf-jb-1-Statistics.db mykeyspace-mycf-jb-1-Summary.db mykeyspace-mycf-jb-1-TOC.txt Examining sstable output
- 25. $ bin/sstableloader Keyspace1/ColFam1 patricia@dev:~/…/cassandra-2.0.4$bin/sstableloader mykeyspace/mycf -d localhost Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1] progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]
- 26. $ bin/sstableloader Keyspace1/ColFam1 patricia@dev:~/…/cassandra-2.0.4$bin/sstableloader mykeyspace/mycf -d localhost Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1] progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]
- 27. $ bin/sstableloader Keyspace1/ColFam1 patricia@dev:~/…/cassandra-2.0.4$bin/sstableloader mykeyspace/mycf -d localhost Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1] progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]
- 28. $ bin/sstableloader Keyspace1/ColFam1 patricia@dev:~/…/cassandra-2.0.4$bin/sstableloader mykeyspace/mycf -d localhost Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/127.0.0.1] progress: [/127.0.0.1 1/1 (100)] [total: 100 - 0MB/s (avg: 0MB/s)]
- 29. $ bin/sstableloader Keyspace1/ColFam1 • Runcommand on separate server
- 30. $ bin/sstableloader Keyspace1/ColFam1 • Runcommand on separate server • Throttle command
- 31. $ bin/sstableloader Keyspace1/ColFam1 • Runcommand on separate server • Throttle command • Parallelise processes
- 32. ! • How Data isStored • Case Studies - Generating Dummy Data - Backfilling Historical Data - Changing Topologies • Conclusion
- 33. // list oforders by user customerOrders = new SSTableSimpleUnsortedWriter(…); // orders by order id orders = new SSTableSimpleUnsortedWriter(…); ! // assume orders are in date order for (Order order : oldOrders) { customerOrders.newRow(ByteBufferUtil.bytes(order.customerId)); customerOrders.addColumn(ByteBufferUtil.bytes(order.orderId), ByBufferUtil.EMPTY_BYTE_BUFFER, timestamp); ! orders.newRow(ByteBufferUtil.bytes(order.userId)); orders.addColumn(ByteBufferUtil.bytes(“customer_id), ByteBufferUtil.bytes(order.customerId), timestamp); orders.addColumn(ByteBufferUtil.bytes(“date), ByteBufferUtil.bytes(order.date), timestamp); orders.addColumn(ByteBufferUtil.bytes(“total), ByteBufferUtil.bytes(order.total), timestamp); } ! customerOrders.close() orders.close()
- 34. // list oforders by user customerOrders = new SSTableSimpleUnsortedWriter(…); // orders by order id orders = new SSTableSimpleUnsortedWriter(…); ! // assume orders are in date order for (Order order : oldOrders) { customerOrders.newRow(ByteBufferUtil.bytes(order.customerId)); customerOrders.addColumn(ByteBufferUtil.bytes(order.orderId), ByBufferUtil.EMPTY_BYTE_BUFFER, timestamp); ! orders.newRow(ByteBufferUtil.bytes(order.userId)); orders.addColumn(ByteBufferUtil.bytes(“customer_id), ByteBufferUtil.bytes(order.customerId), timestamp); orders.addColumn(ByteBufferUtil.bytes(“date), ByteBufferUtil.bytes(order.date), timestamp); orders.addColumn(ByteBufferUtil.bytes(“total), ByteBufferUtil.bytes(order.total), timestamp); } ! customerOrders.close() orders.close()
- 35. // list oforders by user customerOrders = new SSTableSimpleUnsortedWriter(…); // orders by order id orders = new SSTableSimpleUnsortedWriter(…); ! // assume orders are in date order for (Order order : oldOrders) { customerOrders.newRow(ByteBufferUtil.bytes(order.customerId)); customerOrders.addColumn(ByteBufferUtil.bytes(order.orderId), ByBufferUtil.EMPTY_BYTE_BUFFER, timestamp); ! orders.newRow(ByteBufferUtil.bytes(order.userId)); orders.addColumn(ByteBufferUtil.bytes(“customer_id), ByteBufferUtil.bytes(order.customerId), timestamp); orders.addColumn(ByteBufferUtil.bytes(“date), ByteBufferUtil.bytes(order.date), timestamp); orders.addColumn(ByteBufferUtil.bytes(“total), ByteBufferUtil.bytes(order.total), timestamp); } ! customerOrders.close() orders.close()
- 36. ! • How Data isStored • Case Studies - Generating Dummy Data - Backfilling Historical Data - Changing Topologies • Conclusion
- 37. $ bin/sstableloader Keyspace1/ColFam1 patricia@dev:~/…/cassandra-2.0.4$bin/sstableloader mykeyspace/mycf -d cass1,cass2,cass3 ! Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2, cass3,cass4,cass5,cass6] ! progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0 (0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]
- 38. $ bin/sstableloader Keyspace1/ColFam1 patricia@dev:~/…/cassandra-2.0.4$bin/sstableloader mykeyspace/mycf -d cass1,cass2,cass3 ! Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2, cass3,cass4,cass5,cass6] ! progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0 (0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]
- 39. $ bin/sstableloader Keyspace1/ColFam1 patricia@dev:~/…/cassandra-2.0.4$bin/sstableloader mykeyspace/mycf -d cass1,cass2,cass3 ! Streaming relevant part of mykeyspace/mycf/mykeyspace-mycf-ic-1-Data.db to [/cass1,cass2, cass3,cass4,cass5,cass6] ! progress: [/cas1 3/3 (100)] [/cas2 0/4 (0)] [/cas3 0/0 (0)] [/cas4 0/0 (0)] [/cas5 0/0 (0)] [/cas6 1/2 (50)] [total: 50 - 0MB/s (avg: 5MB/s)]
- 40. $ bin/sstableloader Keyspace1/ColFam1 patricia@dev:~/.../cassandra-2.0.4$bin/nodetool compactionstats pending tasks: 30 Active compaction remaining time : n/a
- 41. ! • How Data isStored • Case Studies - Generating Dummy Data - Backfilling Historical Data - Changing Topologies • Conclusion
- 42. cqlsh> CREATE KEYSPACE"test" WITH replication = {'class': 'SimpleStrategy', 'replication_factor': 1 }; ! cqlsh> CREATE COLUMNFAMILY "test" (id text PRIMARY KEY ) ; CQL: Keep schema consistent
- 43. CQL3 Considerations • Uses CompositeTypecomparator
- 44. Planet Cassandra 2014 Q&A PatriciaGorla @patriciagorla Cassandra Consultant www.thelastpickle.com