vCider Cassndra Benchmarks

Benchmarking Cassandra Cluster performance with vCider network module Cassandra Parameters Replication Factor - Number of copies of each piece of data. (e.g. 1, 3) Consistency Level - Number of replicas that should respond to declare a successful operation. (e.g. ONE, QUORUM) Snitches Challenges Amazon EC2 Variance Cassandra “Node <=> Client” encryption Ring Management Network Topology Detection Amazon EC2 Performance Variation Problem: EC2 performance is unpredictable and varies minute to minute Instances freeze/get unresponsive Solution: To accommodate EC2 variance, we run 10 iterations in AB AB AB… pattern and take averages, std. deviations etc. Client <=> Node Encryption Problem: Cassandra provides internode encryption. No inbuilt Client Node encryption available. Solution: Setup OpenVPN for Client Node encryption with udp and 256bit keys and AES Cipher to get comparable results with vCider. Ring Management Problem: Ring slices decide which node owns what part of the complete key store. Cassandra rings are not divided equally by default Solution: Tokens Configure Initial Tokens Network Topologies Detection Snitches: Cassandra Uses Snitches to detect which data center and rack a node resides on. Vcider : PropertyFileSnitch Cassandra Native EC2 Cluster: - EC2Snitch and - EC2MultiRegionSnitch Image Credits: http://www.datastax.com/docs/_images/Multi-DCReplication.png Image Credits: http://2.bp.blogspot.com/_YGilJHLjrrI/TJy3K0wshLI/AAAAAAAAAOI/ogAvf8Ckq3k/s1600/cassandra-ring2.png Cassandra Ring Status Test Setup - Region : Singapore - Instances : Spot Instances - Clients : one, c1.xlarge - Nodes : four, m2.xlarge Network Interfaces 1. OpenVPN 2. EC2 Native Internal 3. vCider Encrypted 4. vCider Unencrypted Test Parameters --consistency-level QUORUM | ONE --threads 10 | 40 --replication-factor 3 | 1 --column-size 32 | 64 | 128| 192| 256 --keep-going --num-keys 500000 | 1000000 -r Puppet Modules cassandra vcider openvpn Example Config node 'HOSTNAME'{ $seed_host = "192.168.1.1" $vcider_address = "192.168.1.2" $initial_token = 0 include vcider include cassandra } Unencrypted Results Internode Encryption Internode Encryption OpenVPN Client - Node Encryption Thank You ! Author: Gourav Shah Founder and Principal Consultant | Initcron www.initcron.com Cloud Ops | Big Data Ops | DevOps Consulting vCider is a Cisco Company http://vcider.com Tools Used Apache Cassandra vCider Network Module OpenVPN Puppet Amazon AWS, EC2 Spot Instances Bash Scripts, Cron