avinash-mishra/cassandra_snapshot_backup

SynopsisCassandra does not provide an easy way to snapshot files and store these snapshots in local directories. This script does that for the user, and restores them using the same snapshot files created by the snapshotter.This collection of scripts requires Ansible which requires ssh access keys to allremote hosts.For more information on Ansible: http://docs.ansible.com/ansible/intro_getting_started.htmlThe Ansible host needs boto3 for AWS S3 services, and the nodes need PyYamlInstallationInstalling on the Ansible host. The only dependency currently is boto3.sudo python setup.py installorpip install boto3Installing on the nodescd ansible_snapshotter/python install.py -n [nodes] # or the host group from the Ansible inventoryUsagesnapshotter.pypython snapshotter.py -d/--path # save path -n/--nodes/--hosts # host group from Ansible or host ip-addresses -ks/--keyspace # specify a keyspace (optional) -tb/--table # specify a table (optional) -t/--title/--tag # name the snapshot --s3 # store in AWS S3 with the config.ini settings (flag) --reload # reinstall the scripts on the nodes (flag)restore.pypython restore.py -d/--path # snapshot zip file -n/--nodes/--hosts # host group from Ansible or host ip-addresses; can also use config.ini -ks/--keyspace # specify a keyspace (optional) -tb/--table # specify a table (optional) --s3 # retrieve from S3 with the config.ini settings; can specify key (arg) or search (flag) --reload # reinstall the scripts on the nodes (flag)config.ini[s3-aws-info]bucket = # mybucketregion = # us-west-1account = # account idpassword = # aws secret key[cassandra-info]hosts = # name of group in ansible inventory or space/comma separated IPsHow it workssnapshot.py does the following:Saves the schema on one node and fetches it using AnsibleTakes a snapshot by calling “nodetool snapshot” and stores them in a zip file on each nodeFetches all zipped snapshots and stores them locally on the Ansible hostUploads snapshots to AWS S3 (--s3 option)restore.py does the following:Destroys the schema if one exists on the Cassandra clusterCleans the old data files such as backup files or snapshot files on every node through AnsibleCopies the snapshot’s schema to a node and restores it to the databaseCopies the snapshot SSTables to every node and loads them using Cassandra’s SSTableLoader utility