datastax/metric-collector-for-apache-cassandra

Metric collection and Dashboards for Apache Cassandra (2.2, 3.0, 3.11, 4.0) clusters.IntroductionMetric Collector for Apache Cassandra (MCAC) aggregates OS and C* metrics along with diagnostic eventsto facilitate problem resolution and remediation.It supports existing Apache Cassandra clusters and is a self contained drop in agent.Built on collectd, a popular, well-supported, open source metric collection agent.With over 90 plugins, you can tailor the solution to collect metrics most important to you and ship them towherever you need.Easily added to Cassandra nodes as a java agent, Apache Cassandra sends metrics and other structured eventsto collectd over a local unix socket.Fast and efficient. It can track over 100k unique metric series per node (i.e. hundreds of tables).Comes with extensive dashboards out of the box, built on prometheus and grafana.The Cassandra dashboards let you aggregate latency accurately across all nodes, dc or rack, down to an individual table.Design PrinciplesLittle/No performance impact to C*Simple to install and self managedCollect all OS and C* metrics by defaultKeep historical metrics on node for analysisProvide useful integration with prometheus and grafanaTry the demodocker-compose up is all you need from the dashboards/demo directory to get a cluster with a lightworkload and dashboards connected to kick the tires.Installation of AgentDownload the latest release of the agent onto your Cassandra nodes.The archive is self contained so no need do anything other than tar -zxf latest.tar.gzinto any location you prefer like /usr/local or /opt.Add the following line into the cassandra-env.sh file:MCAC_ROOT=/path/to/directory JVM_OPTS="$JVM_OPTS -javaagent:${MCAC_ROOT}/lib/datastax-mcac-agent.jar"Bounce the node.On restart you should see 'Starting DataStax Metric Collector for Apache Cassandra' in the Cassandra system.logand the prometheus exporter will be available on port 9103The config/metric-collector.yaml file requires no changes by default but please read and add any customizations likefiltering of metrics you don't need.The config/collectd.conf.tmpl file can also be edited to change default collectd plugins enabled. But it's recommendedyou use the include path patternto configure extra plugins.Installing the Prometheus DashboardsDownload the latest release of the dashboards and unzip.Install Docker composeAdd the list of C* nodes with running agents to tg_mcac.jsondocker-compose up will start everything and begin collection of metricsThe Grafana web ui runs on port 3000 and the prometheus web ui runs on port 9090If you have an existing prometheus setup you will need the dashboards and relabel config from theincluded prometheus.yaml file.Kubernetes SupportCheck out the dashboards/k8s-build directory for a guide on using this project along with Kubernetes.FAQWhere is the list of all Cassandra metrics?The full list is located on Apache Cassandra docs site.The names are automatically changed from CamelCase to snake_case.In the case of prometheus the metrics are further renamed based on relabel config which live in theprometheus.yaml file.How can I filter out metrics I don't care about?Please read the metric-collector.yaml section on how to add filtering rules.What is the datalog? and what is it for?The datalog is a space limited JSON based structured log of metrics and events which are optionally kept on each node.It can be useful to diagnose issues that come up with your cluster. If you wish to use the logs yourselfthere's a script included to parse these logs which can be analyzed or pipedinto jq.Alternatively, DataStax offers free support for issues as part of our keep calminitiative and these logs can help our support engineers help diagnose your problem.Will the MCAC agent work on a Mac?No. It can be made to but it's currently only supported on Linux based OS.LicenseCopyright DataStax, Inc.Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License athttp://www.apache.org/licenses/LICENSE-2.0Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.