Illustration Image

Cassandra.Link

The best knowledge base on Apache Cassandra®

Helping platform leaders, architects, engineers, and operators build scalable real time data platforms.

1/26/2020

Reading time:2 min

Home

by John Doe

Blueflood is a high throughput, low latency, multi-tenant distributed metric processing system behind Rackspace Metrics, which is currently used in production by the Rackspace Monitoring team and Rackspace Public Cloud team to store metrics generated by their systems. In addition to Rackspace Metrics, other large scale deployments of Blueflood can be found at Community Wiki. What is Blueflood?Simply put, Blueflood is a big, fast database for your metrics.Data from Blueflood can be used to construct dashboards, generate reports, graphs or for any other use involving time-series data. It focuses on near-realtime data, with data that is queryable mere milliseconds after ingestion.Data is stored using Cassandra to make Blueflood fault-tolerant and highly-available. In contrast to forebearers such as CarbonDB or RRDTool, your Blueflood cluster can expand as your metrics needs grow. Simply add more Cassandra nodes.Written in Java, Blueflood exists as a cluster of distributed services. The services are:IngestionQueryRollupYou send metrics to the ingestion service. You query your metrics from the Query service. And in the background, rollups are batch-processed offline so that queries for large time-periods are returned quickly.Blueflood was created by the Rackspace Monitoring team at Rackspace to manage raw metrics generated from the Rackspace Monitoring system. Blueflood is now largely promoted by the Rackspace Metrics team which provides Blueflood-as-a-Service as a free service (yes, really – just talk to us). Since making the product open source, several other large companies have begun using the tool.Blueflood is an open source under the Apache 2.0 license.QuickstartThere are a couple different ways that you can get started with Blueflood:Method 1: DockerAssuming git and docker-compose installed:git clone https://github.com/rackerlabs/blueflood.gitcd blueflood/contrib/blueflood-docker-compose/docker-compose up -dMethod 2: VagrantAssuming Vagrant and VirtualBox installed:mkdir blueflood_demo; cd blueflood_demovagrant init blueflood/blueflood; vagrant upMediaMetrics Meetup, December 2014 - Blueflood: Multi-tenanted Time-series Datastore:VideoSlidesBerlin Buzzwords, May 2014 - Blueflood 2.0 and beyond: Distributed open source metrics processing:VideoSlidesMetrics Meetup, February 2014 - Introduction to Blueflood:VideoSlidesThis presentation given to the SF Metrics Meetup group in February 2014 is a good video introduction to Blueflood.Cassandra EU, October 2013 - Blueflood: Simple Metrics Processing:VideoSlidesContributingLet’s just get this straight: we love anybody who submits bug reports, fixes documentation, joins our IRC channel, submits PR’s… whatever you got, we’ll gladly accept.If you want to get involved at any level, check out our Contributing page on the wiki!Questions or need help?Check out the Talk to us page on our wiki.Copyright and LicenseCopyright 2013-2015 RackspaceLicensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License athttp://www.apache.org/licenses/LICENSE-2.0Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Illustration Image
blueflood

Blueflood is a high throughput, low latency, multi-tenant distributed metric processing system behind Rackspace Metrics, which is currently used in production by the Rackspace Monitoring team and Rackspace Public Cloud team to store metrics generated by their systems. In addition to Rackspace Metrics, other large scale deployments of Blueflood can be found at Community Wiki.

Build Status Coveralls Release License

What is Blueflood?

Simply put, Blueflood is a big, fast database for your metrics.

Data from Blueflood can be used to construct dashboards, generate reports, graphs or for any other use involving time-series data. It focuses on near-realtime data, with data that is queryable mere milliseconds after ingestion.

Data is stored using Cassandra to make Blueflood fault-tolerant and highly-available. In contrast to forebearers such as CarbonDB or RRDTool, your Blueflood cluster can expand as your metrics needs grow. Simply add more Cassandra nodes.

Written in Java, Blueflood exists as a cluster of distributed services. The services are:

  • Ingestion
  • Query
  • Rollup

You send metrics to the ingestion service. You query your metrics from the Query service. And in the background, rollups are batch-processed offline so that queries for large time-periods are returned quickly.

Blueflood was created by the Rackspace Monitoring team at Rackspace to manage raw metrics generated from the Rackspace Monitoring system. Blueflood is now largely promoted by the Rackspace Metrics team which provides Blueflood-as-a-Service as a free service (yes, really – just talk to us). Since making the product open source, several other large companies have begun using the tool.

Blueflood is an open source under the Apache 2.0 license.

Quickstart

There are a couple different ways that you can get started with Blueflood:

Method 1: Docker

Assuming git and docker-compose installed:

git clone https://github.com/rackerlabs/blueflood.git
cd blueflood/contrib/blueflood-docker-compose/
docker-compose up -d

Method 2: Vagrant

Assuming Vagrant and VirtualBox installed:

mkdir blueflood_demo; cd blueflood_demo
vagrant init blueflood/blueflood; vagrant up

Media

  • Metrics Meetup, December 2014 - Blueflood: Multi-tenanted Time-series Datastore:
  • Berlin Buzzwords, May 2014 - Blueflood 2.0 and beyond: Distributed open source metrics processing:
  • Metrics Meetup, February 2014 - Introduction to Blueflood:
  • Cassandra EU, October 2013 - Blueflood: Simple Metrics Processing:

Contributing

Let’s just get this straight: we love anybody who submits bug reports, fixes documentation, joins our IRC channel, submits PR’s… whatever you got, we’ll gladly accept.

If you want to get involved at any level, check out our Contributing page on the wiki!

Questions or need help?

Check out the Talk to us page on our wiki.

Copyright 2013-2015 Rackspace

Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.


Related Articles

bigtable
time.series
graphite

grafana/metrictank

John Doe

5/3/2021

Checkout Planet Cassandra

Claim Your Free Planet Cassandra Contributor T-shirt!

Make your contribution and score a FREE Planet Cassandra Contributor T-Shirt! 
We value our incredible Cassandra community, and we want to express our gratitude by sending an exclusive Planet Cassandra Contributor T-Shirt you can wear with pride.

Join Our Newsletter!

Sign up below to receive email updates and see what's going on with our company

Explore Related Topics

AllKafkaSparkScyllaSStableKubernetesApiGithubGraphQl

Explore Further

cassandra