Big Data Analytics On Kubernetes for Streaming Application - XenonStack

Setting up Analytics Stack for Streaming ApplicationsSKACK Stack is an open source Full-Stack platform for Real-Time analysis of Big Data. It consists of Apache Spark, Kubernetes, Akka, Apache Cassandra, and Apache Kafka.GCP & GlusterFS acts a storage solution as it supports multi-mount and data remains on all nodes of GlusterFS & GCP.Challenge for Setting Up Multi Node cluster on SKACKSet up a multi-node cluster for SKACK Stack with a document on Kubernetes.Container environment is not persistent by default, so application in Kubernetes needs Persistent storage to store data.Using Kubernetes to scale up Spark.Using Kubernetes to scale up CassandraUsing Kubernetes to scale up KafkaSolution Offerings for Setting Up on Premises Kubernetes ClusterTo overcome the challenges mentioned above, set up a three-node on premises Kubernetes cluster in which one will as a master and the other two workers.The Cluster includes –Kubernetes MasterKubernetes SchedulerKubernetes Controller ManagerSetup for analyzing the cluster and reporting to the API server to store metrics that contains resource utilization, availability, and performance.