Illustration Image

Cassandra.Link

The best knowledge base on Apache Cassandra®

Helping platform leaders, architects, engineers, and operators build scalable real time data platforms.

1/3/2021

Reading time:1 min

DataStax-Examples/astra-spark-migration

by DataStax-Examples

40 minutes, Expert, Start BuildingMigrate data from an existing Cassandra cluster to Astra using a Spark application.ObjectivesLeverage Spark to migrate data from a Cassandra cluster to Cassandra on AstraDB.How this worksWe're using Spark to migrate data from a Cassandra cluster to Cassandra on AstraDB.Get StartedTo build and play with this app, follow the build instructions that are located here: https://github.com/DataStax-Examples/astra-spark-migrationFollow the instructions below to get started.PrerequisitesLet's do some initial setup.DataStax AstraCreate a DataStax Astra account if you don'talready have one:On the home page. Locate the button Add DatabasePick free plan and a region close to you, click configure.Define a database name, keyspace name and credentials (Take note of the DB Password)Your Astra DB will be ready when the status will change from Pending to Active 💥💥💥Locate the combo Organization: <Your email> on the top navigation. In the drop down menu, click your current organization.Scroll down to the bottom of the page and locate Service Account in Security Settings and select Copy Credentials as shown below.GithubClick Use this template at the top of the GitHub Repository:Enter a repository name and click 'Create repository from template':Clone the repository:

Illustration Image

40 minutes, Expert, Start Building

Migrate data from an existing Cassandra cluster to Astra using a Spark application.

image

Objectives

  • Leverage Spark to migrate data from a Cassandra cluster to Cassandra on AstraDB.

How this works

We're using Spark to migrate data from a Cassandra cluster to Cassandra on AstraDB.

Get Started

To build and play with this app, follow the build instructions that are located here: https://github.com/DataStax-Examples/astra-spark-migration

Follow the instructions below to get started.

Prerequisites

Let's do some initial setup.

DataStax Astra

  1. Create a DataStax Astra account if you don't already have one: image

  2. On the home page. Locate the button Add Database image

  3. Pick free plan and a region close to you, click configure. image image

  4. Define a database name, keyspace name and credentials (Take note of the DB Password) image

  5. Your Astra DB will be ready when the status will change from Pending to Active 💥💥💥image

  6. Locate the combo Organization: <Your email> on the top navigation. In the drop down menu, click your current organization. image

  7. Scroll down to the bottom of the page and locate Service Account in Security Settings and select Copy Credentials as shown below. image

Github

  1. Click Use this template at the top of the GitHub Repository: image

  2. Enter a repository name and click 'Create repository from template': image

  3. Clone the repository: image

Related Articles

sstable
cassandra
spark

Spark and Cassandra’s SSTable loader

Arunkumar

11/1/2024

Checkout Planet Cassandra

Claim Your Free Planet Cassandra Contributor T-shirt!

Make your contribution and score a FREE Planet Cassandra Contributor T-Shirt! 
We value our incredible Cassandra community, and we want to express our gratitude by sending an exclusive Planet Cassandra Contributor T-Shirt you can wear with pride.

Join Our Newsletter!

Sign up below to receive email updates and see what's going on with our company

Explore Related Topics

AllKafkaSparkScyllaSStableKubernetesApiGithubGraphQl

Explore Further

astra