Illustration Image

Cassandra.Link

The best knowledge base on Apache Cassandra®

Helping platform leaders, architects, engineers, and operators build scalable real time data platforms.

5/1/2020

Reading time:1 min

Connectors — Lenses.io

by John Doe

About Stream ReactorStream Reactor is an Apache License, Version 2.0 open source collection of components built on top of Kafka and provides Kafka Connect compatible connectorsto move data between Kafka and popular data stores.Stream Reactor provides source connectors to publish data into Kafka and sink connectors to move data out of Kafka and into other systems.The connectors support KCQL (Kafka Connect Query Language), an open source component of Lenses SQL Engine, provides a SQL like syntax in orderto drive the connector actions. It supports topics routing, payload projection via field selection, error policies, and if the target system supports it auto-creation and auto-evolution.About Kafka ConnectKafka Connect is a framework to rapidly stream events in and out of Apache Kafka. It has a narrow focus on dataingress (in) and egress (out) of the central nervous system of modern streaming frameworks. Connect allows developersto quickly build robust, durable, scalable and secure pipelines in and out of Kafka.Kafka Connect can run in standalone or distributed mode. The former is targeting testing or a one-off job whereas the later provides a scalable, fault-tolerant service supporting an entire organization.Connect can scale down for development, testing, and small deployments or scale out to support production workloads.Combined with KCQL it offers a low barrier entry and operational overhead allowing support for large organizations data pipelines.All our Stream-Reactor connectors support AVRO, and use converters to translate the AVRO into Kafka Connectsinternal Struct type. JSON is supported on the following Sinks: ReThinkDB, MongoDB, InfluxDB,Cassandra DSE Sink, JMS (TextMessages only), CoAP Sink, MQTT Sink, Elasticsearch.ContentsQuick StartDownloadInstallationSource ConnectorsSink ConnectorsConnect CLIIntegration TestsFAQRelease Notes

Illustration Image
Stream-Reactor connector logo

About Stream Reactor

Stream Reactor is an Apache License, Version 2.0 open source collection of components built on top of Kafka and provides Kafka Connect compatible connectors to move data between Kafka and popular data stores. Stream Reactor provides source connectors to publish data into Kafka and sink connectors to move data out of Kafka and into other systems.

The connectors support KCQL (Kafka Connect Query Language), an open source component of Lenses SQL Engine, provides a SQL like syntax in order to drive the connector actions. It supports topics routing, payload projection via field selection, error policies, and if the target system supports it auto-creation and auto-evolution.

../_images/connectSR.png

About Kafka Connect

Kafka Connect is a framework to rapidly stream events in and out of Apache Kafka. It has a narrow focus on data ingress (in) and egress (out) of the central nervous system of modern streaming frameworks. Connect allows developers to quickly build robust, durable, scalable and secure pipelines in and out of Kafka.

Kafka Connect can run in standalone or distributed mode. The former is targeting testing or a one-off job whereas the later provides a scalable, fault-tolerant service supporting an entire organization. Connect can scale down for development, testing, and small deployments or scale out to support production workloads. Combined with KCQL it offers a low barrier entry and operational overhead allowing support for large organizations data pipelines.

All our Stream-Reactor connectors support AVRO, and use converters to translate the AVRO into Kafka Connects internal Struct type. JSON is supported on the following Sinks: ReThinkDB, MongoDB, InfluxDB, Cassandra DSE Sink, JMS (TextMessages only), CoAP Sink, MQTT Sink, Elasticsearch.

Related Articles

cassandra
kafka
kafka.connect

Getting started with the Kafka Connect Cassandra Source

John Doe

4/21/2022

Checkout Planet Cassandra

Claim Your Free Planet Cassandra Contributor T-shirt!

Make your contribution and score a FREE Planet Cassandra Contributor T-Shirt! 
We value our incredible Cassandra community, and we want to express our gratitude by sending an exclusive Planet Cassandra Contributor T-Shirt you can wear with pride.

Join Our Newsletter!

Sign up below to receive email updates and see what's going on with our company

Explore Related Topics

AllKafkaSparkScyllaSStableKubernetesApiGithubGraphQl

Explore Further

cassandra