Using NATS and Siddhi for Stream Processing

The Siddhi.io team and NATS team have collaborated to create this demonstration using NATS JetStream with Siddhi to provide a high performance, highly scalable stream processing solution.

WIP

This is a work in progress.

Overview

A stream of simulated system data is published into NATS and processed by Siddhi.

TODO: Provide details

Filters and Alerts

TODO, describe Siddhi filters, alerts etc on the system data and expected behavior

Getting Started

Dependencies

• Kubernetes
• kubectl
• Siddhi Operator
• Siddhi Dependencies

Installation

NATS

To install NATS and the streaming server, use the one line NATS Kubernetes install found in the nats.k8s repository.

This will install NATS, NATS Streaming, and NATS Surveyor to monitor the NATS deployment.

Siddhi

Follow the Siddhi instructions to install Siddhi as a microservice into your Kubernetes cluster.

Test Applications

TODO

Running the demonstration

To run the demonstration…

TODO

TODO

• Configure the Siddhi Microservice to use the NATS service
• Generate/Save Test Data
• Create Test applications and dockerize