SoylentNews

GitHub - Risingwavelabs/risingwave: RisingWave: the Next-generation Streaming Database in the Cloud.

upstart [soylentnews.org] writes:

████ # This file was generated bot-o-matically! Edit at your own risk. ████

GitHub - risingwavelabs/risingwave: RisingWave: the next-generation streaming database in the cloud. [github.com]:

RisingWave is now ready for production! Curious about the use cases? More details coming soon!

RisingWave is a cloud-native streaming database that uses SQL as the interface language. It is designed to reduce the complexity and cost of building real-time applications. RisingWave consumes streaming data, performs continuous queries, and updates results dynamically. As a database system, RisingWave maintains results inside its own storage and allows users to access data efficiently.

RisingWave ingests data from sources like Apache Kafka, Apache Pulsar, Amazon Kinesis, Redpanda, and materialized CDC sources.

Learn more at Introduction to RisingWave [risingwave.dev].

Quick Start Installation

There are two ways to install RisingWave: use a pre-built package or compile from source.

Use a Pre-built Package (Linux)

Use Docker (Linux, macOS)

Compile from Source with RiseDev [github.com] (Linux and macOS)

To build from source, you need to pre-install several tools in your system. You may use ./risedev configure to configure compile settings. Please refer to the developer guide [github.com] for more information.

You can launch a RisingWave cluster and process streaming data in a distributed manner, and enable other features like metrics collection and data persistence. Please refer to the developer guide [github.com] for more information.

Your First Query

To connect to the RisingWave server, you will need to install PostgreSQL shell [github.com] (psql) in advance.

If everything works correctly, you should see

sum_v1 -------- 6 (1 row)

in the terminal.

Connecting to an External Source

Please refer to get started guide [risingwave.dev] for more information.

Documentation

To learn about how to use RisingWave, refer to RisingWave docs [risingwave.dev]. To learn about the development process, see the developer guide [github.com]. To understand the design and implementation of RisingWave, refer to the design docs listed in readme.md [github.com].

License

RisingWave is under the Apache License 2.0. Please refer to LICENSE [github.com] for more information.

Contributing

Thanks for your interest in contributing to the project! Please refer to contribution guidelines [github.com] for more information.

Using a Streaming Database to Tackle the Tsunami of Real-Time Data

fliptop [soylentnews.org] writes:

Developed in Rust, RisingWave is a Postgres-compatible database can do many of the things that stream processing frameworks do, but within the context and control of a familiar relational database running in the cloud and the SQL language [datanami.com]:

The early days of stream data processing brought us stand-alone systems that were capable of acting upon vast streams of data, and doing so with low latency and reliability. Stream processing frameworks like Apache Storm made headway in addressing these challenges and led the way to more sophisticated frameworks like Apache Flink and others.

Things got significantly more complex when companies realized they needed to know something about the past to take the best action on the newest data, which necessitated the integration of stream processing frameworks with databases or data lakes, where the historical record lived as persisted data. Architectural blueprints, such as the Lambda and Kappa architectures, were proposed to address this unique challenge, but the technical complexity in keeping these dual-path systems running are immense.

[...] Yingjun Wu, a former AWS and IBM engineer, created RisingWave as a cloud-native database with the goal of providing the bernefits of stream processing without the technical complexity inherent with stream processing frameworks.

[...] “Existing open-source systems are very costly to deploy, maintain, and use in the modern cloud environment,” Wu, who is the CEO of RisingWave Labs [risingwave-labs.com], says in a press release today. “Our goal is not to build yet another streaming system that is 10X faster than existing systems, but to deliver a simple and cost-effective system that allows everyone to benefit from stream processing.”

The project is open source and available on GitHub via an Apache 2.0 license. Originally spotted on The Eponymous Pickle [blogspot.com].

Original Submission #1  Original Submission #2