Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(fix) incorrect aggregation script location #23

Merged
merged 1 commit into from
Aug 17, 2024
Merged

(fix) incorrect aggregation script location #23

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 9 additions & 7 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,24 +7,25 @@
Denormalized is a fast embeddable stream processing engine built on Apache DataFusion.
It currently supports kafka as a real-time source and a sink, windowed aggregations, and stream joins.

This repo is still a *work-in-progress* and we are actively seeking design partners. If you have have a specific use-case you'd like to discuss please drop us a line via a github issue or email [email protected].

## Quickstart
## Quick Start

### Prerequisites

- Docker
- Rust/Cargo installed

### Running an example

1. Start kafka in docker `docker run -p 9092:9092 --name kafka apache/kafka`
2. Start emitting some sample data: `cargo run --example emit_measurements`
3. Run a [simple streaming aggregation](./examples/examples/simple_aggregation.rs) on the data using denormalized: `cargo run --example emit_measurements`
3. Run a [simple streaming aggregation](./examples/examples/simple_aggregation.rs) on the data using denormalized: `cargo run --example simple_aggregation`

## More examples

A more powerful example can be seen in our [kafka ridesharing example](./docs/kafka_rideshare_example.md)
A more powerful example can be seen in our [Kafka ridesharing example](./docs/kafka_rideshare_example.md)

## Roadmap

- [x] Stream aggregation
- [x] Stream joins
- [ ] Checkpointing / restoration
Expand All @@ -38,5 +39,6 @@ A more powerful example can be seen in our [kafka ridesharing example](./docs/ka

## Credits

Denormalized is built and maintained by [Denormalized](https://www.denormalized.io) in San Francisco. Please drop in a line to
[email protected] or simply open up a GitHub Issue!
Denormalized is built and maintained by [Denormalized](https://www.denormalized.io) in San Francisco.

This repo is still a *work-in-progress* and we are actively seeking design partners. If you have have a specific use-case you'd like to discuss please drop us a line via a [github issue](https://github.com/probably-nothing-labs/denormalized/issues) or email `[email protected]`.