Awesome Streaming Awesome Build Status

A curated list of awesome streaming (stream processing) frameworks, applications, readings and other resources. Inspired by other awesome projects.

Website is a more dynamic website where you can find updates of the awesome projects here.

Table of Contents

Streaming Engine

Streaming Library

Streaming Application



Data Pipeline

Online Machine Learning

Streaming SQL



Closed Source


  1. In-Stream Big Data Processing
  2. The world beyond batch: Streaming 101 by Tyler Akidau.
  3. Real Time Analytics: Algorithms and Systems (VLDB 2015)
  4. Grokking Streaming Systems by Josh Fischer & Ning Wang
  5. Streaming Systems: The What, Where, When, and How of Large-Scale Data Processing by Reuven Lax, Slava Chernyak, and Tyler Akidau
  6. Data Pipelines with Apache Airflow by Bas P. Harenslak and Julian Rutger de Ruiter


Creative Commons License

Licensed under a Creative Commons Attribution-ShareAlike 4.0 International License