Awesome Data Engineering

A curated list of data engineering tools for software developers Awesome

List of content

  1. Databases
  2. Ingestion
  3. File System
  4. Serialization format
  5. Stream Processing
  6. Batch Processing
  7. Charts and Dashboards
  8. Workflow
  9. Datasets
  10. Monitoring
  11. Docker

Databases

Data Ingestion

File System

Serialization format

Stream Processing

Batch Processing

Charts and Dashboards

Workflow

ELK Elastic Logstash Kibana

Docker

Datasets

Realtime

Data Dumps

Monitoring

Prometheus

Community

Forums

Conferences

Cheers to The Data Engineering Ecosystem: An Interactive Map

Inspired by the awesome list. Created by Insight Data Engineering fellows.

License

CC0

To the extent possible under law, Igor Barinov has waived all copyright and related or neighboring rights to this work.

Bitdeli Badge