Awesome Data Engineering

A curated list of data engineering tools for software developers Awesome

List of content

  1. Databases
  2. Ingestion
  3. File System
  4. Serialization format
  5. Stream Processing
  6. Batch Processing
  7. Charts and Dashboards
  8. Workflow
  9. ELK Elastic Logstash Kibana
  10. Docker
  11. Datasets
  12. Monitoring
  13. Community

Databases

Data Ingestion

File System

Serialization format

Stream Processing

Batch Processing

Charts and Dashboards

Workflow

ELK Elastic Logstash Kibana

Docker

Datasets

Realtime

Data Dumps

Monitoring

Prometheus

Community

Forums

Conferences

Podcasts

Cheers to The Data Engineering Ecosystem: An Interactive Map

Inspired by the awesome list. Created by Insight Data Engineering fellows.

License

CC0

To the extent possible under law, Igor Barinov has waived all copyright and related or neighboring rights to this work.