Project Awesome project awesome

Spotify Luigi

a Python package for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.

Package 18.7k stars GitHub
Back to Big Data