Colossal-AI

An open-source deep learning system for large-scale model training and inference with high efficiency and low cost.