Home / Open Source Apps / text-generation-inference text-generation-inference Rust, Python, and gRPC server to deploy large language model Package GitHub Back to Open Source Apps