Llamaedge

Deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Diffusers

Library of pretrained diffusion models for generating images, audio, and 3D structures, for inference or training

Model Optimizer

Ray

Distributed runtime and ML libraries for scaling Python and AI workloads from a laptop to a cluster