Xinference

Open-source library for unified deployment and serving of language, speech, and multimodal models across diverse hardware and infrastructure.