inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Loading project owner…
Projects using this repository
No references listed yet.
Check-ins (0)

Community

Create post
Ask or share about inference…
Loading...