Modelplane

介紹

The open source control plane for AI inference

翻譯準備中

取自儲存庫 README

README

正在載入完整 README。 以下為已儲存的摘錄。

Modelplane is software you install and run in your own environment to orchestrate models, the serving stack, and the infrastructure underneath across cloud, neocloud, and on-premise. It runs any model on any engine on any infrastructure, from a single GPU to disaggregated, multi-node deployments. Built on [Crossplane], it is an active system that continuously reconciles your fleet toward the state you declare: provisioning inference clusters, scheduling deployments onto compatible clusters, scaling replicas, caching weights, and routing traffic.