Distributed AI inference with mycellios

mycellios is an open-source project building a distributed AI inference runtime. Its coordinator plans model stages across worker computers and streams responses through a familiar API.

The project is under active development. Multi-host GPU performance, models that need combined host memory, and recovery after a worker fails have not been demonstrated as general production capabilities.