Open source software: NOMYO Router
We released NOMYO Router
Recently we released a key piece of our infrastructure as open source software: Hello world NOMYO Router !
The router is managing multiple Inference Endpoints on both Ollama and OpenAI V1 API compatible endpoints and routes request from your frontend application to the configured endpoints for inference.
Router is aware of which model is served by which endpoint and how many (configurable) sessions will saturate an endpoint before using a different endpoint or API for a given large language model.