What happened
Nvidia is expanding into the market for model routers. Model routers direct user prompts to the most suitable or cheapest AI model for a given task. The source report provides limited technical details and launch dates.
The context
Model routers help businesses cut costs by routing simple tasks to smaller models and hard tasks to larger ones. Nvidia already dominates AI chip hardware, so moving into routing software expands its control over the AI stack.
Sources
- cio.com ↗ via Google News Reported