What happened
AI hardware startup Groq raised $350 million in new funding. The company designs custom Language Processing Units built specifically to run trained AI models at high speeds. It will use the capital to expand its chip infrastructure and meet growing customer demand.
The context
Inference is the step where a trained AI model generates answers for users. Running models quickly and cheaply is a major bottleneck for companies building AI products.
Sources
- PYMNTS.com ↗ via Google News Reported