Arena AI

Arena CEO Anastasios Angelopoulos stated that enterprises are struggling with trust, being skeptical of both frontier labs and Chinese open models when deciding on AI solutions. He noted that concerns include model stability due to potential shutdowns by providers like OpenAI or Anthropic, and security risks associated with China-based companies.

The AI industry is shifting focus from the smartest models to cost efficiency, prioritizing 'intelligence per dollar' as many models become sufficient for business tasks. Companies like Amazon are optimizing expenses by using less-powerful but cheaper AI for routine tasks while reserving pricier models for complex needs. Experts highlight factors like reliability, cost structure, and reusability to evaluate AI models based on value.

Alibaba's Qwen 3.7 Max was tested and its preview seemed promising before the Cloud Summit. The test results showed both strengths and weaknesses of Alibaba's new AI. The preview earned a spot on Arena AI five days prior to the summit.

A live tracker was built to visualize the lifecycle and performance changes of flagship AI models, specifically tracking historical ELO ratings from Arena AI. The tracker plots one continuous curve per major AI lab, making it easier to see sudden generational jumps and slow performance decays. The project is open-source and seeking feedback or pointers to datasets.