AI Models Compete in the Chatbot Arena
AI models go head-to-head in Chatbot Arena
Andriy Onufriyenko/Getty Images
An industry-standard league table for ranking artificial intelligence models is being deliberately distorted by technology giants, researchers claim. The popular Chatbot Arena benchmark, according to Sara Hooker at Cohere Labs, a US non-profit, is a “distorted playing field” that gives an advantage to large companies like Meta, Amazon, and Google. These companies are able to discard models that score poorly, skewing the results and creating a misleading picture of the best AI models.
