Crowdsourced AI benchmarks have serious flaws, some experts say | TechCrunch
AI labs are increasingly relying on crowdsourced benchmarking platforms such as Chatbot Arena to probe the strengths and weaknesses of their latest models. But some...
Tag : benchmarking
Even some of the best AI can’t beat this new benchmark | TechCrunch
The nonprofit Center for AI Safety (CAIS) and Scale AI, a company that provides a number of data labeling and AI development services, have released...
AI benchmarking organization criticized for waiting to disclose funding from OpenAI | TechCrunch
An organization developing math benchmarks for AI didn’t disclose that it had received funding from OpenAI until relatively recently, drawing allegations of impropriety from some...
Will Smith eating spaghetti and other weird AI benchmarks that took off in 2024 | TechCrunch
When a company releases a new AI video generator, it’s not long before someone uses it to make a video of actor Will Smith eating...