As companies rethink AI ROI, Replit's AI chief calls token leaderboards 'very dystopian'

• AI leaderboards ranking employees by token use became more popular.
• Replit’s AI chief called the practice “very dystopian” and a poor performance metric.
• Tech firms like Amazon and Uber are questioning the ROI of AI spending.

Catasta said that token consumption is a poor measure of employee performance.

Token usage is “not proportional to the amount of impact that those people are having within the company,” he said.

While Catasta said he was “very happy” about what he described as a recent “narrative flip” on “tokenmaxxing,” he said that the practice can encourage wasteful behavior.

“It’s also irresponsible,” he said, comparing excessive AI use to leaving the lights on at home and not caring about the electricity bill.

“Using AI excessively comes with a certain level of impact: more energy is being used, there’s less capacity for other use cases that other companies want to build on top of,” he added.