AI 'Tokenmaxxing' Fades: Companies Cut Tech Spending

The corporate fad of "tokenmaxxing" on artificial intelligence technology is fading. Workplaces are finding that throwing AI at everything is causing costs to rise without a similar increase in productivity. What began as hype over maximizing AI-generated work from products like OpenAI's ChatGPT and Anthropic's Claude is now seeing a backlash. Vincent Gusdorf, head of AI analytics at Moody's Ratings, notes it's easy to create something you don't need with AI. "Tokenmaxxing" refers to maximizing the usage of tokens, which are the building blocks of generative AI. Each token is about three quarters of a word, and pricier AI versions offer higher usage caps. As bills piled up, companies realized these tools are expensive and need to be used wisely. Silicon Valley executives previously promoted high token consumption, with some even suggesting engineers should be burning significant amounts of tokens. However, this trend fizzled as it became clear it wasn't the best strategy for everyone. Microsoft CEO Satya Nadella warned that customers are paying twice for AI, first in spending on tokens and second by feeding their proprietary data to these models. Palantir CEO Alex Karp said that businesses are "livid" about paying for tokens that create no value and risk their intellectual property. The bottom line is that the initial enthusiasm for unlimited AI usage is being replaced by a more cautious approach focused on actual value and cost.