ex-Meta Principal Explains the AI Token Game
In a Nutshell
The AI industry has built an elaborate circular economy where hyperscalers, model companies, and investors all profit from increased token consumption, with enterprise customers ultimately funding the entire system through premium API pricing. Token maxing is heavily incentivized through subsidies, leaderboards, and FOMO marketing, but evidence shows it often produces twice the output at ten times the cost without correlating to actual business value. Enterprise leaders should replace token metrics with adoption dashboards and outcome tracking, while implementing cost guardrails and removing organizational bottlenecks rather than rewarding raw token volume.
These notes were generated by AI and may contain inaccuracies.
Token maxing is viewed by some as evidence of being an expert in agentic engineering who lives on the bleeding edge and achieves massively higher productivity than peers. Others see it as the most wasteful spending and the dumbest idea of the time. One perspective states: "If you can token max it's like I mean you could buy millions of years of consciousness." Engineers commonly run hundreds of agents, with some running a few thousand agents nightly for deeper work.
AI tokens are very costly. Companies are burning through budgets faster than ever before and receiving shocking bills. Industry leaders continue telling employees to use more tokens, and many companies incentivize AI usage by counting tokens. One executive noted they will probably use $300 million of Anthropic this year. Some companies effectively fund unlimited tokens for everybody.
The ecosystem begins with end users sending prompts to large language models, which generate tokens to complete work. Most people use frontier models and pay companies like OpenAI or Anthropic for tokens used. Large language models run in massive data centers operated by hyperscalers such as AWS, Google Cloud, and Microsoft Azure. Generating tokens requires significant computation, so OpenAI and Anthropic pay hyperscalers for the compute used. Data centers host large numbers of GPUs from chip makers including Nvidia and AMD. Google is the only company that controls the entire chain from chips through models.
Sign in to read the full notes
Get access to AI-generated notes, topic timestamps, and more.