A cheaper token does not guarantee a smaller budget
The episode offers a working forecast, not exact prices. By 2029, achieving 2026-level quality may become three to ten times cheaper and a typical accepted task two to five times cheaper, while a scaled AI portfolio could cost two to five times more. Enterprise spending and adoption are growing quickly, while broad scaling and demonstrated financial impact lag. Though the samples are not directly comparable, together they show AI becoming a production expense rather than a bounded experiment.
The growth mechanism is tasks × calls per task × tokens per call × token price, plus seats, platform services, and reserved capacity. An agentic task may trigger five, ten, or fifty calls, resend context, invoke tools, and activate fallbacks. Token price falls in only one factor while the others expand. More spending may represent valuable work, yet without trace-level telemetry it cannot be separated from loops, retries, oversized results, and rework.
Budget the trace and count accepted tasks
A global allowance per person mixes quick assistance with long production workflows. The episode instead limits the complete trace: cost, steps, retries, repeated calls, tool-output volume, time, concurrency, and authority. An agent also needs a loop detector, kill switch, and safe human fallback because failure adds investigation and recovery. Ownership belongs at the natural level: a seat to a person, exploration to a team, production inference to a use case, and shared capabilities to a central owner.
FinOps maturity starts with visibility and showback. Teams see spend by product, workflow, and environment, build a forecast, and only then receive thresholds or chargeback. The decisive denominator is the accepted task. Its cost includes the model, tools, retrieval, compute, human review, rework, and expected failure loss; only work that passes acceptance is counted. For a bug fix this means tests and no regression, for review a useful signal without noise, and for a production agent a completed workflow with acceptable consequences.
Optimization begins after a quality gate
Routes must be compared on the same tasks and quality threshold, including repeated runs, retries, fallback, human time, and cost tails. Only passing candidates form a Pareto frontier across quality, cost, and latency. This also exposes where lock-in lives: prompts, tool behavior, state, evaluations, commitments, and team skills rather than the HTTP endpoint. The portable unit should be the task contract—input, artifact, acceptance rule, and permitted effects—while provider-specific capabilities stay behind explicit adapters.
Routing maturity proceeds through observable stages: one instrumented route, task tags, static rules, verified fallback, escalation cascades, and finally a learned router trained on real outcomes. A local model must pass the same quality gate. Its economics include GPUs or cloud commitments, idle capacity, high availability, storage, inference engineering, SRE, security, and upgrades; break-even needs stable accepted-task volume. Enterprise contracts likewise require capacity, retention, model-version terms, usage-data export, and exit rights, not merely a headline discount.
What to take away
- 01Cheaper fixed-quality intelligence expands demand, so total AI spend may rise while accepted tasks become less expensive.
- 02Limits should govern the entire trace—cost, steps, time, and authority—rather than a monthly allowance per person.
- 03Cost per accepted task combines inference, tools, human review, rework, and risk; comparing prices before a shared quality gate is misleading.
- 04Routing, enterprise commitments, and local inference pay off only after telemetry, evaluations, stable volume, and a tested exit path exist.