AI Inference Costs

The financial expenditure associated with executing trained AI models on production workloads, encompassing compute, memory, and latency trade-offs.

Overview

• Goldman Sachs reported that companies are exceeding their AI inference budgets by orders of magnitude, with inference costs approaching 10% of total headcount costs. (Source: Goldman Sachs (via Hedgeye Markets), via AI Daily Brief, 2026-08-24)

Provenance