Cost, Latency, and Model Tiering

Agents can be expensive and slow if built naively, and both problems compound: an agent loop makes multiple model calls per turn, each potentially large. Cost and latency are not afterthoughts to optimize later; they're design constraints that shape your architecture. This chapter covers where the costs and delays come from and the levers that control them.