Skip to slide
Chapter 3 · Tool Design
20 / 191

CHAPTER 03 · Tool Design · 4 / 11

The cheap/expensive pairing- A way to reduce token usage in models :-P

A recurring, valuable pattern: offer a cheap, narrow variant alongside an expensive, broad one, so the model can pick the right cost for the task.

  • "Find this phrase in the document" (cheap, targeted) vs. "read the whole document" (expensive, complete).
  • "Get just the metadata" (cheap) vs. "fetch the full text" (expensive).
  • "List what's available" (cheap discovery) vs. "fetch these N items" (expensive retrieval).

Without the cheap option, the model pays full price for every lookup: more tokens, more latency, more cost. The cheap variant lets it confirm a fact or locate a needle without ingesting a haystack. Give the model economical options and it will often use them.

← → arrow keys work too