Prompt Caching and Context Management

Chapter 4 left us with a problem: the prompt grows every turn, cost grows quadratically, and eventually the context window fills up. This chapter covers the two families of fixes that every serious harness uses. One attacks the cost curve (prompt caching). The other attacks the window ceiling (compaction and friends). They are different problems with different solutions, so keep them separate in your head.