CHAPTER 08 · Parallelism, the Responses API, and the App Server · 5 / 8
How it works: a parallel runner with a dependency guard
The buildable piece is the parallel executor. The key is to run read-only calls concurrently while forcing mutating calls to run one at a time, then collect results in order. We use a thread pool because tool calls are mostly I/O-bound (waiting on subprocesses and network).