Skip to slide
Chapter 8 · Parallelism, the Responses API, and the App Server
53 / 142

CHAPTER 08 · Parallelism, the Responses API, and the App Server · 5 / 8

How it works: a parallel runner with a dependency guard

The buildable piece is the parallel executor. The key is to run read-only calls concurrently while forcing mutating calls to run one at a time, then collect results in order. We use a thread pool because tool calls are mostly I/O-bound (waiting on subprocesses and network).

← → arrow keys work too