Skip to slide
Chapter 12 · Secrets and Bring-Your-Own-Key
115 / 191

CHAPTER 12 · Secrets and Bring-Your-Own-Key · 7 / 10

Tie model routing to available credentials

A neat refinement: route work to providers the user can actually pay for. For background tasks (title generation, lightweight extraction), pick the cheapest model of whichever provider the user has a key for, falling back to the operator default. The credential resolution and the model-tiering strategy (Chapter 4) thus work together: "use the cheapest available model of an available provider."

← → arrow keys work too