Model routing can happen across layers, each with a different set of information. The final choice belongs in the harness because it can:
- Reduce cost while maintaining performance, accounting for the prompt cache
- Shape jobs and choose their models together
- Learn continuousl…↗