dsh-model-modes

Configuration

Built-in contracts are enabled by default. fastProfiles is an additive/override layer; later exact provider/model/API matchers win.

- id: dsh-model-modes
  config:
    includeDefaultFastProfiles: true
    fastProfiles:
      # A verified self-hosted gateway. Provider and API must be exact;
      # use model: '*' only if every model on that route has the same contract.
      - provider: your-gateway
        model: gpt-5.6
        api: openai-responses
        strategy: openai-fast

      # Vertex is explicit because the matcher cannot inspect endpoint location.
      - provider: google-vertex
        model: gemini-3.7-flash
        api: google-vertex
        strategy: vertex-priority

Known strategies:

• openai-fast
• openai-codex-fast
• service-tier-priority
• fireworks-priority
• google-priority
• vertex-priority
• bedrock-priority
• openrouter-fast
• vercel-gateway-fast
• custom

Set includeDefaultFastProfiles: false to use only explicit profiles.

Use custom only for a verified gateway-specific contract:

fastProfiles:
  - provider: your-gateway
    model: your-model
    api: openai-responses
    strategy: custom
    body:
      acceleration:
        tier: turbo
    headers:
      X-Gateway-Fast: "1"

To keep Fast orthogonal, custom patches cannot modify model, provider, reasoning, reasoning_effort, thinking, thinkingConfig, effort, and related fields.