dsh-tool-vision

External vision model for DeepSeek Harness.

DeepSeek's own models are text-only, and dsh-llm has no multimodal content block yet. This plugin bridges the gap in two ways:

1. inspect_image tool — sends an image (local file, or http(s) URL) to any OpenAI-compatible /chat/completions endpoint that supports image_url content parts, and returns the vision model's textual answer into the agent loop.
2. Image bridge (v0.1.1) — when the active model is text-only, images pasted into the conversation are intercepted on the llm/stream waterfall, exported to a local file, and replaced with a text hint, so the agent picks them up with inspect_image. Models listed in multimodalModels receive image blocks directly instead.

• Zero dependencies beyond the dsh SDK — works with any compatible endpoint: OpenAI GPT-4o, Qwen-VL (DashScope), GLM-4V (Zhipu), Moonshot, Gemini compatible endpoints, local Ollama, etc.
• Registered on the global tools layer: every agent in the process can call inspect_image.

Install

Mount in a profile patch ($DSH_HOME/profiles//cordis.patch.yml):

- insert:
    - id: tool-vision
      name: 'dsh-tool-vision'     # after: pnpm add dsh-tool-vision in the profile
      config:
        baseURL: 'https://api.openai.com/v1'
        apiKeyEnv: 'VISION_API_KEY'
        model: 'gpt-4o-mini'

Or load it from a local path without npm:

    - id: tool-vision
      name: './plugins/dsh-tool-vision/index.js'

Config

Field	Default	Meaning
baseURL	https://api.openai.com/v1	OpenAI-compatible API base URL.
apiKey	''	API key (takes precedence over env).
apiKeyEnv	VISION_API_KEY	Env var holding the key.
model	gpt-4o-mini	Vision model id.
maxTokens	1024