dsh-agent-eval
DSH plugin: evaluate agent performance on defined tasks — run benchmarks, score outcomes, track improvement over prompt/model changes.
AI Analysis
核心用途是量化评估智能体任务执行能力。适合需要对智能体进行基准测试、调优提示词或对比模型效果的开发者。
Install
This plugin has no verified bundle, or compatibility checks failed. Read the repository notes first. Read the full README ↗
README
Read the full README ↗配置
- id: agent-eval
plugin: dsh-agent-eval
config:
fixturesDir: ./eval/tasks
resultsDir: ./eval/results
defaultTimeout: 120000 # 每个任务最长 2 分钟