dsh-research-lab

Research-lab toolkit for DeepSeek Harness: a wiki-centric, eval-rigor-driven research workflow distilled from AutoSci (wiki as the center of a research project), ASI-Bench (evaluation rigor), daily-arXiv-ai-enhanced (digest), ChatPaper (paper review), nature-skills / research-writing-skill (academic writing), Supervisor-Skills (senior-review instinct), and hard lessons from real distillation experiments (hypothesis → verdict loops, eval 口径 discipline).

Tools

tool	purpose	inspired by
`rlab_wiki`	write wiki pages (`experiment/literature/decision/todo`) under `
/.rlab/wiki/` + rebuild index	AutoSci
`rlab_experiment`	hypothesis → prediction → evidence → verdict → conclusion pages	AutoSci + falsifiability discipline
`rlab_bench`	per-project eval ledger (`bench.jsonl`); flags 口径 (protocol) mismatches, e.g. mixing test/dev splits	ASI-Bench
`rlab_paper_review`	arXiv id → adversarial 8-point review checklist (also applies to your own papers)	ChatPaper + ASI-Bench
`rlab_arxiv_digest`	keyword digest of recent arXiv papers → `
/.rlab/digests/.md`	daily-arXiv-ai-enhanced
`rlab_writing`	line-anchored academic-expression check (passive/weak verbs/vague quantifiers/filler/term consistency)	nature-skills, research-writing-skill
`rlab_related`	self-building keyword retrieval: NLP tokenization + SQLite FTS5, no preset lexicon — terms are TF-IDF-mined from your docs (EN words + ZH n-grams) and expanded iteratively (search → mine → merge → repeat)	hamuleite-style corpus, Rocchio relevance feedback
`rlab_status`	one-screen project state: wiki counts, bench report, open TODOs	—

On-disk layout


/.rlab/
  wiki/
    index.md            # auto-rebuilt
    experiment/.md  # hypothesis → verdict
    literature/.md  # paper notes (link from digests)
    decision/.md    # ADRs: why you chose X
    todo/.md        # open items
  related.db           # FTS5 corpus + auto-built lexicon (rlab_related)
  bench.jsonl           # one eval row per line (JSON)
  digests/.md     # arXiv digests

Eval 口径 discipline (rlab_bench)

Every row must state metric, split, and for MTEB tasks the hf_subset. The report warns whenever a task's history mixes splits — comparing test-vs-dev scores is the classic way papers fool themselves (and reviewers).

Install

# from ~/.dsh/profiles/web
pnpm add @snow-the/dsh-research-lab@file:../.dsh-starter/plugins/dsh-research-lab
# add "dsh-research-lab" to dsh.profile.bundles, then restart dsh web

Build

pnpm install && pnpm build   # tsc declarations + esbuild bundle → dist/

@snow-the/dsh-research-lab

安装

说明文档