Wiki › Project

Paper Scout

Article
From Chaipat's knowledge graph

Paper Scout is a free, open-source agent skill that turns a research question into a ranked, de-duplicated reading list of real papers, a BibTeX file and an interactive citation map. It is the first step of the Research Suite, followed by Claim Conflict Finder and Research Dossier.

Citation map, network view
Citation map, network view

What it does

An agent that supports the SKILL.md standard (Claude Code, Codex CLI, Cursor, Gemini CLI) reads the skill's instructions and drives a single Python script, scripts/scout.py, through a fixed sequence:

  1. Search OpenAlex, Semantic Scholar and arXiv with three to six search strings written from different angles. All three APIs are free and need no key.
  2. Snowball through the references and citing papers of the best hits.
  3. De-duplicate across sources by DOI, arXiv id and normalised title, keeping the richest metadata and flagging preprints.
  4. Rank every paper, then let the agent screen titles and abstracts the way a researcher would.
  5. Write references.bib and citation_map.html.

Ranking

The score combines three parts:

  • Relevance (55%): overlap between the question's terms and the paper's title (counted twice) and abstract.
  • Impact (30%): citations per year since publication, plus how often the paper is cited by others in the same set.
  • Recency (15%): where the publication year falls within the set's range.

Papers without an abstract are marked down by 10%.

No invented papers

The skill's first rule is that every paper must come from an API record with a DOI, arXiv id or URL. If the APIs can't be reached, it says so instead of filling the gap from memory. Preprints are always labelled as not peer-reviewed, and the final report lists which sources answered and which failed.

The citation map

citation_map.html is a single offline page with two views: a network of research clusters showing who cites whom, and a timeline of how the ideas developed. Clicking a paper opens its abstract, links and in-set citations. The page makes no network requests.

The repository includes a real run on "How are galaxy merger histories reconstructed from stellar data?": 114 papers from OpenAlex and arXiv, connected to his galactic merger work at NARIT.

Timeline view in dark mode
Timeline view in dark mode

Running it

python3 scripts/scout.py search --out research/topic --query "…" --terms "…" "…"
python3 scripts/scout.py rank     --out research/topic --keep 40
python3 scripts/scout.py snowball --out research/topic --top 5
python3 scripts/scout.py bib      --out research/topic
python3 scripts/scout.py map      --out research/topic

The script needs only Python 3.10 or later. Offline unit tests run without network access, and tools/package.py builds a single-file zip for the Agensi marketplace.

See also