Skip to content

Web research

Liminal researches the public web with web_search plus parallel web_fetch — there is no separate web_research tool. The model composes a search with several fetches, which maps cleanly onto "gather N sources, compare claims."

The retrieval order

For knowledge tasks the protocol enforces an order so the agent doesn't skip what it already knows:

  1. memory_query / recall_relevant — your own notes.
  2. vault_search / vault_read — your long-form knowledge.
  3. web_search + parallel web_fetch — only when local knowledge is insufficient.

See Memory & recall for the first two layers.

Tools

ToolPurpose
web_searchFind candidate sources for a query
web_fetchFetch + extract a page (readability when AGENT_WEB_READABILITY is on)
http_requestRaw HTTP when you need headers/JSON, not article extraction
extract_structuredPull structured JSON out of messy HTML/text

Run multiple web_fetch calls in parallel for breadth. Large bodies are distilled to .agent_artifacts/ pointers in context — the model re-reads via read_artifact instead of repeating megabytes each round.

Bot walls & reliability

web_fetch has per-request and total wall-clock timeouts and retries behind bot walls. When a site returns a 401/403, AGENT_WEB_FETCH_403_RETRY retries with alternate (Firefox / cross-site Chrome) user agents. For pages that need JavaScript execution or a logged-in session, use browser automation instead of web_fetch.

VariableDefaultPurpose
AGENT_WEB_READABILITYonArticle extraction in web_fetch
AGENT_WEB_FETCH_TIMEOUT_MS20000Per-request timeout
AGENT_WEB_FETCH_TOTAL_WALL_MS55000Hard wall clock per call (all retries + parse)
AGENT_WEB_FETCH_403_RETRYonAlternate-UA retry after a bot-wall 401/403
AGENT_QUERY_REWRITEoffMulti-query expansion before recall

Research at scale

For multi-angle or multi-source research, fan out:

  • spawn_agent per angle ("only fetch official docs", "only GitHub issues") — see Sub-agents & orchestration.
  • A dynamic workflow with phases (sources → analysis → synthesis) when the classifier marks the task workflowSuitable.
  • research_state tracks the research ledger so long investigations stay disciplined.

Keeping results

Write durable findings down: short claims via remember({ scope: "workspace" }), long briefs via vault_write with [[wikilinks]]. The document engine can compile a report into PPTX/DOCX/PDF when AGENT_DOC_ENGINE is on. Set AGENT_EFFORT=high for thorough deliverables — see Reasoning & effort.

Liminal AI · Alpha docs · Marketing: vireondynamics.com/liminal · Compare: vireondynamics.com/liminal/compare