Skip to content
FunCoding

Search

Search docs, Skills and MCP

firecrawl-crawl

Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages.

其他646skills/firecrawl-crawl/SKILL.md

Install

Send this to Claude Code, Codex or Cursor. The agent checks the Skill for safety first and installs it only after you confirm.

读取 https://funcoding.ai/skills/firecrawl/cli/firecrawl-crawl/install.md ,按里面的步骤帮我安装这个 Skill。

SKILL.md

firecrawl crawl

Bulk extract content from a website. Crawls pages following links up to a depth/limit.

Prerequisite: crawl requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.

Quick start

# Crawl a docs section
firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json

# Full crawl with depth limit
firecrawl crawl "<url>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json

# Check status of a running crawl
firecrawl crawl <job-id>

Run firecrawl crawl --help for the full option list.

Done when: the crawl reaches a terminal status and the saved output under .firecrawl/ contains the expected pages.

Tips

  • Use --wait when you need the results immediately. It has no default timeout; use --timeout <seconds> to bound polling. Without --wait, crawl returns a job ID for async polling.
  • Scope crawls with --include-paths whenever the request names a section — crawl only the pages you need.
  • Crawl consumes credits per page. Check firecrawl credit-usage before large crawls (credit-usage requires authentication).

See also

Similar Skills

ponytail-gain
DietrichGebert/ponytail160k

ponytail-gain

Show ponytail measured impact as a scoreboard: less code, less cost, more speed, from the agentic benchmark averages. One-shot display.

Other

ponytail-debt
DietrichGebert/ponytail160k

ponytail-debt

Harvest every shortcut: comment into one debt ledger, so deferrals get tracked instead of forgotten. One-shot report.

Other

ponytail-gain
DietrichGebert/ponytail160k

ponytail-gain

Show ponytail's measured savings (code, cost, speed) from the benchmark. One-shot display. Use for /ponytail-gain, "what does ponytail save", "ponytail impact".

Other

ponytail-debt
DietrichGebert/ponytail160k

ponytail-debt

List every `shortcut:` comment (and older `ponytail:` ones) as a debt ledger. One-shot report, changes nothing. Use for "ponytail debt", "what did ponytail defer", "list the shortcuts", /ponytail-debt.

Other

understand-onboard
Egonex-AI/Understand-Anything86k

understand-onboard

Use when you need to generate an onboarding guide for new team members joining a project

Other

ulw-loop
code-yeongyu/oh-my-openagent70k

ulw-loop

A goal-like loop that decomposes work into systematic, evidence-bound ultrawork steps. Use when the user wants a goal loop or durable, checkpointed execution.

Other