Firecrawl Crawl
firecrawl_crawlStarts a crawl job on a website and extracts content from all pages.
How it works ↓Pricing
Per call
$0.05
Model
flat
Pay only for what you use. No subscriptions.
Inputs
excludePaths
arraycrawlEntireDomain
booleanincludePaths
arrayscrapeOptions
objectdeduplicateSimilarURLs
booleanallowExternalLinks
booleanurl *
stringmaxConcurrency
numberdelay
numbermaxDiscoveryDepth
numberlimit
numberallowSubdomains
booleanignoreQueryParameters
booleanprompt
stringsitemap
stringInput Parameters
Cost per run
Execution cost$0.05
About Firecrawl Crawl
Starts a crawl job on a website and extracts content from all pages.
Best for: Extracting content from multiple related pages, when you need comprehensive coverage. Not recommended for: Extracting content from a single page (use scrape); when token limits are a concern (use map + batch_scrape); when you need fast results (crawling can be slow). Warning: Crawl responses can be very large and may exceed token limits. Limit the crawl depth and number of pages, or use map + batch_scrape for better control. Common mistakes: Setting limit or maxDiscoveryDepth too high (causes token overflow) or too low (causes missing pages); using crawl for a single page (use scrape instead). Using a /* wildcard is not recommended. Prompt Example: "Get all blog posts from the first two levels of example.com/blog." Usage Example:
{
"name": "firecrawl_crawl",
"arguments": {
"url": "https://example.com/blog/*",
"maxDiscoveryDepth": 5,
"limit": 20,
"allowExternalLinks": false,
"deduplicateSimilarURLs": true,
"sitemap": "include"
}
}
Returns: Operation ID for status checking; use firecrawl_check_crawl_status to check progress. Safe Mode: Read-only crawling. Webhooks and interactive actions are disabled for security.
Frequently Asked Questions
Starts a crawl job on a website and extracts content from all pages. **Best for:** Extracting content from multiple related pages, when you need comprehensive coverage. **Not recommended for:** Extracting content from a single page (use scrape); when token limits are a concern (use map + batch_scrape); when you need fast results (crawling can be slow). **Warning:** Crawl responses can be very large and may exceed token limits. Limit the crawl depth and number of pages, or use map + batch_scrape for better control. **Common mistakes:** Setting limit or maxDiscoveryDepth too high (causes token overflow) or too low (causes missing pages); using crawl for a single page (use scrape instead). Using a /* wildcard is not recommended. **Prompt Example:** "Get all blog posts from the first two levels of example.com/blog." **Usage Example:** ```json { "name": "firecrawl_crawl", "arguments": { "url": "https://example.com/blog/*", "maxDiscoveryDepth": 5, "limit": 20, "allowExternalLinks": false, "deduplicateSimilarURLs": true, "sitemap": "include" } } ``` **Returns:** Operation ID for status checking; use firecrawl_check_crawl_status to check progress. **Safe Mode:** Read-only crawling. Webhooks and interactive actions are disabled for security.
Firecrawl Crawl costs $0.05 per call on xpay. No subscription, no minimums. Pay only for the calls you make. New accounts get $5 in free credits.
Connect the Firecrawl MCP endpoint to your client — Claude Code: claude mcp add --transport http firecrawl "https://firecrawl.mcp.xpay.sh/mcp?key=YOUR_XPAY_KEY"; Cursor/Windsurf/Cline/VS Code: same URL in mcp.json. The agent will see firecrawl_crawl as a callable tool with the input schema and run it directly. (Unified across all providers: https://mcp.xpay.sh/mcp?key=YOUR_XPAY_KEY, then xpay_run with toolPath firecrawl/firecrawl_crawl.)
Yes — that's exactly what xpay is for. You don't need a Firecrawl account or API key. Sign up at xpay.tools (Google or email), get $5 free credit, and run Firecrawl Crawl immediately. Billing flows through your xpay balance.
Firecrawl Crawl accepts 15 input parameters: excludePaths, crawlEntireDomain, includePaths, scrapeOptions, deduplicateSimilarURLs, allowExternalLinks…. See the input schema and runnable form on this page for details and to test live.