Scrapegraphai API

Scrapegraphai API on xpay — AI-powered web scraping and content extraction, billed per call

Scrapegraphai API is a RESTful web scraping service that uses AI to intelligently extract structured data from any website. Instead of brittle CSS selectors or regex patterns, you describe what you want in natural language—"extract all product names and prices"—and the API returns clean, parsed JSON. It also handles JavaScript rendering, converts pages to Markdown, performs AI-powered web searches, and crawls entire sites with automatic data extraction. Developers use it when they need reliable, semantic data extraction without maintaining scraping infrastructure.

What's available

• scrapegraph_start_smartscraper — Extract content from a webpage using AI by providing a natural language prompt and a URL. Ideal for one-off data pulls from a single page.
• scrapegraph_scrape — Extract raw HTML content from web pages with JavaScript rendering support. Use this when you need the full DOM or want to parse it yourself.
• scrapegraph_start_searchscraper — Start an AI-powered web search request. Combine search and extraction in one call to find and parse results.
• scrapegraph_start_smartcrawler — Start a web crawl request with AI extraction or Markdown conversion. Crawl multiple pages and extract data from each automatically.
• scrapegraph_start_sitemap — Extract all URLs from a website sitemap automatically. Useful for mapping site structure before crawling.
• scrapegraph_start_markdownify — Convert any webpage into clean, readable Markdown format. Great for archiving or processing content for LLMs.
• Status-check tools (scrapegraph_get_smartscraper_status, scrapegraph_get_searchscraper_status, scrapegraph_get_smartcrawler_status, scrapegraph_get_sitemap_status, scrapegraph_get_markdownify_status) — Poll async jobs and retrieve results.

When Scrapegraphai API is the right tool

• You need to extract structured data (product listings, job postings, news articles) from websites that change layout frequently.
• You want to describe what you want in plain English instead of writing CSS selectors or XPath expressions.
• You're building an AI agent that needs to browse and understand web content on the fly.
• You need to convert web pages to Markdown for ingestion into LLMs or knowledge bases.
• You're performing one-off or low-volume scraping and don't want to maintain a scraping infrastructure.
• You need JavaScript rendering to handle dynamic content.

When to choose something else

• You're scraping a simple, static HTML site with a consistent structure—a lightweight regex or BeautifulSoup solution may be cheaper and faster.
• You need to scrape at massive scale (millions of pages per day)—dedicated scraping platforms or self-hosted solutions are more cost-effective.
• You're scraping a site that explicitly forbids automated access in its robots.txt or terms of service.
• You need real-time, sub-second latency—API calls introduce network overhead.
• Your data is available via a native API—use that instead.

Pricing snapshot

Quickstart

To use Scrapegraphai API via xpay in Claude Code:

claude mcp add --transport http scrapegraph "https://scrapegraph.mcp.xpay.sh/mcp?key=YOUR_XPAY_KEY"

Replace YOUR_XPAY_KEY with your xpay API key (get one free at https://xpay.tools after signup). Once connected, your Claude Code agent will have access to all Scrapegraphai API tools by their native names—just ask Claude to "use scrapegraph_start_smartscraper to extract product names from this URL" and it will call the tool directly.

Alternatively, to access all xpay providers (including Scrapegraphai API) through a single MCP connection:

claude mcp add --transport http xpay "https://mcp.xpay.sh/mcp?key=YOUR_XPAY_KEY"

For Cursor, Windsurf, Cline, or VS Code with Copilot, add a server entry to your mcp.json configuration file with the same URL.

Why route Scrapegraphai API through xpay?

• No Scrapegraphai API signup — xpay holds the upstream credentials. You authenticate once with your xpay API key and get immediate access.
• Pay per call, no subscription — You're charged only for the calls you make. A single scrapegraph_start_sitemap call costs $0.02; a scrapegraph_start_searchscraper call costs $0.24. No monthly fees, no minimum spend.
• MCP-native integration — Scrapegraphai API tools are exposed as standard MCP tools. Claude, Cursor, and other MCP-compatible agents can discover and invoke them without custom code.
• Unified billing across providers — If you also use Tavily, Apollo, or other xpay providers, all calls bill to a single xpay account with transparent per-call pricing.
• Instant access — Start scraping within minutes. No API key management, no rate-limit negotiation with Scrapegraphai API directly.

Overview

Scrapegraphai API is a powerful choice for developers who need intelligent, AI-driven web scraping without the overhead of maintaining scraping infrastructure. By routing it through xpay, you get frictionless access, transparent per-call pricing, and seamless integration with your AI agent workflows.