webclaw API
Web extraction API for AI agents. Scrape, crawl, search, map, batch, extract, summarize, diff, research, and inspect brand signals from public web pages.
Fork copies the collection into your workspace, without the publisher's secrets, so you can add your own key and send requests. Star saves it to your starred APIs (Account › Marketplace) and helps others find it.
Overview
Web extraction API for AI agents. Scrape, crawl, search, map, batch, extract, summarize, diff, research, and inspect brand signals from public web pages.
Endpoints 25
- POSTExtract content from a single URL.
/v1/scrape - POSTStart an asynchronous crawl job from a seed URL.
/v1/crawl - GETGet crawl job status and results.
/v1/crawl/:id - GETList crawl pages with server-side pagination.
/v1/crawl/:id/pages - POSTDiscover URLs from robots.txt and sitemap.xml.
/v1/map - POSTExtract content from multiple URLs in one request.
/v1/batch - POSTSearch the web and optionally scrape result pages.
/v1/search - POSTExtract structured JSON from a URL using a schema or prompt.
/v1/extract - POSTGenerate a page summary.
/v1/summarize - POSTExtract brand signals such as colors, fonts, logos, and social preview data.
/v1/brand - POSTCompare current page content against a prior snapshot.
/v1/diff - POSTStart a multi-source research job.
/v1/research - GETGet research job status and result.
/v1/research/:id - GETList X monitors for the authenticated user.
/v1/x/monitors - POSTCreate an X (Twitter) monitor that polls a profile, search, list, or replies and fires a webhook on new matches.
/v1/x/monitors - GETGet one X monitor.
/v1/x/monitors/:id - DELETEDelete an X monitor.
/v1/x/monitors/:id - PATCHUpdate an X monitor. Only provided fields are changed.
/v1/x/monitors/:id - POSTTrigger an immediate check of an X monitor in the background.
/v1/x/monitors/:id/check - POSTFirecrawl-compatible scrape endpoint; consult compatibility docs for supported options.
/v2/scrape - POSTFirecrawl-compatible crawl start endpoint.
/v2/crawl - GETFirecrawl-compatible crawl status endpoint.
/v2/crawl/:id - DELETECancel a Firecrawl-compatible crawl job.
/v2/crawl/:id - POSTFirecrawl-compatible sitemap URL discovery.
/v2/map - POSTFirecrawl-compatible web search endpoint.
/v2/search
API details
- Base URL
https://api.webclaw.io- Authentication
- A bearer token in the Authorization header
- Operations
- 25 operations on 21 pathsPOST 16GET 6DELETE 2PATCH 1
- Response formats
application/json- Description format
- OpenAPI 3.1.0, API version
1.0.0 - Links
- Documentation · OpenAPI document
- Listed from
- Webclaw's published OpenAPI description
How to test the webclaw API in Swastik Codes
- Open the APISelect “Fork & run in Swastik Codes” on this page. Sign in or create a free account if asked.
- Fork it into your workspaceChoose a workspace. You get your own copy of the webclaw API collection, without the publisher's secrets.
- Add your credentialsThis API uses A bearer token in the Authorization header. Add yours in the collection's variables or an environment; the requests already reference it.
- Send a requestPick an endpoint, for example “Extract content from a single URL.” (POST /v1/scrape), and press Send. Check the response, add tests and run the whole collection with the runner.
Frequently asked questions
What is the webclaw API?
Web extraction API for AI agents. Scrape, crawl, search, map, batch, extract, summarize, diff, research, and inspect brand signals from public web pages. It is listed under Developer tools and has 25 endpoints.
Who publishes the webclaw API?
It is listed from webclaw's public API description (an OpenAPI document), not published by webclaw on Swastik Codes. Anyone who controls webclaw.io can claim the profile by adding a DNS TXT record.
What is the base URL of the webclaw API?
Requests go to https://api.webclaw.io. Endpoint paths are added to this base URL.
How do I authenticate with the webclaw API?
With A bearer token in the Authorization header.
How many endpoints does the webclaw API have?
25 operations on 21 paths (16 POST, 6 GET, 2 DELETE, 1 PATCH).
Is forking the webclaw API free?
Yes. Forking copies the collection into your workspace for free. It has been starred 0 times and forked 0 times.