WebScraping.AI

WebScraping.AI

A client for https://webscraping.ai API. It provides a web scaping automation API with Chrome JS rendering, rotating proxies and builtin HTML parsing.

Developer tools#openapi#developer-tools

Fork copies the collection into your workspace, without the publisher's secrets, so you can add your own key and send requests. Star saves it to your starred APIs (Account › Marketplace) and helps others find it.

Overview

A client for https://webscraping.ai API. It provides a web scaping automation API with Chrome JS rendering, rotating proxies and builtin HTML parsing.

Endpoints 4

HTML

  • GETPage HTML by URL/html?url=https://example.com&headers={"Cookie":"session=some_id"}&timeout=10000&js=true&js_timeout=2000&proxy=datacenter&country=us&device=desktop&error_on_404=false&error_on_redirect=falseReturns just HTML on success, JSON on error

Selected HTML

  • GETHTML of a selected page area by URL and CSS selector/selected?selector=h1&url=https://example.com&headers={"Cookie":"session=some_id"}&timeout=10000&js=true&js_timeout=2000&proxy=datacenter&country=us&device=desktop&error_on_404=false&error_on_redirect=falseReturns just HTML on success, JSON on error
  • GETHTML of multiple page areas by URL and CSS selectors/selected-multiple?selectors=h1&url=https://example.com&headers={"Cookie":"session=some_id"}&timeout=10000&js=true&js_timeout=2000&proxy=datacenter&country=us&device=desktop&error_on_404=false&error_on_redirect=falseAlways returns JSON

Account

  • GETInformation about your account calls quota/accountAlways returns JSON

API details

Base URL
https://api.webscraping.ai
Authentication
An API key in the api_key query parameter
Operations
4 operations on 4 pathsGET 4
Main resources
Selected HTML 2Account 1HTML 1
Response formats
application/json text/html
Description format
OpenAPI 3.0.2, API version 2.0.7
Listed from
APIs.guru OpenAPI Directory (CC0-1.0)
Source updated

How to test the WebScraping.AI in Swastik Codes

  1. Open the APISelect “Fork & run in Swastik Codes” on this page. Sign in or create a free account if asked.
  2. Fork it into your workspaceChoose a workspace. You get your own copy of the WebScraping.AI collection, without the publisher's secrets.
  3. Add your credentialsThis API uses an API key in the api_key query parameter. Add yours in the collection's variables or an environment; the requests already reference it.
  4. Send a requestPick an endpoint, for example “Page HTML by URL” (GET /html?url=https://example.com&headers={"Cookie":"session=some_id"}&timeout=10000&js=true&js_timeout=2000&proxy=datacenter&country=us&device=desktop&error_on_404=false&error_on_redirect=false), and press Send. Check the response, add tests and run the whole collection with the runner.

Frequently asked questions

What is the WebScraping.AI?

A client for https://webscraping.ai API. It provides a web scaping automation API with Chrome JS rendering, rotating proxies and builtin HTML parsing. It is listed under Developer tools and has 4 endpoints.

Who publishes the WebScraping.AI?

It is listed from WebScraping.AI's public API description (an OpenAPI document), not published by WebScraping.AI on Swastik Codes. Anyone who controls webscraping.ai can claim the profile by adding a DNS TXT record.

What is the base URL of the WebScraping.AI?

Requests go to https://api.webscraping.ai. Endpoint paths are added to this base URL.

How do I authenticate with the WebScraping.AI?

With an API key in the api_key query parameter.

How many endpoints does the WebScraping.AI have?

4 operations on 4 paths (4 GET). The largest groups are Selected HTML, Account, HTML.

Is forking the WebScraping.AI free?

Yes. Forking copies the collection into your workspace for free. It has been starred 0 times and forked 0 times.

Suggest an API

Tell us which public API is missing. We check it, then add it here with its endpoints when it has an OpenAPI (Swagger) description.