Dataflow Kit Web Scraper
Render Javascript driven pages, while we internally manage Headless Chrome and proxies for you. Build a custom web scraper with our Visual point-and-click…
Developer tools#openapi#developer-tools
Fork copies the collection into your workspace, without the publisher's secrets, so you can add your own key and send requests. Star saves it to your starred APIs (Account › Marketplace) and helps others find it.
Overview
Render Javascript driven pages, while we internally manage Headless Chrome and proxies for you.
- Build a custom web scraper with our Visual point-and-click toolkit.
- Scrape the most popular Search engines result pages (SERP).
- Convert web pages to PDF and capture screenshots.
Authentication
Dataflow Kit API require you to sign up for an API key in order to use the API.
The API key can be found in the DFK Dashboard after _free registration_.
Pass a secret API Key to all API requests to the server as the api_key query parameter.
Endpoints 5
fetch
- POSTDownload web page content
/fetchUse fetch endpoint to download web pages.
serp
- POSTCollect search results from search engines
/serpTo crawl search engine result pages, you can use /serp endpoint. SERP collection service extracts a list of organic results, news, images, and more. Specify…
parse
- POSTExtract structured data from web pages
/parseDataflow kit uses CSS selectors to find HTML elements in web pages for later data extraction. Open visual point-and-click toolkit and click desired elements…
url-to-pdf
- POSTSave web page as PDF
/convert/url/pdfAutomate URL to PDF Conversion right in your application. Specify request parameters like URL, Proxy, and actions to render web pages to PDF using Headless…
url-to-screenshot
- POSTCapture web page Screenshots.
/convert/url/screenshotAutomate URL to Screenshot Conversion right in your application. Specify request parameters like URL, Proxy, and actions to convert web pages to screenshots…
API details
- Base URL
https://api.dataflowkit.com/v1- Authentication
- An API key in the api_key query parameter
- Operations
- 5 operations on 5 pathsPOST 5
- Main resources
- fetch 1parse 1serp 1url-to-pdf 1url-to-screenshot 1
- Response formats
text/plain; charset=utf-8application/jsonapplication/pdfapplication/x-ndjson- Description format
- OpenAPI 3.0.0, API version
1.3 - Links
- Documentation · OpenAPI document · Terms of service · Support
- Listed from
- APIs.guru OpenAPI Directory (CC0-1.0)
Source updated
How to test the Dataflow Kit Web Scraper in Swastik Codes
- Open the APISelect “Fork & run in Swastik Codes” on this page. Sign in or create a free account if asked.
- Fork it into your workspaceChoose a workspace. You get your own copy of the Dataflow Kit Web Scraper collection, without the publisher's secrets.
- Add your credentialsThis API uses an API key in the api_key query parameter. Add yours in the collection's variables or an environment; the requests already reference it.
- Send a requestPick an endpoint, for example “Download web page content” (POST /fetch), and press Send. Check the response, add tests and run the whole collection with the runner.
Frequently asked questions
What is the Dataflow Kit Web Scraper?
Render Javascript driven pages, while we internally manage Headless Chrome and proxies for you. Build a custom web scraper with our Visual point-and-click… It is listed under Developer tools and has 5 endpoints.
Who publishes the Dataflow Kit Web Scraper?
It is listed from Dataflowkit's public API description (an OpenAPI document), not published by Dataflowkit on Swastik Codes. Anyone who controls dataflowkit.com can claim the profile by adding a DNS TXT record.
What is the base URL of the Dataflow Kit Web Scraper?
Requests go to https://api.dataflowkit.com/v1. Endpoint paths are added to this base URL.
How do I authenticate with the Dataflow Kit Web Scraper?
With an API key in the api_key query parameter.
How many endpoints does the Dataflow Kit Web Scraper have?
5 operations on 5 paths (5 POST). The largest groups are fetch, parse, serp, url-to-pdf.
Is forking the Dataflow Kit Web Scraper free?
Yes. Forking copies the collection into your workspace for free. It has been starred 0 times and forked 0 times.