Octocrawl
Web pages as Markdown or JSON with an Evidence Record: final URL, HTTP status, robots.txt, hashes
Fork copies the collection into your workspace, without the publisher's secrets, so you can add your own key and send requests. Star saves it to your starred APIs (Account › Marketplace) and helps others find it.
Overview
Web pages as Markdown or JSON with an Evidence Record: final URL, HTTP status, robots.txt, hashes
Endpoints 0
The endpoints of this API are not described here yet. If you know where its OpenAPI (Swagger) description is published, and we will add them.
API details
- Authentication
- None needed
- CORS
- Not allowed: call it from a server
- Links
- Documentation
- Listed from
- public-apis list (MIT)
Frequently asked questions
What is the Octocrawl?
Web pages as Markdown or JSON with an Evidence Record: final URL, HTTP status, robots.txt, hashes It is listed under Developer tools and has 0 endpoints.
Who publishes the Octocrawl?
It is listed from Octocrawl's public API description (an OpenAPI document), not published by Octocrawl on Swastik Codes. Anyone who controls octocrawl.dev can claim the profile by adding a DNS TXT record.
Does the Octocrawl need an API key?
The public-apis list marks it as needing no authentication.
Is forking the Octocrawl free?
Yes. Forking copies the collection into your workspace for free. It has been starred 0 times and forked 0 times.