Web Transpose home page
Search...
Dashboard
Support
Dashboard
Search
Navigation
Webᵀ Crawl
Set Allowed Pages
Documentation
API Reference
Web Transpose Website
Webᵀ AI Scraper
POST
Create AI Web Scraper
POST
Scrape with AI Scraper
POST
List AI Web Scrapers
Webᵀ Crawl
POST
Create Web Crawl
POST
Start / Resume Crawl
POST
List Web Crawls
POST
Get Crawl
POST
Download Crawl
POST
Get Page (HTML, URLs, Text)
POST
Get Page's Child URLs
POST
Set Allowed Pages
POST
Set Banned Pages
POST
Set Max Pages
POST
Get Visited Pages
POST
Get Ignored Pages
POST
Get Queued Pages
POST
Get Banned Pages
POST
Get Ignored Pages
Webᵀ Chat
POST
Create Chat
POST
Get Chat
POST
Query Chat Database
POST
Add Websites to Chat
POST
Delete Website from Chat
Webᵀ Search
POST
Web Search SERP API
POST
Web Search + AI Filtering
Webᵀ Crawl
Set Allowed Pages
POST
/
crawl
/
set-allowed
Send
Authorization
X-API-Key
string
*
X-API-Key
Required
string
Body
object
crawl_id
string
crawl_id
string
allowed_urls
array
allowed_urls
array
Body
application/json
crawl_id
string
allowed_urls
string[]
Get Page's Child URLs
Set Banned Pages
