Webᵀ Crawl
- POSTCreate Web Crawl
- POSTStart / Resume Crawl
- POSTList Web Crawls
- POSTGet Crawl
- POSTDownload Crawl
- POSTGet Page (HTML, URLs, Text)
- POSTGet Page's Child URLs
- POSTSet Allowed Pages
- POSTSet Banned Pages
- POSTSet Max Pages
- POSTGet Visited Pages
- POSTGet Ignored Pages
- POSTGet Queued Pages
- POSTGet Banned Pages
- POSTGet Ignored Pages
Webᵀ Chat
Webᵀ Crawl
Set Allowed Pages
POST
/
crawl
/
set-allowed
curl --request POST \
--url https://api.webtranspose.com/v1/crawl/set-allowed \
--header 'Content-Type: application/json' \
--data '{
"crawl_id": "<string>",
"allowed_urls": []
}'
Body
application/json
Response
200
Successful operation
curl --request POST \
--url https://api.webtranspose.com/v1/crawl/set-allowed \
--header 'Content-Type: application/json' \
--data '{
"crawl_id": "<string>",
"allowed_urls": []
}'