Webᵀ Crawl
Set Banned Pages
Webᵀ Crawl
- POSTCreate Web Crawl
- POSTStart / Resume Crawl
- POSTList Web Crawls
- POSTGet Crawl
- POSTDownload Crawl
- POSTGet Page (HTML, URLs, Text)
- POSTGet Page's Child URLs
- POSTSet Allowed Pages
- POSTSet Banned Pages
- POSTSet Max Pages
- POSTGet Visited Pages
- POSTGet Ignored Pages
- POSTGet Queued Pages
- POSTGet Banned Pages
- POSTGet Ignored Pages
Webᵀ Chat
Webᵀ Crawl
Set Banned Pages
POST
/
crawl
/
set-banned
X-API-Key
string
*
X-API-Key
Required
string
object
crawl_id
string
crawl_id
string
banned_urls
array
banned_urls
array
Body
application/json
crawl_id
string
banned_urls
string[]