Webᵀ Crawl
- POSTCreate Web Crawl
- POSTStart / Resume Crawl
- POSTList Web Crawls
- POSTGet Crawl
- POSTDownload Crawl
- POSTGet Page (HTML, URLs, Text)
- POSTGet Page's Child URLs
- POSTSet Allowed Pages
- POSTSet Banned Pages
- POSTSet Max Pages
- POSTGet Visited Pages
- POSTGet Ignored Pages
- POSTGet Queued Pages
- POSTGet Banned Pages
- POSTGet Ignored Pages
Webᵀ Chat
Webᵀ AI Scraper
Scrape with AI Scraper
Endpoint to execute a specific scraper.
POST
/
scraper
/
scrape
curl --request POST \
--url https://api.webtranspose.com/v1/scraper/scrape \
--header 'Content-Type: application/json' \
--data '{
"scraper_id": "<string>",
"url": "<string>",
"html": "<string>",
"cache": true,
"proxy": "<string>",
"render_js": true
}'
Body
application/json
Response
200
Scraper executed successfully.
curl --request POST \
--url https://api.webtranspose.com/v1/scraper/scrape \
--header 'Content-Type: application/json' \
--data '{
"scraper_id": "<string>",
"url": "<string>",
"html": "<string>",
"cache": true,
"proxy": "<string>",
"render_js": true
}'