Create an AI Web Scraper that works on any website in one line of code.
import webtranpose as webt

schema = {
  "Merchant Name": "string",
  "Title of Product": "string",
  "Product Photo URL": "string",
}

scraper = webt.Scraper(
  schema, 
  render_js=True, 
  api_key="YOUR_WEBTRANSPOSE_API_KEY", # optional, if you want to run on cloud
)

Scraper Parameters

schema
dict
required
The schema for the data to be scraped.
scraper_id
str
The ID of the scraper. (Optional)
name
str
The name of the scraper. (Optional)
render_js
bool
default:false
Render Javascript on the website.
verbose
bool
default:false
Extra logging to help debugging.
api_key
str
Web Transpose API Key. (Optional)

Get your AI Web Scraper

When you create a Web Scraper, a scraper ID is generated.
scraper.scraper_id
You can use this scraper ID to get your AI Web Scraper.
scraper = webt.get_scraper(scraper_id)