Create an AI Web Scraper that works on any website in one line of code.

import webtranpose as webt

schema = {
  "Merchant Name": "string",
  "Title of Product": "string",
  "Product Photo URL": "string",
}

scraper = webt.Scraper(
  schema, 
  render_js=True, 
  api_key="YOUR_WEBTRANSPOSE_API_KEY", # optional, if you want to run on cloud
)

​
Scraper Parameters

​
schema
dict
required

The schema for the data to be scraped.

​
scraper_id
str

The ID of the scraper. (Optional)

​
name
str

The name of the scraper. (Optional)

​
render_js
bool
default:
false

Render Javascript on the website.

​
verbose
bool
default:
false

Extra logging to help debugging.

​
api_key
str

Web Transpose API Key. (Optional)

​
Get your AI Web Scraper

When you create a Web Scraper, a scraper ID is generated.

scraper.scraper_id

You can use this scraper ID to get your AI Web Scraper.

scraper = webt.get_scraper(scraper_id)
Crawl with Webᵀ LiteScrape a Website