Create an AI Web Scraper that works on any website in one line of code.

import webtranpose as webt

schema = {
  "Merchant Name": "string",
  "Title of Product": "string",
  "Product Photo URL": "string",
}

scraper = webt.Scraper(
  schema, 
  render_js=True, 
  api_key="YOUR_WEBTRANSPOSE_API_KEY", # optional, if you want to run on cloud
)

​
Scraper Parameters

schema
dict
required

The schema for the data to be scraped.

scraper_id
str

The ID of the scraper. (Optional)

name
str

The name of the scraper. (Optional)

render_js
bool
default: false

Render Javascript on the website.

verbose
bool
default: false

Extra logging to help debugging.

api_key
str

Web Transpose API Key. (Optional)

​
Get your AI Web Scraper

When you create a Web Scraper, a scraper ID is generated.

scraper.scraper_id

You can use this scraper ID to get your AI Web Scraper.

scraper = webt.get_scraper(scraper_id)
Crawl with Webᵀ LiteScrape a Website