Crawl a website locally using Webᵀ Lite’s built-in crawler.
pip install webtranspose[lite]
Crawl
will create a unique crawl.crawl_id
that can be used in the future to get the crawl again.
["https://webtranspose/*"]
["https://webtranspose/blogs/*"]