Update a Web Crawl
Ensure you have set your Web Transpose API Key.
crawl.set_max_pages(1000)
allowed_urls = [ "https://www.webtranspose.com/blog/*", "https://www.webtranspose.com/pricing/*", ] crawl.set_allowed_urls(allowed_urls)
banned_urls = [ "https://www.webtranspose.com/crawl/*", "*webtranspose*", ] crawl.set_banned_pages(banned_urls)
