Crawlbase

Actions8

• Crawl url

  Fetch a public HTTP or HTTPS URL through Crawlbase using the connected Normal token and return its content with separate target and Crawlbase statuses.

• Delete stored pages

  Irreversibly delete explicitly selected pages from Crawlbase Cloud Storage by request ID and return each page's deletion outcome.

• Generate user agents

  Generate one to ten realistic randomized User-Agent strings for a selected device class.

• Get crawling usage

  Return current Crawling API usage and optionally previous-month statistics for the connected Crawlbase account.

• Get storage count

  Return the number of pages currently held in Crawlbase Cloud Storage.

• Get stored page

  Retrieve the latest Crawlbase Cloud Storage page by exactly one request ID or original URL.

• Get stored pages

  Retrieve up to 100 Crawlbase Cloud Storage pages by request ID without deleting them.

• List stored page ids

  Return one page of Crawlbase Cloud Storage request IDs and a short-lived continuation cursor.