Skip to main content

Bulk Scrape

The Bulk Scrape node enables you to scrape multiple URLs concurrently while managing resources efficiently.

Overview

This node allows you to:
  • Scrape multiple URLs
  • Manage concurrency
  • Handle rate limiting
  • Process results in batches
  • Export data in bulk

Configuration

Example Usage

Basic Bulk Scrape

Advanced Configuration

Queue Management

Error Handling

Retry Configuration

Export Formats

JSON Export

CSV Export

Progress Tracking

Resource Management