Web Scraping
Bulk Scrape
Scrape multiple URLs simultaneously
Bulk Scrape
The Bulk Scrape node enables you to scrape multiple URLs concurrently while managing resources efficiently.
Overview
This node allows you to:
- Scrape multiple URLs
- Manage concurrency
- Handle rate limiting
- Process results in batches
- Export data in bulk
Configuration
Parameter | Type | Description |
---|---|---|
URLs | Array[String] | List of URLs to scrape |
Concurrency | Number | Maximum concurrent requests |
Rate Limit | Object | Rate limiting settings |
Selectors | Object | Data extraction selectors |
Export | Object | Export configuration |