Scrape Content from Links
The Scrape Content from Links node allows you to extract content from a list of links and follow them recursively if needed.Overview
This node enables you to:- Extract content from links
- Follow nested links
- Set crawl depth
- Filter content
- Handle pagination
Configuration
Example Usage
Basic Link Scraping
Advanced Configuration
Link Following Rules
Pattern Matching
Content Extraction
Nested Content
Data Processing
Content Transformations
Error Handling
Common issues and solutions:- Broken links
- Invalid content structure
- Rate limiting
- Depth limits
- Circular references