Skip to main content

Scrape Content from Links

The Scrape Content from Links node allows you to extract content from a list of links and follow them recursively if needed.

Overview

This node enables you to:
  • Extract content from links
  • Follow nested links
  • Set crawl depth
  • Filter content
  • Handle pagination

Configuration

Example Usage

Advanced Configuration

Pattern Matching

Content Extraction

Nested Content

Data Processing

Content Transformations

Error Handling

Common issues and solutions:
  • Broken links
  • Invalid content structure
  • Rate limiting
  • Depth limits
  • Circular references