Playwright is a Node.js library that allows automation of web browsers for web scraping. It was developed by Microsoft and supports multiple browsers, including Chromium. Keep in mind that when scraping websites, you should always review and comply with the website's terms of service and policies to ensure ethical and legal use of the data.
- (Optional) Connect Text Splitter.
- Input desired URL to be scraped.
Visit Web Crawl guide to allow scraping of multiple pages.
Loads URL content as Document