Multi Link Scraping
Trying to find way of scraping multiple links at once but keep getting error when using a loop and scraper inside. (connect ECONNREFUSED)
Cheers
H
Solution:
Jump to solution
Pass the URL as an array from the request body and in the URL pass the item of loop. It will work then.
3 Replies
Solution
Pass the URL as an array from the request body and in the URL pass the item of loop. It will work then.
Is there a way to make it faster as I ran as test with 9 links and it took a long time. Is there a way where I use ai to scrape the website and only return the Info I am looking for. This will vary depending on website.
No cold start could help here. Which will reduce the execution time, available from pro plans.
Currently scraping is supported via puppeteer, AI is not requred here, although you can filter the content using AI (creating custom node) based on the response.