Scrape (Dynamic)
Is there a limit on the use of this node?
I know it works because I have had positive results, but immediately after it works it then suddenly doesn't, for about 10 minutes all I get is a navigation timeout message, until miraculously it works again.
5 Replies
AI Support Bot Information
<@797926148549378059> you can react on the relevant answer (message) with a ✅ in this thread when you think it has been solved, by the bot or by a human!
Anyone can react on this message with a ❌ if the GPT bot is unhelpful or hallucinating answers.
Please note: Team members will review and answer the questions on best efforts basis.
Hi @Chris Wright | Brandmember Navigation timeout seems a common issue in the puppeteer when the target URL you are trying to fectch isn't yet available - https://stackoverflow.com/questions/70487251/webscraping-timeouterror-navigation-timeout-of-30000-ms-exceeded. Could you share what target url you are testing on and howmuch timeout you are getting in error?
Stack Overflow
Webscraping TimeoutError: Navigation timeout of 30000 ms exceeded
I'm trying to extract some table from a company website using puppeteer.
But I don't understand why the browser open Chromium instead my default Chrome, which then lead to "TimeoutError: Navig...
Thanks @Gaurav Chadha I just tested on workflow ending 6NPu and as expected the very first test of the workflow executed in 4790ms.
Subsequent tests with the timeout set at 50000ms didn't work, I then tried 100000ms and the first time trying this the workflow executed in 2680ms
A subsequent test at 100000ms came back with - "upstream request timeout" (maybe this is too long)
Then I've tried reducing in down to 10000ms as it should manage that from what we've seen of the successful executions, but it doesn't work.
Although I feel like if I come back to it in half an hour it will probably work first time but then not again.
Oh and this is trying to target https://who.is/
WHOIS Search, Domain Name, Website, and IP Tools - Who.is
Find information on any domain name or website. Large database of whois information, DNS, domain names, name servers, IPs, and tools for searching and monitoring domain names.
I duplicated the workflow to add a wait of 5000ms between the typing and click actions with an ultimate load timeout of 50000ms but that isn't working. Thats on workflow ending Yb5c