DeliChips
DeliChips12mo ago

HI all, Im excited about this product i

HI all, Im excited about this product i must say... Im still learning but can anyone confirm using the buildship endpoint with puppeteer can also perform actions like click links, log in etc. https://puppeteer.buildship.run/v1/crawl . i see there is also a https://puppeteer.buildship.run/v1/screenshot .. where do I see all teh endpoints and info on them? .. ok i see probably not and will just use browserless api
4 Replies
Gaurav Chadha
Gaurav Chadha12mo ago
cc @Deepanshu.
Deepanshu
Deepanshu12mo ago
Hey @DeliChips , we are working on a node and will be made available soon. The node will allow you to provide the steps (list of objects containing a puppeteer action and related parameters), you will be able to use any of the methods from puppeteer-page-method as action. You can search Scrape Web URL (Dynamic) in utility nodes inside buildship and give it a try (docs: https://docs.buildship.com/utility-nodes/scrape-web-url). But, if you need something even more advanced, you can use something like browserless.
DeliChips
DeliChipsOP12mo ago
I see and thanks for the update here. Im making progress and getting successfull executions of the node but not able to do a simple login - in the output i see "Warning! JavaScript must be enabled for proper operation of the Backend." ... the browser accessing the url looks OK though " 318365 172.0.126.17 - - [22/Dec/2023:13:41:05 +0000] "GET /administrator HTTP/1.1" 200 2061 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/118.0.0.0 Safari/537.36"" .. and even with JS off, that log in page can still login. I will tinker with this some more and if anything go to browserless worst case. Thank you again.
Deepanshu
Deepanshu12mo ago
Did you use try using setJavaScriptEnabled action provided in puppeteer-page-method ?