opaidios
BRBuildShip + Rowy
•Created by opaidios on 1/26/2024 in #❓・buildship-help
Puppeteer
I've also tried the web scraping nodes, but they don't return the html of the page regardless of selector
3 replies
BRBuildShip + Rowy
•Created by opaidios on 1/26/2024 in #❓・buildship-help
Puppeteer
maybe there's a better way to do it, I'm not a developer so idk if this is efficient, but it works
3 replies
BRBuildShip + Rowy
•Created by opaidios on 1/25/2024 in #❓・buildship-help
Nearby Places not working
Thank you Gaurav.
Another question, I am running the crawler on a list of urls, is there a way to see a live log of it's activity?
4 replies
BRBuildShip + Rowy
•Created by thisisbuze on 1/25/2024 in #❓・buildship-help
Anyone successfully create a node with AI? Tips?
I will also add that I use GPT to edit the node logic when I don't get what I need from the AI, that also works
6 replies
BRBuildShip + Rowy
•Created by thisisbuze on 1/25/2024 in #❓・buildship-help
Anyone successfully create a node with AI? Tips?
I have some that parse data, I've had it build a webhook, and a few other things that worked. Maybe 20% success rate.
6 replies
BRBuildShip + Rowy
•Created by thisisbuze on 1/25/2024 in #❓・buildship-help
Anyone successfully create a node with AI? Tips?
yes, but you have to be really specific about what you ask, even include desired output code
6 replies
BRBuildShip + Rowy
•Created by opaidios on 1/25/2024 in #❓・buildship-help
Nearby Places not working
it's working now, this has happened a few times. Starting to think there's a bug somewhere. I wish I could offer more insight, workflow is called 'brixy'
4 replies
BRBuildShip + Rowy
•Created by opaidios on 1/23/2024 in #❓・buildship-help
Buildship Scraping Help
I sent the data to a replit script to return a list of urls instead with the place_id, I will try crawler again with new data
9 replies
BRBuildShip + Rowy
•Created by opaidios on 1/23/2024 in #❓・buildship-help
Buildship Scraping Help
here's the catch;
the base url is "https://www.google.com/maps/search/?api=1&query=gym&query_place_id="
& the data that I've extracted so far looks like this
[
{
"lat": 6.2476376,
"lng": -75.56581530000001,
"place_id": "ChIJBa0PuN8oRI4RVju1x_x8E0I"
},
{
"lat": 6.2073151,
"lng": -75.57068579999999,
"place_id": "ChIJA-ZKeCooRI4RsT_eKlHovT8"
},
{
"lat": 6.211902599999998,
"lng": -75.5652279,
"place_id": "ChIJOx9p1igoRI4RzNB2nThQF0M"
}]
I need to add the place_id to the end of the url and extract the data that way
9 replies
BRBuildShip + Rowy
•Created by opaidios on 1/23/2024 in #❓・buildship-help
Buildship Scraping Help
I had the AI write a node to send data via webhook to Make.com, hopefully there is a workaround. I tried running crawler in parallel, but it can't select URL extension from a list of items.
9 replies
BRBuildShip + Rowy
•Created by opaidios on 1/23/2024 in #❓・buildship-help
Buildship Scraping Help
thank you guys for looking into this
9 replies
BRBuildShip + Rowy
•Created by opaidios on 1/23/2024 in #❓・buildship-help
Buildship Scraping Help
@Deepanshu I haven't actually used a node, but the one I've attempted was 'crawler'. I will try other things today.
9 replies