Bulk GPT - test stops
Hello,
I watched the demo of Bulk GPT (https://www.youtube.com/watch?v=0-fACNxxf9Y&t=219s), where I can ask ChatGPT to do a task on each line of a csv file. The video says that it works great up to a few hundred lines, but it struggles with larger input files. When I run "test" on a big file (4000 rows), the "test" blue button reappears after a while (there is no error message), as if it stopped running, but the node "GPT text generator" seems to still be running.
-Is the test still running?
-If not, is it because my input text is too big?
-How can I do to work on larger files?
Thank you!
BuildShip
YouTube
Bulk GPT - Run OpenAI API on a CSV file in parallel for every row
Learn how to run openAI in parallel on every line of a CSV file in bulk
Get started for free here 👉 https://buildship.com
A Low-code Visual Backend Builder with AI
Automate Bulk GPT Content Generation with BuildShop
00:00 Introduction to Bulk Content Generation with GPT
00:32 Getting Started with BuildShip for API Creation
01:30 Building the...
Solution:
Jump to solution
HI @M. Berthet, you can buy resources as addons within your app under projects settings.
11 Replies
For handling large input files in BuildShip, here are some considerations and potential solutions:
1. Is the test still running?
- If the "test" blue button reappears after a while without any error message, it is likely that the test has stopped running. The "GPT text generator" node may appear to be running due to the large input size, but the workflow might have timed out or encountered an issue.
2. Is it because my input text is too big?
- Yes, handling large files with thousands of rows can be challenging for the system, especially when using nodes that require significant processing, such as the "GPT text generator". The system might be timing out or running into memory limitations.
3. How can I work on larger files?
- Batch Processing: Split the large CSV file into smaller batches and process each batch separately. This can help in reducing the load and avoiding timeouts.
- Optimize Node Configuration: Ensure that the nodes are configured optimally to handle large datasets. Check for any settings that might limit the processing capacity.
- Increase Resources: If possible, increase the computational resources allocated to your workflow to handle larger datasets more efficiently.
- Asynchronous Processing: Consider using asynchronous processing where the task is divided into smaller chunks and processed independently.
For more detailed guidance, I recommend submitting your query via the in-app support button in BuildShip, where the support team can provide more specific advice based on your workflow configuration.
For more information on the GPT text generator node and other related nodes, you can refer to the BuildShip documentation:
- Generate EPUB Node
- WhatsApp Bot
Generate EPUB Node 📖 – BuildShip
A unified resource to start building your backend with low-code. Dive into triggers, nodes, and step-by-step guidance to jumpstart your workflow creation.
WhatsApp Bot – BuildShip
The WhatsApp Bot is a powerful trigger that allows you to connect and create a WhatsApp Bot using using WhatsApp Business Account by Meta.
How do I increase resources?
To increase resources in BuildShip, please submit your request via the in-app support button. The support team will assist you with upgrading your plan or allocating additional resources based on your requirements.
Solution
HI @M. Berthet, you can buy resources as addons within your app under projects settings.
@M. Berthet, plus we have a Bulk GPT++ template coming soon that will be able to process larger datasets by running a scheduled workflow. Stay tuned 🙂
Thank you for this! Do you know the timeline, approximately? 🙂
For information regarding timelines or specific updates, please submit your query via the in-app support button.
If I increase resources by paying, can I really make this specific workflow run on thousands of rows, or do I need to wait for a new version of the bulk GPT? @Luis
You can buy resources as add-ons within your app under project settings. For more details, please refer to the BuildShip documentation. If you have specific requirements or encounter any issues, please submit your query via the in-app support button.
Hi @M. Berthet, I'll keep you posted once I release this template. After you give it a try then you can decide what is the best option for you. But I believe the new workflow should work well enough.
Amazing, thank you so much!