Updated OpenAI Assistant (Stream Response) doesn't seem to be consumed correctly anymore.
Hey everyone, I'm trying to (re)create a workflow I've built before.
Simple REST API call to OpenAI Assistant (Stream Response) to return stream response.
Somehow I don't get the stream anymore. All I get returned is the null signal for the end of the stream.
I've added listeners in the node code, so I can confirm that the node is calling and receiving correctly, it just doesn't "return the content".
Any ideas on what the problem might be?
Anyone else with this issue with the standard template node?
7 Replies
Processing...
🤖 Deciphering the code matrix. 🧬 this might take a couple of minutes... beep boop
Sorry, there was an error processing your request. Please try again in ~1 minute
I'm trying to (re)create a workflow I've built before.
Simple REST API call to OpenAI Assistant (Stream Response) to return stream response.
Somehow I don't get the stream anymore. All I get returned is the null signal for the end of the stream.
I've added listeners in the node code, so I can confirm that the node is calling and receiving correctly, it just doesn't "return the content".
Any ideas on what the problem might be?
Anyone else with this issue with the standard template node?
AI Support Bot Information
<@778867538947080222> you can react on the relevant answer (message) with a ✅ in this thread when you think it has been solved, by the bot or by a human!
Anyone can react on this message with a ❌ if the GPT bot is unhelpful or hallucinating answers.
Please note: Team members will review and answer the questions on best efforts basis.
AI Response
It seems you're experiencing an issue with the OpenAI Assistant Stream Response in your workflow. You can start by reviewing a similar template called Streaming AI Chatbot, which uses the OpenAI Assistant to generate stream responses to prompts. This template might help you identify any discrepancies or issues with your current setup.
However, if the problem continues and you're sure that the listeners in the node code are correctly set up to receive incoming data, consider the following suggestions:
1. Verify that the API key used in the node is correctly set up and valid.
2. Ensure the correct stream endpoints and parameters are used in the API call.
3. Check if any BuildShip updates or changes might have influenced the node's functionality.
If these steps do not resolve the issue, it may be beneficial to contact BuildShip support or revisit the documentation for potential fixes.
BuildShip AI Support
I believe I've got it!
In the new template workflow, the output node has an empty cache time, but when I set it to 0 it starts consuming and relaying the streaming text chunks!
Yes, I had the same problem and solution just yesterday @projectfuze