Chat with your database - Assistant V2 - 'V' : 'Output too large'
I'm using the OpenAI assistant node like in the 'chat with your database' template where it queries a menu dataset. In my case the dataset is a restapi call. It kind of works. However, when I feed it too many rows it will just return 'input too large - output too large' in the logs and it will generate a random response for the assistant. I'm testing with 'how many rows are there in my dataset'.. When it is able to work through all data it will say like for example 50 which is correct. But when the set has like 100 rows it logs 'output too large' and will return that it contains for example 173 rows. So it's just making up a number. Is there a way to pull in the info from the rest api call, save it in storage as like a csv and feed it as an attachment to the assistant? Not sure since I haven't played around with it that much yet but might this be possible?
Solution
For the second question to save the data from REST API request and sue it as feed to Assistant, you can create a workflow like this to achieve the usecase.
message.txt8.14KB
