AdaA
BuildShip13mo ago
Ada

How to get the openai total token usage from the same node that's streaming the message?

I'm using the OpenAI Assistant node and have modified the code a bit to do message streaming. In the return node, I've set it to return streamed messages.
I was wondering if there's a way to get the total token usage from each streamed message. And if I can have two return nodes, one to output the streaming messages, and the other for token usage?
Was this page helpful?