anywhichway
BBuildShip
•Created by anywhichway on 7/15/2024 in #❓・buildship-help
chat support
How do I manage My Library of custom nodes, e.g. delete, update. I can't find anything in the docs.
11 replies
BBuildShip
•Created by anywhichway on 7/7/2024 in #❓・buildship-help
inference speed on Groq using Llama 3 70B through Buildship
The inference speed on Groq using Llama 3 70B through Buildship seems to vary dramatically. At times I get 9 and 10 second delays that I do not get when interacting with Groq directly. It has the feel of cold starting somewhere, but I am on the Pro plan where pricing page says no cold starts. This may be true of other inference engines, I do not know.
2 replies