Should you use the Azure OpenAI Assistants API?
Vložit
- čas přidán 6. 09. 2024
- There"s a new Azure OpenAI API in town: the assistants API. Should you ditch the existing API that's used in nearly all LLM apps when this new API is out? Watch to find out...
Demo starts here - • Should you use the Azu...
Repo: github.com/gba...
#azure #openai #assistant
It's fantastic to see you back on CZcams after a long time. Please continue sharing, and I truly appreciate your blog and videos.
Thanks for the kind words. More to come soon I hope…
Underrated by CZcams :) Thank you
clearly and simply explained A+ 🎉
Great video. Have a question. Even if I use completions or assistant api. The tokens for ALL the conversation Will be billed?
Yes, every input and output token is billed depending on the model chosen. That's the same for both APIs.
Great video - very helpful! I'm intrigued to know if the CLU (conversational language understanding) fits into the assistant model, I can't piece together in my head how this could be utilized when looking at the playground UI.. I guess it's probably something you'd need to code for (fire the prompt to CLU to extract intent, then pass to assistants completion API?) appreciate your thoughts :)
I have a question i want to preprocess the text data and i have certain defined rules it should take care so should i use normal chat completion or assistant for that
It's best to use the chat completions API for that. In addition, if you want to extract structured data from text, I can recommend using the completions API with the Python instructor library.
Apart from file_ids could we get data from other data source like SQL Server, BQ.... to assistants? Please could you do code video on it.
The only way to do that is via function calling and custom code that gets the data from SQL etc.. and feeds it to the assistant. There's no built-in support for that just yet.
are you available on fiverr for custom work?
no, sadly not... 🙂