The Complete Guide to Building AI Agents for Beginners
Vložit
- čas přidán 6. 06. 2024
- 🚀 Dive into the future of AI with our beginner's guide to AI Agent Development 🤖💡 - your first step to mastering automation and innovation in 2024! 🌟
🤖Agents-as-a-Service:
👉 agents.vrsen.ai/
🧪Agency Swarm Lab (Repo from Video):
github.com/VRSEN/agency-swarm...
🐙 Agency Swarm:
github.com/VRSEN/agency-swarm
🔋 OAI-Widget (My tool):
www.oai-widget.com/
🚀 Custom AI Solutions:
www.vrsen.ai/
🤝 Need help with your next AI project?
calendly.com/vrsen/ai-project...
🐦 Twitter:
/ __vrsen__
💬 Discord:
/ discord
02:21 - Who is an AI Agent Developer?
04:01 - What are AI Agents?
07:17 - Multi Agent Frameworks
08:59 - Agents-as-a-Service
09:28 - Available Frameworks
13:17 - Why Assistants API?
14:24 - Agency Swarm Tutorial
14:31 - Agents
15:58 - Tools
18:01 - Agencies
19:54 - Building AI SmmA Live
26:18 - Testing Our Agency
27:22 - Roadmap
About: Unlock the potential of AI agent development with the 'AI Agent Development - Complete Course For Beginners 2024'. This comprehensive video course demystifies AI agents, offering insights into their evolution, and explores the most popular frameworks. Led by an experienced AI development agency owner, learn how to leverage powerful AI agent frameworks, including a deep dive into the creator's own, and build a Social Media Marketing Agency utilizing DALL-E 3 for content creation. Perfect for beginners and seasoned developers alike, this course is your gateway to mastering AI agent development and integrating AI into business processes for automation and efficiency. Join now to future-proof your skills in this rapidly evolving field. - Věda a technologie
3:48 “The primary skills required for an Al agent developer role can significantly vary from project to project. This topic deserves its own separate video by itself.” Yes it does 👍
Got it!
+1
+2
Found this channel very late I guess. As a commerce student I'm eager to hop into this journey. Can you pls breakdown on how to get to this role with the specific tools, packages and frameworks to learn ? Thanks a ton
It also means that technical skills, while essential, will need to be paired with a vast life experience if one wants to become a top performer as an AI Agent Developer.
The best overview I have seen yet. Very helpful. Thank you!
I developed software that has increased the data maintenance process in our shop by around 5000%. Almost everything except quality control is automated. Whereas in the past we needed 2 months to manually set up 1000 items in the shop, for example, we now need maybe 3 days and there is still potential to speed it up even more. I implemented all of this in around 7 months with the help of gpt4 and without any great programming knowledge. There were a few moments when I thought I couldn't do it because the project was already very complex, but I fought through it. I definitely wouldn't have managed it without AI. However, I must also say that I have a bit of experience in development and therefore know which questions I need to ask and have an idea of the goal.
What's Ur email let's talk business
It's great that your company is developing it, how did you do this using GPT-4?
Yep. The insights and value are knowing what questions to ask. Tech does replace humanity, it supplements and compliments it...nice work by you
@@PedroHenrique-cu1ur with a lot of c&p, try and error, frustration and passion, I would say. 😂 The road to the goal is paved with failures. There were a few moments where I thought I wouldn't be able to do it because I couldn't solve a problem, but so far I've always managed to make a breakthrough, even if it sometimes took weeks.
@@user-vb3eg7mt2li’m doing an ai agent project as we speak but i have zero experience with coding and development 😂😂 but im pushing through. I need my own assistant.😂😂
Love your content and all your work! Thanks for this guide! Making a video on AI Agent Developers would be awesome.
Great video, thank you, got my agency genesis up and running🎉🎉
Bro this is unbelievable this is the exact video I was looking for when tapped on the youtube app... thanks as this is greatly appreciated...🎉
As a PHP / JS developer by day, I am going to reboot my langchain course at night after watching this. - very inspiring stuff mate!
Great video, love the detailed explanation. So smart.
@5:10 this is gold. I tried explaining this to a tech lead and wish I’d had this video so they could hear it not just from me
Great video, thanks. I want to create a data analysis agent but the problem I have been facing is implementing reasoning capabilities. Essentially I want first an agent to create a plan how it should answer a user query. Then another agent that follows that orchestrate that plan by dividing the tasks to different agents when tasks are independent, and for dependent tasks, it needs to wait for other tasks that finish first and then provide the results to a new agent to finish that task. All in all, I cannot get my head around how I can implement such a system. Any tips will be highly appreciated.
Go go boss. Always growing!
i just fell in love with this channel. great vids! you just got a new sub! 😘
love your videos. I think you guys need an UI. That'll make a world of difference and put your product in the hands of a lot more people who are not just developers.
Yup, working on it
I have been working on training a custom agent for a few months now. I would love to hear anything you have to offer about the skills and techniques involved with training an AI agent. Keep up the great work!
The knowledge is crazy you earned yourself a sub
Great video, and yes, please make a video on AI Agent Developers. Thank you!
Very Nice structure and well delivered.
A sub was created.
Thank you
You are insane this is awesome work!
13:12 i think my question somewhat made it into the video 😜
love your content! came for the diligence, stayed for the passion.
i also tried a lot of ai agent frameworks (including crewai and autogen), and also came to the conclusion that i need to build my own; but i also prefer your framework over the others, keep it up!
which one did you like more between crewai and autogen ?
@@amrinderrandhawa6799i clearly prefer crewai for the very customizable workflows and the ability to not only assign one, but two separate llm's to a single agent if necessary.
for me, autogen was more of a "quick and dirty" solution to simpler tasks, but if you need a series of tasks relying on each others outcome and each task requires about 4 agents to be solved properly, you quickly end up with 20+ agents divides into 5+ crews and 5+ tasks to solve, where the quite straightforward "question - response" style of autogen just does not really do it anymore and usually gets pretty messy, as well.
@@amrinderrandhawa6799 clearly crewai; i tried autogen first (mostly because at the time i tried autogen, crewai has not been released yet), but working with autogen feels a lot like "chaos management", whereas crewai is way more focussed, more streamlined and more intuitive imo...
both work pretty smoothly if you get your setup going (for autogen, i used olllama and litellm to host multiple llms in parallel on my local devices), which also works with crewai even without the intermediate step of using litellm and both offer very similar capabilities; some of the differences are:
autogen offers way more flexibility for agent creation with the "agent class" parameter, which allows to add (to put it videogame-terminology) some sort of "passive skills" - if the ability would be the "active skills" in that regard.
- talking about agent classes, one of the most useful classes (at lest for me) would be the "open ai assistant api agent"-class, which can be used as a drop-in replacement for the openai assistant api - which might come in handy depending on your use-case
-crewai also offers something that might also come in handy, depending on your use-case: where autogen "only" offers one parameter per agent to set a base url and thus, assign your desired llm to it, crewai actually offers two, the "llm" parameter and the "function calling llm" parameter, enabling each agent to be assigned to two different base urls, if necessary.
crewai offers you to define crews and tasks, not only agents, which for me, is the dealbreaker here. as i only (!) use sequential processing without asynchronous tasks, the ability to not only create the agents, but then assign them to different crews, those different crews to tasks and those tasks to processes makes it very "applicable" to real-world use-cases by being very modular by nature. maybe i was just unlucky or i did it wrong, but when you try to make multiple agent-teams interact with each other with them relying on each others outcome, autogen never provided really decent results....
-as stated in the video, as crewai has multiple natural language prompts in the backend, the outcomes might vary depending on your prompt engineering capabilties and (mostly if you want to use crewai with open source llms and not openai) the natural language processing capabilities of the underlying model, as well.
(sorry for the wall of the huge wall of text... 😅)
@@amrinderrandhawa6799i prefer crewai over autogen mostly because it focuses more on crews and tasks, whereas autogen seems more agent-focussed (at least, right now...). maybe i just got unlucky or maybe i was doing it wrong, but bigger the agent swarm grew and the more complex the tasks got, the worse autogen performed.
hey i would like to know ,can i create this crew agent & all completely free ??most of them need some sort of Open ai API or some paid services?
Hi! Could you please share the type of the keyboard you're using ? It looks pretty solid and comfortable. Am I wrong? Cheers!
Great topic, thanks 👍
Amazing, you are right Agents is the next HR industry and there will be a lot of maintenance and cleaning to do with all the virtual rubbish we all are creating not knowing exactly what we are doing, I am interested in developing emotionally intelligent agents. I have some ideas, but most wont get it... I know it is possible because emotions are a construct, and constructs are based on conditions and conditions, once recognised can be written, and measured. I should know I am a psych.
How do we account the token counts, in production it is must!!!!
This is really cool, thanks for doing this.
Is there any possible future scope you will support open source LLMs? Shared state between agents should be possible with any database layer, be it in memory or even persisted. Being coupled to one provider is okay in some situations but can be very daunting for other applications and orgs
Agreed
3:56 definitely interested in seeing thay video!
Great work, please keep on
Nice video and amazing framework, thanks for it...
Do you know how to force a agent to iterate multiple times over a tasks?
Let's say that I want to write a full long article for a blog...
I have a agent that creates the structure for the article, let's say
1. introduction
2. what is agency swarm?
3. what is a AI agent?
4. how to set up a team of agents?
etc etc
how can I tell the agent writer to write only 1 section at time? instead of the entire article?
thank you
Wow wt* I was using autogen and other stuff, but couldn’t get it how I wanted it… I was planning to create it all by myself because maybe that’s easier then get it to work…
I saw this video, and I watch this video and see every issue I had with it is solved INSANE!! Hihi.
Love this thank you so much, for making this❤️❤️❤️
If Langchain was made after the Assistants API, would it be a breakthrough solution? I think that in general we could see something like Agency Swarm, but with a different LLM, although I understand that we can't replace Instructor, right?
Great video, thank You.
I have a bit of a noob question, I have used the genesis feature to spin up my agency, but now I am getting the "OpenAI key not set" with the message " ValueError: OpenAI API key is not set. Please set it using set_openai_key." Which file do I set this in
I think you really get it. You mentioned being critical of langchain; of which I've been looking it to. Could you offer a more detailed critique of the framework?
Hard to customize because there are too many unnecessary abstractions for features that can be implemented by yourself in 5 minutes
Curious as to what agents cost to have them built for you, as you said, one at a time?
Thanks for the content! This stuff has me blown away! So amazing!
I want to be able to adjust settings like temperature, token limit, stop sequences and frequency. This can all be done in OpenAI. Can I integrate this through to the chatbot widget? This is essential. Voiceflow has this. :)
Thank you!
the installation of Agency Swarm assumes the usage of GPT 4 instead of 3.5. How to choose GPT 3.5?
This video is super informative, Thank you. Please can you make a video on how to become an AI agent developer, Thank you
Awesome progress
What I really like about agency swarm from a conceptual standpoint is We can elevate an organizational model of how groups interact and use the framework to model how scientist and cognitive researchers think the human mind works
Imagine if we can create agents that are essentially a collection of various processes that mimic what we think happens within people. We have conscious awareness, subconscious processes, and autonomous systems. All working underneath. The consciousness of our awareness yet are happening regardless. This sort of structure and thinking of the system can easily be extrapolated and presented as an entirely different use case outside what Arsen originally planned his solution to be.
How would you link this up with a nextjs interface instead of gradio?
Great content! Does it give support to Vertex AI and Gemini?
cool thanks for the new video!
Can you build this thing for a person for their individual business needs?
I'm loving the agency_swarm framework. Really great work. Can you provide an example of using the framework with front-ends other than Gradio (with streaming)? Thanks in advance!
Dude ... the open-source models are the future ... what are you doing?
I totally disagree. In my opinion OpenAI is at least 6-18 months ahead of everyone.
I've never heard an Eastern European say "nitty-gritty", but now I'm hooked. Please say it more.
Is this currently useable with offline LLMs and if not do you intend on making it capable of doing so? I couldn't find documentation anywhere on directing your framework to a local LLM.
Local LLM is hard though. No direct documentation, but you can learn how to use model in local.
Is that Visual studio code your using there @vrsen ?
pip install worked but agency-swarm genesis gave some issues,
according to gpt
it seems like there is still an issue with the readline module, specifically related to compatibility issues with Python 3.10. The error message indicates that there is an attribute error in the py3k_compat.py file of the pyreadline package.
This issue might be due to the pyreadline package not being fully compatible with Python 3.10 yet.
Which version of python is compatible? i've so far tried 3.9, 3.10.10 3.11 and latest with no luck. Would be cool to be able to get past the second step😂
Talks about agent swarms and scalability... Lets have more..
Right after ...
9:15 but we will code them one at a time 😅😂
Quickly question: How do I utilize OpenAI and still be GDPR compliant?
So far I believe that AWS and Llama 3 for example would provide the best security regarding gdpr compliance.
Can you guys give me some feedback on how to achieve the highest GDPR compliance? :)
I am located in Germany, here it really is a big thing
Hey, I am also located in germany and would love to connect regarding this problem, how may I reach out to you?
How are you handling proprietary company data that the company does not want to send/share to OpenAI or leave its company boundaries? In my line of work this is critical and why open-source shines as I can keep all data internal to the company.
If you deploy on Azure, all you data stays on your own private instance. vrsen.github.io/agency-swarm/advanced-usage/azure-openai/
@@vrsen thanks I will check that out. In the gov space this is a huge dealbreaker. If using Azure OpenAI, I also see why it doesn't make sense to support open-source models. Thanks
@@playboy71322why his framework doesn't support open source models and what makes it different from crewai?
I own an ecommerce store selling catering equipment. Do you think it would be possible to get ai to do everything or almost everything? If so, guess I must reach out to you!
Can we use local LLMs with this framework?
Watch the video.
ok that was insightful, but what do we need to learn before all this? From a person that did Python course for 1-2 months. Thanks!
I was working on crew ai to mimic work of SDET engineer, I think I should try swarm now
👍
hey ,do i need to purchase some some services while creating this. agents ??
If you want to use gpt-4 you need to buy openai credits
are u a dev or are u more of business owner idea guys that understands ai functionality and have devs team ?? am just curious I love your content ty!
Hey guys! I'm immersed in the study of AI agents and I'm curious: would it be viable to build an agent that prospects customers for freelance professionals? I envision a system capable of exploring Instagram in an automated way, identifying potential customers and even starting conversations to schedule sales meetings. Is it possible to develop such AI agents? If so, do you know of any videos on CZcams or any mentors that explain how to create AI agents to automatically prospect customers through Instagram? Is there something like this in development or is this an idea for the future of AI?"
Can I fine-tune this models on my data or use fine tuned models?
Yes you can use fine tuned models on your openai account by changing model parameter in your Agent classes
@@vrsen Thank you!
Yes, AI agent development Role video please...
I could not reproduce. I had a lot of errors. No module named 'readline', module 'collections' has no attribute 'Callable', "The requested model 'gpt-4-turbo-preview' does not exist. etc...
ChatGPT
@@vrsen I solved some problems using it, but I could not find how to specify the model to use.
'readline' => i also had this problem, I fixed it with: pip install pyreadline3 ...on/for windows.
And:
import collections
collections.Callable = collections.abc.Callable
...in python code
Please make a video of the AI agent developer levels on project basis
You got it!
Hi , amazing concepts , but can in your agency swarm can you add multiple llm support using langchain. i tried to do it on my fork . but it was getting complicated. Would love a video from you ooon this topic
You can import tools form langchain, see “advanced usage” from documentation. Although, obviously, I do not recommend this. Use tool creator gpt instead
@@vrsen advanced usage from agencyswarm or langchain ?. Btw can you list your reasons for agency swarm not being llm agnostic in a seperate video. going into the nitty gritty details. i k you covered some reasons for that , but I think people would like to know more about this. And maybe some ways to make this work with other llms
I think this video and the previous ones sufficiently explain why the bet was made on the Assistants API, particularly in terms of state management. And within 3-4 months, OpenAI will release a new model, making the agency swarm both cheaper and better🎉
Nah, i'll stick to open source. Good luck though!
can you elaborate on why? not challenging, just a noob wanting to hear another perspective
@@outsidesoundsOpenAI is not open 😭🤣, why you ask that? Everyone know if you want to use OpenAI api you need to spend money
the point the guy in the video makes is that open source is not free, there’s no api fees but you still have to pay for your own hardware/infrastructure to run something at scale. is that not true?
@@outsidesounds open source mean the source code or source data is free. Meanwhile OpenAI never reveal which data they are using.
underated
imagine having morning standup with your agents ☠
This is actually going to be the case after OpenAI releases memory feature in Assistants API.
@@vrsen its gonna get crazy 😎
I'm interested in doing and learning like you ... but for now there is no budget. just started business ... can help
Great! Is It possible to use local LLM?
Круто! Очень круто!
Please i also want a separate video for the skill necessary for AI Agent developer, please
Can I subscribe twice to this channel 🤔🤗🤗
Very interested in AI agent developer course
I am kinda new to this, but i want to learn... can you teach new comers?
I’m interested in Ai developer video
I am a bit new to the framework world... how risky is it to bet your businesses infrastructure around a smaller framework? Yes the microsoft example has flaws. But it also has a high likelihood of being opperational in two years. The swarm framework looks amazing, and I want to sink time and production into it, but I feel a bit scared of the mess a missing repo one day might cause. Any advice? Just suck it up and build??
If you can show us how to integrate this locally (for example using LM studio for the LLM and Stable Diffusion for the image generation for the ad agency), the video will EXPLODE>
Watch the video.
0:52 It’s not just a cleverly prompted LLM. That’s factually incorrect. It’s an LLM that was further trained to improve its long term planning and reasoning abilities. Which is not an easy task to do.
If by trained you mean actual training, like adjusting the weights, than It’s not trained. They are using publicly available llms like Claude and GPT 4.
I will try to beat them in a few videos on SWE.
@@vrsen Nope. They are not using out-of-the-box LLMs.
The Agent is the New Function.
I literally see a time where functions are replaced by agents.
Which program is he using?
visual studio code
❤
FYI McDonalds does not hire cooks.
What do u mean?😂
Can i steal you algorithm and implemented it to open source model?
Can you make a video about how to make an AI agent that can build AI agents?
The innovative approach of *Phlanx's caption generator* transforms social media management into a profit-generating activity. By enhancing engagement and expanding reach, businesses can attract new customers and retain existing ones more effectively. This direct impact on revenue makes it a must-have tool for any business looking to thrive in the digital age.
Add another 90k followers to this channel please 🙏🏽 gems 💎
@Vsern thanks for this tutorial, i would like to borrow some of your ideas for my thesis but trying to follow through your video i am facing challenges with this error, 'File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\openai\_base_client.py", line 988, in _request
raise self._make_status_error_from_response(err.response) from None
openai.BadRequestError: Error code: 400 - {'error': {'message': "The requested model 'gpt-4-turbo-preview' does not exist.", 'type': 'invalid_request_error', 'param': 'model', 'code': 'model_not_found'}}', kindly assist with some insights on how to go about it. thanks
the request model didn't exist
I couldn't even get past step one LOL , I do pip install --agency swarm and nothing happens.
pip install agency-swarm 🤣
Great with the effort to build this autonomous facebook ad agency but when you look at how bad the ad copy that GPT4 generates it is shockingly poor. I wouldn't waste any adspend on the crap that comes out of it.
Not to mention that at multiple points you are changing the codebase that was generated because the gpt4 knowledge to make agents or tools is out of date, so this method only works if you have strong Dev skills or a system which can research latest API documentation (like Devin)
And if you did have access to a system like Devin then you won't need any framework at all.
Bro have you tested devin yourself?
Only a handful of people has access to it it… And the videos they selected weren’t just some random performances, I’ll tell you that.
My goal with this video was to help you get started. To make these agencies work well in production does require work. This is basically what businesses are paying us for.
If you want everything to be done for you by AI, you’re probably around a decade early.
you need to investigate fine-tuning. it does require work and investment.
@@vrsen your system is world class, no doubt. Way better then crew AI and I love your videos, I was just saying that in practice it's that GPT4 is not yet up to the right level for these use cases. However, as correctly mentioned of the models are fine tuned also then it could work.
If you don't know about Bespoke Automata are you even trying to Agent?
what is that
Kagnjishn :)
intersted
Can you build an AI agent that knows all the tax laws for business owners, so taxes are done simplistically with every opportunity to save money earned
I honestly wish I knew a lot more about coding. My worry is using it and not knowing how to fix it :(
I have built a few apps including one for crypto and I have no coding experience at all, whenever I have an issue I simply use ChatGPT to help me fix it, that is what it designed for. This however is a little more complex and this is not for beginners as the title suggests, or maybe some type of beginner that I dont know of :)
out of my personal experience, also heavily lacking coding-skills: i ask the ai to fix it for me ;)
I have built many apps with AI and have zero coding experience I simply use ChatGPT to fix the issues when they arise, that is what she is designed for. However this is way more complex to fix and to be honest the title suggests it is for beginners, but beginners of what? it is more of an info video not a complete guide. For a beginner you would need to slow down 500%.
AI can already help you fix the majority of the issues; the important part is knowing the right questions to ask. I will release a video on AI Agent Developer skills soon I guess, since there are a lot of requests.
The AI finds and does the fixes. I know nothing but have been quite successful running python scripts.
Привет я в Торонто. хочу к тебе в Команду. Я работаю уже год с LLM. Выйграл в одном из местных хакатонов. Тебе интересно сотрудничать ?
Hello I'm in Toronto. I want to join your Team. I have been working with LLM for a year now. Won in one of the local hackathons. are you interested in collaborating?
Да, конечно, в дискорде есть форма в #job-posts
😏 *Promo SM*
Ngga buruk
а есть твои уроки на русском?
Брат, говори уже на русском, тебя все поймут)
Horosho
I literally stopped watching after "We are only working with GPT models".
I'll follow the project and I hope you'll add these simple "Assistant" functionalities to the library or outsource it for us to be able to use any model, be it GPT, Gemini or LLama.
Devin is overrated