How I Made AI Assistants Do My Work For Me: CrewAI

Sdílet
Vložit
  • čas přidán 19. 05. 2024
  • In this video about crewai I've decided to show you:
    1. how to build your own team of ai agents that debate and think about your business idea from multiple angles
    2. how to give your agents access to real world data like google searches and reddit
    3. performance of 15 models in total: 13 local models + 2 through api
    🤖 Join my Discord community: / discord
    📰 My tutorials on Medium: / mayaakim
    🐦 My twitter profile: / maya_akim
    To rent a GPU from Massed Compute (crewaAI preinstalled) follow the link ⤵️
    bit.ly/maya-akim
    Code for 50% discount: MayaAkim
    Promised links:
    My Github CrewAI Repo:
    github.com/majacinka/crewai-e...
    CrewAI:
    github.com/joaomdmoura/crewAI
    AI agent landscape (as seen on 2:09):
    github.com/e2b-dev/awesome-ai...
    Serper Free Signup:
    serper.dev
    Andrej's video:
    • [1hr Talk] Intro to La...
    Gemini Free API Key:
    makersuite.google.com/app
    LangChain Tools:
    python.langchain.com/docs/int...
    Timecodes:
    0:00 - 3:17 what is crewai
    3:18 - 8:24 startup example
    8:28 - 13:48 internet/reddit example
    13:49 - 14:27 gemini pro
    14:28 - 14:42 price
    14:42 - 19:17 local models
    #crewai #aiagents #localmodels
  • Věda a technologie

Komentáře • 493

  • @maya-akim
    @maya-akim  Před 4 měsíci +197

    *UPDATE:* Thanks to the viewer @tryingET great suggestion, I managed to improve the prompts and make the output consistent. You can check out the improved version on my github.
    Thanks for watching and I'm curious, what were your experiences with crewAI like?

    • @PCMagikHomeLab
      @PCMagikHomeLab Před 4 měsíci +7

      Thanks to You I will start this in my home lab :) btw good job, waiting for more content. I see ring on finger, that's mean it's to late?

    • @TheGalacticIndian
      @TheGalacticIndian Před 4 měsíci +5

      Top ASMR experience👌

    • @christopheboucher127
      @christopheboucher127 Před 4 měsíci +12

      Thanks for this deep dive! The problem with open source templates is that they don't handle function calls, which is necessary for the crew to function. It seems that OpenHermes handles it well, the scripts work as expected, but even gpt3.5 gives better results.. thanks again for sharing

    • @amandamate9117
      @amandamate9117 Před 4 měsíci

      i have to agree @@TheGalacticIndian

    • @maya-akim
      @maya-akim  Před 4 měsíci +18

      @@tryingET This was just a great suggestion! I just ran the script couple of times, and you're right, the results are much more consistent. I only changed the part with "(linkToURL)", for some reason it was throwing the agent off. But it works with simple "(link to project)". I'll update the repo, thanks a lot for this help 🙏🏻

  • @BuildNewThings
    @BuildNewThings Před 4 měsíci +693

    crewAI creator here, so cool to see videos like this! I also automated parts of my work with crewAI as well and it's a "a-ha" moment for sure! Great content! keep it up 💪

    • @aimademerich
      @aimademerich Před 4 měsíci +9

      Wow I was trying to find your video my guy… someone posted a tutorial with your video and didn’t link you, great videos @BuildNewThings

    • @MrPhilipe711
      @MrPhilipe711 Před 4 měsíci +4

      Great program! Any chance we will be able to use memgpt with it?

    • @themax2go
      @themax2go Před 4 měsíci +5

      is it possible to run them in parallel instead of serial (maybe via threads)?
      The idea is that there's a manager who of course manages the worker agents (researchers, writers, ...); the worker agents then hand-off their work to analyst agent(s) who determine if more work is to be done, the result is then handed off to the manager, who then hands off to-do work to task creator agents to define what else needs to be done based on metrics from the analyst(s), then brought back to the manager who then assigns tasks to agents based on available workload (agent workload queue would be cool). also, dynamically "spawning" (instantiating) agents based on needs would be cool also, to conserve resources. maybe some features in crewai are missing yet to do that - what do you think?

    • @ArnaudMEURET
      @ArnaudMEURET Před 4 měsíci +8

      Huh wat? The video eventually comes to the conclusion that the results are useless and basically a waste of time. ☹️

    • @aimademerich
      @aimademerich Před 4 měsíci

      @@themax2go not at the moment it only does sequential, maybe pair it with autogen

  • @ryun_d3v
    @ryun_d3v Před 3 měsíci +32

    This is by far the most clear explanation I've found on agents, how to use them and how to run them locally. Congrats!

  • @sameerasamarasinghe1248
    @sameerasamarasinghe1248 Před 2 měsíci +12

    I hardly comment on CZcams channels. But this is another level. The way you explain things, organization, referencing, and pace spot on. Great content. Please keep up the great work. Thanks :)

  • @hidroman1993
    @hidroman1993 Před 4 měsíci +18

    Literally every LLM video
    Title: "I automated everything"
    Video: "Wow no model can understand the task"

  • @hasanaboulhasan
    @hasanaboulhasan Před 4 měsíci +6

    Good Job Maya :) I thought about many ideas while watching your video!

  • @g_software
    @g_software Před 4 měsíci +2

    This was an awesome video Maya. Thank you so very much for the wonderful and very helpful information! 🙏

  • @enspan3704
    @enspan3704 Před měsícem +2

    This is incredible. Thank you so much for sharing. Very inspiring!

  • @christophera.7547
    @christophera.7547 Před 4 měsíci +115

    I'm relieved to find someone else who faced challenges while running local models. Your sincere and practical review is appreciated. Unlike many others who simply join the hype train without discussing their struggles, your honesty is refreshing. Thank you.

    • @3wcdev878
      @3wcdev878 Před 4 měsíci

      Try ollama or gpt4all anyway to run a SOTA model you will need gpu or apple silicon.

    • @hqcart1
      @hqcart1 Před 4 měsíci +7

      me too, local models beside being pain in the butt, freezing your whole damn dev environment, then you get a shitty output, i am surprised she did test many models, i would have givenup much faster.

    • @nevill1947
      @nevill1947 Před 4 měsíci +5

      Not enough people talk about this. I follow the steps and run into error after error. Versions don't match, missing dependencies, list goes on. Ai development really takes a toll on your life force lmao

    • @VizDope
      @VizDope Před 3 měsíci +1

      I only tested one model weeks ago and i got no issue installing it and running it. It’s uncensored and i was curious. Outputs were great. If you have at least 16gb ram on 7B models there’s no way it will crash your PC. Of course it’s slow as fuck, like 1 word per second generation

    • @hqcart1
      @hqcart1 Před 3 měsíci +1

      @@VizDopeyou assume you have nothing else running dude, how do you develop this way? you need at least 64GB just to feel something!

  • @howtomeditateai
    @howtomeditateai Před 3 měsíci

    I want to thank you for this video! It is one of the most informative videos I have seen. Now that I watched it through I realized you really did your homework. I appreciate it.👏

  • @KamleshKumar-yh1lt
    @KamleshKumar-yh1lt Před 2 měsíci +1

    Super work there Maya. You earned a subscriber, and a follow. I built an agent on node with run tools with custom functions over RAG. But this is next level only, will try this next. Thanks again. Keep shining

  • @LiubovIlina-ls7gr
    @LiubovIlina-ls7gr Před 2 měsíci +1

    Huge thanks for such detailed, well structured and illustrated information! The best video I’ve watched on AI so far.

  • @roynijland7386
    @roynijland7386 Před 3 měsíci +7

    First time i encounter your channel/videos, and immediately got a subscribe from me. I love the clear explanation, straight to the point, no over promising or "Make $3000 dollar a day with these 10 simple bla bla". Thank you for keeping things real and useful. Breath of fresh air!

    • @PGFuto
      @PGFuto Před 5 dny

      Dr CC cfv CC cccc denn cr FFM ggf so XXL ref für du v_''_& cv

  • @joshuacunningham7912
    @joshuacunningham7912 Před 4 měsíci +3

    Wow. Thank you for such a great video and for sharing these insights. Really good.

  • @vinchitZone
    @vinchitZone Před 18 dny

    this is so in-depth and really appreciate your hard-work and dedication Maya.

  • @EricSchroeder-cc4hf
    @EricSchroeder-cc4hf Před měsícem

    One of the best, honest reviews - love this! Thank you!

  • @mortitotti
    @mortitotti Před 3 měsíci +1

    Absolutely Stunning Maya, Thanks for sharing these golden information.🤩

  • @deepdrops
    @deepdrops Před 2 měsíci +1

    Great video, Maya! Please keep creating more valuable content about agent creation.

  • @gabrieliba
    @gabrieliba Před 2 měsíci +1

    Thank you for your clear and lucid explanation about CrewAI !!!

  • @aimattant
    @aimattant Před 3 měsíci +4

    Maya, have to say - that was in-depth. Love the detail. Expensive running GPTs with CHAT 4. The output is definitely worth it though. I guess getting your own custom newsletter every day for less than a dollar does save research time. The next step is to get that file data into the actual newsletter now. Cheers for the free resources on Langchain. Just getting into APIs with py and deployment apps. I predict that you will have a great future on CZcams. Keep up the good work.

  • @codeplaywatch
    @codeplaywatch Před 4 měsíci +3

    I haved learned few very important things from your video. Thank you for an amazing video 🙏

  • @isidoras.radojkovic2074
    @isidoras.radojkovic2074 Před 3 měsíci

    AMAZING video Maja! Thank you so much ❤

  • @jabatheshort660
    @jabatheshort660 Před 3 měsíci +1

    This is an incredible guide!!! Thank you so much for making this video

  • @pavangandhi7808
    @pavangandhi7808 Před 28 dny

    Love this. Really transparent and talking about limitations of models..

  • @rushirajpara6815
    @rushirajpara6815 Před 4 měsíci +4

    Appreciate the way you've explained difference with analogy of "Thinking, Fast and Slow"

  • @andresroca9736
    @andresroca9736 Před 3 měsíci

    Really nice work friend. Nice narrative style and prosody while getting such a structured goal. And definitely awesome to listen discussions on the topics and decision making, this marks the difference. ... For trivial coding there is AI and Internet... for the core reasons and concepts there is us the humans

  • @mcramirez
    @mcramirez Před 4 měsíci +4

    Excellent explainer... Congrats and keep going !!!! Hello from Dominican Republic.

  • @mhdz10
    @mhdz10 Před 2 měsíci +1

    This is awesome Maya, thank you for sharing.

  • @jaanireel
    @jaanireel Před 4 měsíci +43

    00:02 AI assistants currently capable of system one thinking
    02:15 Build custom AI agents to collaborate and solve complex tasks.
    04:40 Creating and defining tasks for a team of AI agents to assist in market analysis and business plan creation.
    07:11 Agents can work in a sequential process
    09:36 Creating custom tools to improve newsletter quality.
    11:53 Automating research process using CrewAI agents
    14:06 Understanding and running local models with CrewAI
    16:23 Experimented with 30 models, best performing had 7 parameters
    18:28 Crew AI offered surprising insights from Reddit data.

    • @kunalr_ai
      @kunalr_ai Před 4 měsíci +1

      how many $ need to give to openai for their api service.. please mention that as well

  • @GabrielVeda
    @GabrielVeda Před 4 měsíci +37

    This mirrors my experience with local models vs automation. I've come to the conclusion I either need to massively upgrade my hardware or just wait it out for a new breakthrough model. I'm a bit jaded with all the hype that never seems to live up to real-world use.

    • @antoineminiconi4943
      @antoineminiconi4943 Před 4 měsíci +2

      totally agree

    • @bunkertons
      @bunkertons Před 3 měsíci

      Welllllll, yes and no. I've been able to tripple my productivity and I got 100% on two seperate essays using AI to workshop some ideas and build the essay outlines.

    • @AverFlow
      @AverFlow Před 2 měsíci

      We already have "Agency Swarm" in our business so there is no need for CrewAI or Autogen for sure. Try it out.

  • @nedyalkokarabadzhakov5405
    @nedyalkokarabadzhakov5405 Před 4 měsíci +2

    Very good and clear explantion. I rarely comment but when i do its because is worth it. So GPT-4 was the best model for all the tasks.

  • @RPBCACUEAIIBH
    @RPBCACUEAIIBH Před 4 měsíci +1

    Thanks for the info. Didn't even knew about Crew AI.

  • @laStar972chuck
    @laStar972chuck Před 3 měsíci +6

    Damn, you really are DOING THE WORK and then reporting back to us for free, dude !
    Thanks so much for such gem. Much appreciated !

  • @swifttransactions3595
    @swifttransactions3595 Před 3 měsíci +1

    INCREDIBLE CONTENT. You just got a new follower

  • @sfield541
    @sfield541 Před 3 měsíci +2

    Really good foundational information and great content. Thank you!!

  • @AkysChannel
    @AkysChannel Před 4 měsíci +1

    It's very calming to listen to you. Doesn't happen with technical videos a lot. Great vid!

  • @davidvc4560
    @davidvc4560 Před 8 dny

    Thank you! This content is so good.

  • @luigitech3169
    @luigitech3169 Před 4 měsíci +3

    Thanks for testing local AI models, I had a similar experience

  • @jorper98
    @jorper98 Před 3 měsíci

    Wow! Very good video! So much GREAT info - thank you!

  • @RouteOneTwoEight
    @RouteOneTwoEight Před 3 měsíci

    Great content and overview Maya. Thanks for sharing.

  • @csnawwa
    @csnawwa Před 3 měsíci

    I like your setup and vibe keep this good work up

  • @seanhynes9516
    @seanhynes9516 Před 20 dny

    Tremendous! incredible research and findings ! THx

  • @barrykruyssen
    @barrykruyssen Před 3 měsíci

    Wow, what great research and presentation. Thanks for sharing.

  • @joze838
    @joze838 Před 3 měsíci

    This was probally the most helpful video I have ever watched.

  • @phoenixaudas
    @phoenixaudas Před 3 měsíci

    This is such a great, informative and well crafted video Maya, so glad to see your channel grow so quickly - no worries! It is well deserved … how does Mat Armstrong say?! “HWBT” aka “Hard Work Beats Talent” … and you’ve got BOTH 💯🔥🚀❗️👍

  • @PawFromTheBroons
    @PawFromTheBroons Před 3 měsíci

    That's the most mental use of a boom arm I've seen anywhere.
    😆
    Commented for creativity, and the engagement boost.

  • @mysticaltech
    @mysticaltech Před měsícem

    Maya, wonderful! I love learning from you. About local models, I bet Nous-2-Pro-7B could do a good job but have yet to try it. Keep up the good work!

  • @waleedsalama336
    @waleedsalama336 Před 2 měsíci

    Great work! I'll try it out tomorrow! 👏

  • @alexeycherkashin6251
    @alexeycherkashin6251 Před 4 měsíci +2

    Wow, what an intense research on the topic! Thank you for sharing this info with us 🙏

  • @MindSetShortsOficial
    @MindSetShortsOficial Před 2 měsíci

    As I loved the video, I'm going to create my agents 🕵‍♀; Thank you Maya! 😄

  • @jappanmavani3132
    @jappanmavani3132 Před 3 měsíci

    Thanks for making this type of content. I like it.

  • @DaviddTech
    @DaviddTech Před 3 měsíci +2

    Amazing video thanks for the insights.

  • @gosuperva
    @gosuperva Před 6 dny

    This is awesome! Building a team of AI agents that can access real-world data sounds incredibly powerful.

  • @13exousia
    @13exousia Před 4 měsíci +1

    I have been considering doing this. Thanks Maya.

  • @costathoughts
    @costathoughts Před 3 měsíci

    Hey Maya!
    It was an amazing video! Its growing my interest to work in some stuffs more IA related, one the thing that shine to me is the Agents as a nerd I was thinking how is the effort to create a Copilot agent that would have access in some local project even the github, however, using a Local LLM

  • @LearnAvecAmeen
    @LearnAvecAmeen Před 3 měsíci +1

    I just discovered your channel, beautiful concept, all the best insh'Allah

  • @notclagnew
    @notclagnew Před 24 dny

    Great content, thank you. Subscribed!

  • @alexatedw
    @alexatedw Před 4 měsíci +3

    I used this same method only through Google apps script and integrated into spreadsheets. Nice work

    • @lausianne
      @lausianne Před 2 měsíci

      That sounds interesting. I know Apps script better than Python and I want to work with sheets. Would you share your work, or some of your insights?

    • @alexatedw
      @alexatedw Před 2 měsíci

      @@lausianne sure. I have a few videos on my channel and if you shoot me an email, I can share the code I used

  • @trainspotting02
    @trainspotting02 Před 18 dny +1

    Great video and LLM review.

  • @AirmanCS
    @AirmanCS Před 4 měsíci +1

    Ha never heard anyone mentioning thinking fast and slow anywhere that is a great book

  • @alphablender
    @alphablender Před měsícem

    WOW incredible value...your work is enterprise-grade and enterprise-ready ithank you so much for this huge work i'm a software engineer (Java, Unity..) passionate about programming and i love this practical video this is amazing...thanks so much beautiful Maya!!❤ Subscribing!!!!

  • @josgraha
    @josgraha Před 4 měsíci +6

    This is like a book in one video, thank you so much! Just curious, but how would you compare the latest autogen studio to crew ai? Lots of wonderful ideas here and beautifully presented, thank you so much for publishing this, you are indeed a knowledge sharing master and the world needs more intellectual contributions like this. Thanks again!

    • @maya-akim
      @maya-akim  Před 3 měsíci +3

      thanks a lot! I'm working on autogen studio video and I'll compare it to crewai

  • @youngmediageeks
    @youngmediageeks Před 4 měsíci +1

    Amazing content, great work and great style of explaining everything. Thanks for taking your time delivering so nice content on this topic.

  • @leandromirandafahurmachado2094

    Your channel is really good! Eage to see more about te AI content

  • @grimskull416
    @grimskull416 Před 3 měsíci +14

    It's shocking to me how quickly someone made an AI to do this, as I created my own autonomous agents in python a few months back to do these similar things.
    One tip I have for people trying to come up with a large & detailed tasks/descriptions is to write it in a .TXT file, and then reference it in your code. That way it keeps the code clean and also easy to modify the descriptions and tasks in the future without changing anything in the code.

    • @123userthatsme
      @123userthatsme Před 3 měsíci +1

      Excellent idea! You could even create services to update it from a GUI without touching your code. I'd probably set it up like a traditional JSON config file.

    • @DAN_1992
      @DAN_1992 Před 3 měsíci

      How to use .txt from my laptop and feed it as an input to the llm?
      please guide

  • @robertbutscher6824
    @robertbutscher6824 Před 18 dny

    great, very useful & interesting. Thanks a lot for your great video

  • @test12382
    @test12382 Před 2 měsíci

    Wow you have a talent for explaining. Thank you

  • @MaliRasko
    @MaliRasko Před 4 měsíci +9

    everybody can do it.. then opens a terminal and starts typing 😂.. loving this video already.. can’t wait till we start pip installing stuff

    • @maya-akim
      @maya-akim  Před 4 měsíci +5

      some encouragement is not bad ;) but also, the creator of crewai is already working on UI, so hopefully, people won't be pip installing for too long

    • @aimademerich
      @aimademerich Před 4 měsíci +2

      😂 yea that install she skipped at the beginning would have been helpful for people like me, luckily I have GPT4 😅

  • @DigitalBeautyVault
    @DigitalBeautyVault Před měsícem

    Hi Maya! I’m so fascinated by your technical abilities. I barely understand the whole thing, but I’ve always been fascinated by AI and started learning AI tools.I saw on your tiktok that you taught yourself Python. It would be awesome if you can also share your learning process coming from a non-tech background and how’s your progress so far. Thank you :)

    • @maya-akim
      @maya-akim  Před měsícem

      Thanks! It's a great idea, I'll definitely make a video about that :)

  • @JohnnyTwoFingers
    @JohnnyTwoFingers Před 3 měsíci

    You explain these things WAY better than anyone else I've watched, thank you!! 👍👍👍

  • @jasonkocher3513
    @jasonkocher3513 Před 4 měsíci +3

    Watching from BerylCNC... what's your opinion on using CrewAI or AutoGen versus creating a GPT within OpenAI, and providing instructions that frame out the functionality in a similar way? My development work is mostly related to CNC tool path utilities. LLMs do a poor job of inferring and understanding geometry, so I have to bake in a lot of rules and math. GPTs seem like a cool way to get noticed, but I really need to include libraries and Python code. One of ours is called "Beryl of Widgets", and it helps makers figure out what to make and sell with the tools they have available. It could be so much more with CrewAI, I think, but then I need a way to deploy it. Great content, thank you!

  • @andk9999
    @andk9999 Před 4 měsíci +2

    Great video! Congrats!

  • @VidhathShetty
    @VidhathShetty Před 4 měsíci +3

    This looks lovely I can't wait to take charge of work and make it more productive. Can't wait to binge on the rest of your videos newly subbed.

    • @InXLsisDeo
      @InXLsisDeo Před 4 měsíci

      And fire loads of redundant employees ?

  • @nikhil0360
    @nikhil0360 Před měsícem

    Actually a great video to start with AI agents, thanks

  • @enjoypolo
    @enjoypolo Před měsícem

    I’m not a coder but want to learn how to build and tinker with these. Thanks for the clear explanations!

  • @chrisBruner
    @chrisBruner Před 4 měsíci +1

    Good job on this video. I've used crewAI and Ollama. Always looking to see how other people are using this stuff.

  • @philippelescan
    @philippelescan Před 4 měsíci +1

    Thanks a lot for this video. I like it. It's very useful. :)

  • @arnoldocabrera
    @arnoldocabrera Před 4 měsíci +1

    Great content , keep it up!

  • @milleniumdawn
    @milleniumdawn Před 4 měsíci +1

    Impressive video. The Reddit scrapper, thinking about changing ollama settings :D I'm sad your system limited your choice of LLM. But now I'm really motivated to try on my system, to test Mixtral.

  • @tassoskaris
    @tassoskaris Před 13 dny

    Great presentation. Congrats

  • @horus8296
    @horus8296 Před 4 měsíci +2

    You look like a 500k+ suscribers's creator, great job and great video btw

  • @affinnen
    @affinnen Před 16 dny

    Great content, thanks!

  • @AlwaysCensored-xp1be
    @AlwaysCensored-xp1be Před 2 měsíci

    Will be learning more about this CrewAI. I have been using ollama to run LLMs on my Raspberry Pi5. I really need more Pi5s to run in parallel.

  • @aimademerich
    @aimademerich Před 4 měsíci +2

    Phenomenal thank you

  • @student7261
    @student7261 Před 4 měsíci +4

    Excellent review. New subscriber earned 😊. Would be interesting to see your take on Opengen Studio and compare this with Crew AI.

  • @MrSuntask
    @MrSuntask Před 4 měsíci +2

    Wow! Love it!

  • @KCM25NJL
    @KCM25NJL Před 4 měsíci +2

    It's quite possible that GPT4 is much more adept at understanding the premise of function calling, as it likely has a fine tuned expert in it's MOE to deal with "GPTs", thus making it more capable when dealing with OOTB solutions like CrewAI et al. I'd hazard that until someone fine tunes an OS model with a variety of function calling methods, and tools like CrewAI move on to more dynamic conversation flows rather than just sequential, then we'll begin to see the benefits of offline muilti-agent setups.

  • @Dr_Tripper
    @Dr_Tripper Před 3 měsíci

    I have worked with dozens of models and scripts as a non-programmer newbie. This waklthrough worked almost first run! Thanks.

  • @sharankumar31
    @sharankumar31 Před 2 měsíci

    subscribed for your such a detailed review and your time you took for this video….

  • @isaiassoares8458
    @isaiassoares8458 Před 4 měsíci +1

    Amazing, great job! I world like to try too!!!

  • @ojciecvaader9279
    @ojciecvaader9279 Před 3 měsíci +1

    I just started to learn about AI and.. I barely understand whats going on here, but I'm fascinated :). I was thinking about possibility to create this kind of agents/assistants for tasks like searching informations about specific topic online. I will follow you :),

  • @bloomflora1105
    @bloomflora1105 Před 2 měsíci

    appreciate the effort!

  • @antoineminiconi4943
    @antoineminiconi4943 Před 4 měsíci +3

    Thank you for your great research and video. Concerning Daniel Kahneman´ system 1 and system 2, the French neuroscientist Olivier Houdé proposes a continuation of this theory, based on the latest neurology discoveries. He published a short book called “L’Intelligence humaine n’est pas un algorithme.” that is easy to read and understandable, and as it is short, it might be easy to translate to English with an LLM.

  • @DeruwynArchmage
    @DeruwynArchmage Před 3 měsíci +1

    My understanding is that using a larger quantized model works better. I’m planning on trying it soon on my computer, maybe with autogen. I’ve got a 4090, i9-10900k, and 64Gb RAM, so I’m hoping I can run maybe a 30b quantized model on it.
    I read that the ~5-bit quantized models are the sweet spot that reduces your memory footprint without any significant loss in quality of responses. 4-bit is still good but takes enough of a hit to matter. Again, haven’t tried it myself, so maybe I’m mistaken, but that’s what I read.

  • @jdavidoconnell
    @jdavidoconnell Před 4 měsíci +2

    Thanks for sharing.

  • @just..someone
    @just..someone Před 4 měsíci +3

    Side note, when showing something like the “ai agent landscape” would be neat if there was a reference where to find it. (There was enough info to do so, but a side of the repo would be sweet)

    • @maya-akim
      @maya-akim  Před 4 měsíci +1

      good callout, thanks! just included the link in the description box!

  • @alecc.5610
    @alecc.5610 Před měsícem

    That mic stand placement is wild lol

  • @YoungMoneyInvestments
    @YoungMoneyInvestments Před 4 měsíci +4

    I watched Matthew Berman’s video on AutoGen, what made you decide to use CrewAI and have you tried/compared it to AutoGen?

  • @petealiendnatronics6152

    very informative thank you. something like a carpet or room dampening could help the sound quality of the stream. thanks again.

  • @domjancik
    @domjancik Před 3 měsíci

    Very clear and informative video, it was a joy to learn the full process with you and I'm excited to try it out myself on some tasks.
    My takeaway with local models is: don't even bother at this point? Or even anything besides GPT4 still sounds like a waste of time. Curious about where lamma 3 takes us.
    I was surprised not to hear a single mention of running on GPUs when it comes to local model performance.

    • @dmitrymainichev789
      @dmitrymainichev789 Před 3 měsíci

      Not quite there. Local models are okay if you have 32 GB, good prompts and >10 minutes per answer. If not it's a pain in the ass..