How to use CLAUDE 3 with AutoGen TUTORIAL
Vložit
- čas přidán 16. 07. 2024
- Hello and welcome to Day 28! We are going to be covering Claude 3! I will show you multiple ways of testing it, and then how to use it locally and with AutoGen! Let's dive in and get started!
Don't forget to sign up for the FREE newsletter below to give updates in AI, what I'm working on and struggles I've dealt with (which you may have too!):
=========================================================
📰 Newsletter Sign-up: bit.ly/tylerreed
=========================================================
Connect With Me:
🐦 X (twitter): @TylerReedAI
🙋♂️ GitHub: github.com/tylerprogramming/ai
📸 Instagram: TylerReedAI
💼 LinkedIn: / tylerreedai
📆 31 Day Challenge Playlist: • 31 Day Challenge AutoGen
🙋♂️ GitHub 31 Day Challenge: github.com/tylerprogramming/3...
🥧 PyCharm Download: www.jetbrains.com/pycharm/dow...
🐍 Anaconda Download: www.anaconda.com/download
🦙 Ollama Download: ollama.com/
🤖 LM Studio Download: lmstudio.ai/
📖 Chapters:
00:00 Intro
00:21 claude.ai
00:45 sample code
01:38 Claude $5 Free Credit
02:04 Running Locally
03:08 Cost
04:07 Claude + AutoGen
05:46 Run LiteLLM
06:20 Example #1
06:58 Example #2
08:14 My Thoughts
💬 If you have any issues, let me know in the comments and I will help you out!
Awesome. Since I'm the first to comment I will say keep up the good work sir. I have been following your journey. Great stuff
Thank you I appreciate it!
Doing great work. I godda start uploading consistently again 😅
You should man! 😀
Is the liteLLM step still required? And how would you add claude to autogen studio?
Do not forget to mention that for now Claude is available only in small portion of the world.
This is true for the access through their web interface/subscription. You can request API access from most places.
I gotcha, I did forget this, will include on another video
Hey quick question! I'm following your course and kinda jumped out to this, just to add the opus model as one of my models, but I'm playing in AutoGen Studio. I followed your instructions (with litellm) in autogen studio, but that didn't work. Where would I create this model so that it is accessible in the ui?
Hey thank you for following along! So good question, I may have to try this myself with Studio to get it working. I don't have an answer right now, but I added it for myself to work on.
Is this not working with autogen studio? I always run into connection issues and I don't know why?
that I am not sure, I will have to try again. What does it say?
There is no messages.py in the day 28 repositories.
0:11 if it needs an API key is it really local? If in not downloading the model for use on my hardware without connecting to a service its not local.
Edit after watching more: yeah this isn't local, this is just connecting to their server for an API. Clickbait title.
Came here to post the same thing. Was irrationally excited that Anthropic released an open model to host locally.
Hey yeah you’re right. My apologies, I’ll change it. Sorry for the confusion.
Updated title and thumbnail, I apologize for the confusion!
@@TylerReedAI Thanks!
I would install anaconda, but it is impossible to remove from mac once installed, so I have to do VM or something LMAO
😖😅