33
6 000

How to Run Local AI Models - in 5 minutes

*How to run Local AI Models, in 5 minutes, using LM Studio*
You don't have to always pay for OpenAI or Anthropic APIs.
In this video, I'll show you how to set up and run Open Source LLMs on your machine with LM Studio.
It is completely free and private too!
📥 Download LM Studio: lmstudio.ai
I downloaded Llama 3 7B and have experimented with Llava.
Check HuggingFace at huggingface.co
*Alternatives:*
* Ollama: ollama.com
* Llama.cpp: github.com/ggerganov/llama.cpp
💡 *Please comment what you plan to build with these models.*
👍 If you found this video helpful, please like, subscribe, and share it with your friends or colleagues.
I have more coming and am planning a video on using your data with local models (RAG and other techniques).
🖥️ Make sure your machine meets the minimum system requirements.
I'm running on a MacBook Air M1 with 16GB RAM.
We can also chat on:
Threads: www.threads.net/@diogosnows
X: x.com/DiogoSnows
🔴 Watch me live on Twitch TV: www.twitch.tv/diogosnows
🕒 *Timestamps:*
0:00 - Introduction
1:14 - Downloading LM Studio
1:42 - Alternatives
1:56 - Choosing Model
2:44 - Chat with Local AI
4:34 - More on LM Studio
5:04 - Running AI Model Server
6:25 - Calling from Python
7:39 - Thoughts and see you soon

zhlédnutí: 615

Video

Komentáře

@boqoll Před 7 dny
U need a supercomputer for this. The regular m.2 mac, can’t handle this. Way too slow…
@DiogoNeves Před 7 dny
It needs a fair bit of memory, I’m running on an M1 Air with 16GB Which models have you tried? Start with a smaller one. How much memory do you have? Soon I am going to show a lighter approach that although slow, runs on a raspberry pi
@yorkie4k Před 16 dny
I've been using LM Studio as it just works. Super easy to build plugins with the server as well to get functionalities that aren't in the app.
@DiogoNeves Před 16 dny
@@yorkie4k totally! I’m now also looking into Llamafiles and SQLite-vec. Both really cool too, but LM Studio is still the simplest and most accessible I know Do you use LM Studio just for the chatbot? Or are you building something with it? Would love to learn more 😉
@yorkie4k Před 16 dny
@@DiogoNeves I've built my own RAG app for it. If you're in the LM Studio discord you'll see my post on it.
@endianAphones Před 17 dny
For me it helps to think that I'm talking to someone I know. Imagine you're in a meeting or something. Not that I'm creating anything.
@DiogoNeves Před 17 dny
@@endianAphones thanks 🙏 definitely will use that next time!
@luciferovonnachtosphere Před 21 dnem
Finally, I found a well-made, no-frills, guide to installing local LLMs!
@DiogoNeves Před 21 dnem
@@luciferovonnachtosphere thanks 🙏 I really appreciate
@aca95aks Před 21 dnem
I'm much preferring LM Studio than GPT4All - thanks for the tutorial :)
@DiogoNeves Před 21 dnem
@@aca95aks thanks 🙏 yes, I really like the simplicity and interface of LM Studio. Have you tried any of the other alternatives like Ollama?
@danielhabibio Před 22 dny
This is the first tech tutorial I've ever seen that was recorded in the woods!
@DiogoNeves Před 22 dny
@@danielhabibio thanks! The coming videos should also have an outdoor twist too 😉 hopefully gets more people in the flow and woods are just awesome. P.s. I promise I’m not building a bunker in the woods to hide from our AI overlords 😉
@glossyxrose Před měsícem
Tysm
@glossyxrose Před měsícem
Wow! That looks so cool!
@DiogoNeves Před měsícem
We were together this day 😊
@glossyxrose Před měsícem
Nice donut!
@mrredfairy1 Před rokem
Adorable.
@zeldafan5515 Před rokem
Awww this is so cute 🥰
@DiogoNeves Před rokem
Thanks!! A friend of mine is considering creating a website so that anyone could easily make these stories. I really like the idea
@MsClaraneves Před rokem
😢

Diogo Neves

Komentáře