Run Your Own Local ChatGPT: Ollama WebUI
Vložit
- čas přidán 6. 09. 2024
- Today we learn how we can run our own ChatGPT-like web interface using Ollama WebUI.
Ollama: github.com/oll...
Ollama WebUI: github.com/oll...
◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾
📚 Programming Books & Merch 📚
🐍 The Python Bible Book: www.neuralnine...
💻 The Algorithm Bible Book: www.neuralnine...
👕 Programming Merch: www.neuralnine...
💼 Services 💼
💻 Freelancing & Tutoring: www.neuralnine...
🌐 Social Media & Contact 🌐
📱 Website: www.neuralnine...
📷 Instagram: / neuralnine
🐦 Twitter: / neuralnine
🤵 LinkedIn: / neuralnine
📁 GitHub: github.com/Neu...
🎙 Discord: / discord
Thank you for this, its fantastic. Would you be able to demonstrate installing a local llm to query your own documents? I have came across a number of tutorials for this but had not success running.
When I open the webui in browser and log in there are no models and I have ollama installed with llama2. how do I get my models to show up in the web ui? Thanks
I struggle with the same issue :(
@@benjaminbalassa9096 str8 up same issue i have ollama llama3:latest going fine in terminal and can speak to it and it works great, my webui is working great, it just isnt showing up in my dropdown to find the model to select it any ideas on this yet?
You DON'T have to use Docker. There are some good reasons not to. But all the tuts are with docker.
Love it! Do you mind sharing the hardware list of your desktop/laptop running llama2 ? The speed looks great in your demo. Thanks!
32GB of RAM, AMD Ryzen 7 5800, Nvidia GeForce RTX 3060 Ti, SSD Hard Drive
@@NeuralNine we got similar specs just that urs is desktop and mine is laptop 😆😅😫☠
@@NeuralNine Iam a laptop and the spec:
8gb of ram , intel i5 10210, no Gpu (🙂), 256 ssd
how did you download and where did you placed the model?
For me its blank since i didn't downloaded any model
hello
can I make this control my network and ask him about it to get the information localy
Good Thinking
pls make a videoon how can we fine tune oss model
Ollama exposing NeuralNine at 5:50 🤣
Hi, can you share which video card you are using for this demo ?
Awsome content as always, mr. Maximilian
Mine looks different, it installed and the icon is OI, not Llama. I can't load llama LLMs. hmm...
How did you get the models to show when you opened it Mine is completely empty. You did not show how you did that.
That'a a bold rule to lay over me. And everyone here, for that matter 😄 Just go to a comment that you resonate with, will you?
Hi! Thanks for showing me obbama, it is really useful.
Where is the link to the docker website?! How am I supposed to do anything if the link isn't even there?!
can you give it dataset/knowledge source
Hey so I’m trying to write an Alexa task that will provide a conversational UI w/ offline LLM (my usecase is crisis relief workers in areas with limited / downed connectivity).
Would the VoiceGPT extension work with Ollama WebUI? Also, is there a risk rating for wrong results for the lighter 2B or less models?
Is Ollama better than Jan? It seems like no one is talking about it
Thank for sharing 👍, …same installation steps to set up on cloud instances….? ? 👨🏽💻
Hey there, im asking if i can remove the register button because mine its a private ai and i dont wanna other people using my pc as ai. can you help me?
hi can we able to deploy this model with UI on any platforms like github or smtng else
can you do a video to how to install it one computer and acess it via wifi
How to train this local AI on my dataset???
i did it without docker, it annoyed me.
Awesome. Thank You
I am new to Docker, containers and linux commads. Please help me in converting from Ollama using CPU (I had an AMD GPU) to Nvidia, to which I switched after installing Ollama and the models... atm it still uses CPU only. Any ideas?
no idea homie this isn't the place for technical support
Maximillian, cool name.
Just not mine :D
@@NeuralNine - That’s hallucination for you
@@NeuralNine classic maximilian!
Very Useful, I want to setup an LM like this on my own hp g8 server to use on my other python project to generate descriptions automatically.
Is there any way to connect Ollama to my Python project (need to use Ollama API)?
no
@@christophermoreira6198 Not good...
does this work with azure open ai api?
works not! when i install ollama and then i use docker with open-webui all works god. the ollama on my terminal works perfect. and the docker with open-webui works. now tell me what mus we do for using llama2:latest it is not usable in open-webui! i can nothing see the llama2 or other! this step have you not in the video, that sucks!
did you resolve this im using llama3:latest and its working fine in terminal, webui and docker are good, but my model doesnt show up in the dropdown it seems.
ur english sucks
Make sure I llama is running on your pc as well as docker I had similar problems but all is fixed. The reason why he don’t explain things too much is because it’s too easy to use this. If Any one is having problems then the issue is something really simple.
how to use with python
What do you mean?
Do you want to call ollama models from python?
Cool, thx
:)
How good is Ollama compared to GPT-4?
Ollama itself is just the app / platform. It depends on the model you use. Check out the LMSYS leaderboard for a comparison
Thank you@@NeuralNine
Windows version is out now.
If I run it on wsl, Can I acess on windows?
yes
yes it works on WSL but beeter to run via docker on windows - better performacne
Thanks!
good
Keep telling „you can“ without explaining how is not helpful.
Guys, why do you show us such things? What's the point of using this software locally on a PC if there are professional services on the market such as GPT or Gemini? Who in their right mind would install this on their computer for such purposes? Show us something that MAKES SENSE. For example, how to build a knowledge base using this model. How to search a local database. How to create a search engine for content in documents... other. I would have to lose my mind to replace GPT with Ollama to use it as a chatbot.
Because for organizations that have confidential documents you can’t simply plug them into chatGPT or Gemini.
This is a solution if you want to have an internal LLM thats private that can interact with your own private data.
Are you 12?
There are tons of reason for localization. Start with security.
I am struggling to create knowledge base using these models. Any Good guide ?
Are u dumb? 😂😂😂
@@graphguythey probably trolling..
very bad in explaining
malisimo tutorial. No me interesa tu vida o que enseñes LO QUE YA HICISTE. MOSTRA COMO SE INSTALA de cero o ni te molestes en poner a grabar la pantalla y tu camara