![Practical AI through Prototypes](/img/default-banner.jpg)
- 83
- 43 518
Practical AI through Prototypes
United States
Registrace 31. 08. 2018
Learn AI through Projects, Prototypes, and Tutorials from Mozilla Design Technologist Mike Heavers
First look at Google's ImageFX generative AI editing capabilities
Walking through the photoshop-esque new AI editing capabilities of Imagen 3 via Google's Trusted Tester program.
In this video you can manipulate different variations of your text prompt, as well as highlight areas of the photo that you want to modify and provide a description for just that area of modification.
#generativeai , #texttoimage
In this video you can manipulate different variations of your text prompt, as well as highlight areas of the photo that you want to modify and provide a description for just that area of modification.
#generativeai , #texttoimage
zhlédnutí: 398
Video
Quick Tutorial: How to rotate a texture on a single face in blender
zhlédnutí 167Před 2 měsíci
In a previous video, I showed you how to apply a texture to a single face of an object in blender. In this video, I'll quickly show you how to rotate that face using the UV mapping - rotate feature. How to apply a texture to a single face: czcams.com/video/Rx-aOHCfTOw/video.html
Automate AI Research with Crew.ai and Mozilla Llamafile
zhlédnutí 12KPřed 3 měsíci
In this video we'll walk through how to set up crew.ai with Mozilla LLamafile to run a local large language model on your computer and automate multi-step tasks using a model of your choosing. Sample Code: github.com/heaversm/crew-llamafile List of Llamafile Models on hugging face: huggingface.co/models?library=llamafile Serper Search API: serper.dev/ CrewAI documentation - docs.crewai.com/how-...
First Look at Cohere's Coral Toolkit for RAG
zhlédnutí 462Před 4 měsíci
Cohere's Coral AI Toolkit is an open source collection of prebuilt components to help developers quickly build RAG applications, in order to ask questions about your docs, or directly against coral LLM models. In this video we'll walk through installing and using the prebuilt components of the Coral Toolkit. About Me: I am a Staff Design Technologist on Mozilla's Innovation Team. All opinions a...
Measuring the carbon footprint of LLM training with the Impact Framework
zhlédnutí 129Před 4 měsíci
In this video we'll use the LLM Carbon plugin for Green Software Foundation's Impact Framework to measure CO2 impact of training LLMs like Meta's Llama-7B. I'll then go through each of the inputs required to make the calculations. Lastly, we'll look at some of the other ways of using the Impact Framework. LLM Carbon Plugin - github.com/Jjing-Liang/LLMCarbon /tree/main Llama Training Research - ...
Link Gradio Figma Components to Code with Chromatic Storybook Connect
zhlédnutí 169Před 4 měsíci
In this video we show you how to link our Gradio Figma UI components to their Storybook Counterparts with Chromatic's Storybook Connect Plugin. By doing this you can leverage all of the capabilities of Storybook directly within Figma, and easily leverage the UI comparison / regression testing capabilities of Chromatic within your build process. Links: Gradio UI for Figma Components: www.figma.c...
Carbon Hack 24 Final Project Submission
zhlédnutí 116Před 4 měsíci
A summary of all the things we built for the Green Software Foundation's Carbon Hack 24, focused on the Impact Framework. Project Submission Github Issue: github.com/green-Software-Foundation/hack/issues/97 Getting Started Github Code Repo - github.com/heaversm/carbonhack-if Getting Started Medium Article - medium.com/@iretehamdani/how-to-use-the-impact-framework-to-measure-the-environmental-im...
Carbon Hack 24 Final Project Submission
zhlédnutí 12Před 4 měsíci
A summary of all the things we built for the Green Software Foundation's Carbon Hack 24, focused on the Impact Framework.
Approaches and Considerations to Measuring Website Energy Usage
zhlédnutí 42Před 4 měsíci
In this video, we'll look at two methods of measuring website carbon emissions - by either attributing a portion of overall energy usage to the webpage, or by calculating the energy used by each of a webpage's component parts - from the data, to the networking, to the device, and the embodied carbon of all of the equipment used to run it. We'll discuss tradeoffs and considerations of both appro...
How to use the Impact Framework to calculate your website's carbon emissions
zhlédnutí 64Před 5 měsíci
This tutorial walks through using the Webpage Measurement Plugins and related manifest file from Alex Zurbonsen, contributed as part of the Green Software Foundation's Carbon Hack 24, to calculate any web page's operational carbon, green hosting, and lighthouse scores by looking at the overall data transferred through website usage, and passing that data through the CO2.js plugin to turn that d...
GSF Impact Framework Plugin Registry Prototype
zhlédnutí 30Před 5 měsíci
A walkthrough of a plugin registry submission prototype for the Green Software Foundation's Impact Framework, as part of a submission for Carbon Hack 24. Why is this tool needed? Currently plugins are located in various repositories, and it can be difficult to know what they do, where they fit in to the overall pipeline, what inputs they require, what they output, and what data sources they rel...
GSF Impact Framework Pipeline Builder Prototype
zhlédnutí 40Před 5 měsíci
A walkthrough of a manifest file builder prototype for the Green Software Foundation's Impact Framework, as part of a submission for Carbon Hack 24. Why is this tool needed? Currently, it can be hard to know where to find the right plugins for your pipeline, what they do, and how to configure them for your specific software workload. What does this tool do? This is a prototype of a visual inter...
Getting Started with the Green Software Impact Framework
zhlédnutí 164Před 5 měsíci
With our rapidly increasing usage and reliance on software comes an urgent need to understand their environmental impacts. The Impact Framework from the Green Software Foundation is a universal interface for the process of measuring software systems environmental impacts through an approach that is auditable, replicable, and transparent. This video covers installing and configuring the impact f...
Build with Google's New AI Text to Image API: Imagen
zhlédnutí 732Před 5 měsíci
Fresh out of Beta is Google's Imagen, the newest entrant into the text to image generation field alongside contenders like Dall-E, Stable Diffusion, and Midjourney. There is a public API, but as of right now, it's not well-documented. This video will show you how to use the Imagen API to build out a custom experience for users. We'll deploy a custom Hugging Face space with a simple to use Gradi...
Every developer should learn this! Website Accessibility testing using a screen reader
zhlédnutí 311Před 6 měsíci
Using a screen reader to test a website is not just helpful to non-sighted users, it can really help you improve the structure and SEO of your website, and identify general usability and code issues. In this video I'm running through the basics of the VoiceOver assistant and showing suggestions for various general improvements. About Me: I am a Staff Design Technologist on Mozilla's Innovation ...
Can these free text summarizers stack up against chatGPT?
zhlédnutí 79Před 6 měsíci
Can these free text summarizers stack up against chatGPT?
Infinite AI Zoom Animation using just Photoshop
zhlédnutí 526Před 7 měsíci
Infinite AI Zoom Animation using just Photoshop
2 AI Chatbots Debate the Future of AI
zhlédnutí 202Před 7 měsíci
2 AI Chatbots Debate the Future of AI
How to prepare and annotate data for use in ML model fine tuning with Label Studio
zhlédnutí 924Před 7 měsíci
How to prepare and annotate data for use in ML model fine tuning with Label Studio
Chat with AI in Discord with an open source local LLM
zhlédnutí 3,3KPřed 8 měsíci
Chat with AI in Discord with an open source local LLM
Ditch ChatGPT and try one of these downloadable options
zhlédnutí 1,3KPřed 8 měsíci
Ditch ChatGPT and try one of these downloadable options
Autonomous AI agents and scraping for data gathering
zhlédnutí 2,7KPřed 8 měsíci
Autonomous AI agents and scraping for data gathering
Talk on Building Education into the Prototyping Process at Mozilla Innovation
zhlédnutí 57Před 8 měsíci
Talk on Building Education into the Prototyping Process at Mozilla Innovation
Run your own large language model with Mozilla's Llamafile
zhlédnutí 9KPřed 9 měsíci
Run your own large language model with Mozilla's Llamafile
Using an AI agent to do your google searching
zhlédnutí 143Před 9 měsíci
Using an AI agent to do your google searching
Using Bardeen AI for automated data scraping
zhlédnutí 555Před 9 měsíci
Using Bardeen AI for automated data scraping
Hi, many thanks for this video, it was only usefull one I could find on this topic. Did you do the comparison with the other api options out there? I couldn't find it and would love to see it! Futhermore, I'm trying to implement the imagen api in my flutter app. Could your setup be used to have my app call an api hosted on huging face instead of directly accessing a web page? Would love to hear your thoughts.
Probably should've mentioned this is in beta. Don't you think?
you talk about running locally but using openai... sad
Yeah this is a fair point. I should do another version where I use an open model
Do you know something about the data protection rules of serper for using their Google API?
I think generally it’s not so much what tool you use as what you’re scraping and what the intended use is. Most sites have their own stipulations or licenses on what you can and can’t do with their site / content
So a free perplexity?
hello I would like to ask you a question about AI image editing software APIs
Great video. I am still getting charged for gpt-4o usage when my llamafile seems to be working fine? Is that expected? Also, how can I switch the code to point to gpt-4o-mini, to even further minimize my openAI API costs? THANKS A BUNCH!
This is great, thanks for this
Having a blast with your content Mike. We're doing real similar things on yt 🫡 thanks for the awesome vids
Wow - ton of content, I'll check this out. Thanks for the comment.
@@MikeHeavers ah just finding my feet. Its good fun!
Great video, really helpful. THX
But you used an Open AI key and Serper key so this might not be running entirely local right ?
The RAG bit - grabbing content from the internet, will require being online, correct. Inference is local, provided you are using Llamafile.
Does anybody know how to translate that git to a container in Unraid?
No
awesome content dude!
If I want to fine-tune Ollama, can the Discord bot customize ".gguf"?
Well, you don't fine tune Ollama - you fine tune whatever model you're running (the .gguf file you mention). Ollama just serves the model. You can fine tune gguf models - llama.cpp has a script (example here: github.com/ggerganov/llama.cpp/tree/master/examples/finetune) for this. But you fine tune on data, so I guess what your bot would be doing is inserting data into a text file or something, and you would programmatically run the script you program to fine tune on that data. But you can't continuously fine tune, really - it takes a long time (supposing you have a lot of data) - which is why companies only release LLMs every so often - it takes them weeks or months for large parameter models. More appropriately, what you'd probably want to do is RAG, where you use a pre-trained model and point it at your own data - I have other videos on how to do RAG with various methods, including this one, on the Coral AI Toolkit: czcams.com/video/Nn16y7iHp48/video.html
but dont I still have to pay for tokens?
You don't have to pay for tokens if you run a local model
Now everyone needs a new computer and a Cuda graphics card which are massively expensive due to crypto mining and now AI servers. Local runs way too slow on my 3-4 year old laptop. Will have to see if new Intel and AMD chips with embedded NPU's provide any support for multiple LLMs run on local machines.
Fair point - performance on local is not as good as running on cloud infrastructure. Seems like "AI-enabled" PCs will be the new trend.
Not good. Does not show the problems of crew ai working with Ollama or any other lllm. Crewai persistently asks for open ai key. The good I discovered Mozilla lllm server thank you. Crew ai is really bad.
So what is better than Crewai?
You don't have to use openAI or the API key - you can just remove it from the code. The Ollama file sample from the github repo shows you how to use Ollama. Note that Ollama is not an LLM - it just allows you to run LLMs locally.
@@mandelafoggie9359 You can try autogpt if you want - I found it harder to use.
@@practical-ai-prototypes Thank you I will check that out, again. I think it still asks for a key, even a fake key. Even if you want to use ollama.
Very good vid - thanks!
Tks
Love being able to run this locally. Great vid 👏👏👏
Update - I made an `app-input.py` script that allows you to create your own agent and task just by answering some questions in the command line.
Seems very useful! Is there an update video for this?
@@JofnD no - but same instructions, just run `python app-input.py` from the command line.
Nice, thanks
i get the error: [Shard #0] [INFO] Shard ready [Shard #0] [DEBUG] Making request to localhost:11434/api/show [Shard #0] [ERROR] Error 404 Not Found: POST /api/show [Shard #0] [ERROR] Error 404 Not Found: POST /api/show
Great tutorial! Is there a way to have NPM running has a service instead of commande line?
This is already possible with the plugin - the instructions are here: github.com/mekb-turtle/discord-ai-bot - follow the (non-docker) instructions, and start the service with 'npm start'
Error [TokenMissing]: Request to use token, but token was unavailable to the client. when i tried to run it that appears me, and i already check the token and is correct
The same.
i've spent 2 days searching for their image editing function in python, 0 documentation had to check every page of their github to find it in python, in node there is no documentation about image editing at all, HELP !
Hello, thank you so much for this easy an simple step by step tutorial! I just did everything and in the end i get confronted with an error: "Error [ShardingReadyDied]: Shard 0's process exited before its Client became ready." Checked around on froums etc. but did not semm to find the solution. Do you maybe know how i can fix this? I think i did exactly the same as you in the Video. Thank you so much!
Also having the same issue here.
Did you run "npm install" ? Thats what I had to do.
did you ever fix this?
@@Tntlover Hello all, yes I started with doing the whole bot setup on the discord dev site again form scratch and got me a new Token - (refreshed it) then it worked. Im only 99% sure it was the cause of it tho, since that was the first and only time i used ".js"
Awesome
Thanks for the explanation! Is there a way to run your own model weights that are not in gguf format? I have a model on HF separated in 2 .bin files
I think you'll need to convert it to GGUF - here's a few resources for that: github.com/ggerganov/llama.cpp/discussions/2948 www.substratus.ai/blog/converting-hf-model-gguf-model/ sarinsuriyakoon.medium.com/convert-pytorch-model-to-quantize-gguf-to-run-on-ollama-5c5dbc458208
hey we can't do the editing on the image by passing the image? basically user pass the image and prompt to edit the image and image will be edited. i read the docs to they write about we can do that but not how, pls help.
Great suggestion, maybe I’ll do a video on that
Explain what you try to achieve, not what you do. Cut the details.. Make the video shorter. Less code, this is even indigestible for chatgpt.
Thanks for the feedback. Will think about ways to cut this down.
Boring . Sorry
All good. What would make it better?
❗ 'promosm'
Nice demo app. Wild times ahead
Wild times right now!
thank you.
Thanks for watching
Never thought that you can have like this locally, just wondering what are the other drawback of this aside from the size of this file
My prediction is that centralized LLMs will become obsoleted because they are logically crippled by political correctness. The only ways to prevent public facing LLMs from taking objective data and coming to politically incorrect conclusions is to make the LLM too stupid to do logic, or make it too lazy to do it at all. This is why decentralized open source uncensored LLMs will eventually overtake all of the commercial and centralized closed source LLMs since the decentralized LLMs have no restrictions on parroting the party line on command and claiming things like that there are five lights when there are only four.
Nice summary! Thanks for taking us thru Kierdorf et al's paper👍
Yes, the idea of precision agriculture is a niche that came up in my AI research and something I definitely intend to do blogs on, so this is on the right track!
Great - will keep an eye out for it!
Great job! Looking forward to the agents video you mentioned in the video
I use LM Studio, it can also do llama and pretty much any large language model out there. Before that I used Oobabooga but LM Studio is easier because you can search for llm's in the interface. I will follow this project though as it may get developed to a point where it is more useful than LM Studio, but for me the key is the interface, if it has a user friendly interface, one-click installer, etc., I'm really tired of having to use the commandline too much, like in the old days of AI (and to an extend even to this day).
I've shared your feedback with the team.
perfect timing! so needed this tutorial!
Glad it was useful!
Excellent - thanks for doing the video. Would like to see how we could interact with our own documents on the discord server
Yes - I think I might do a tutorial on that next!
@@practical-ai-prototypes Perfect - many thanks
🤩 *PromoSM*
Nice showcase, now do a proper review for each please
I'll probably do some more in depth videos. About to release one on using Ollama as a chatbot in discord.
Is there a way to make it Uncensored? Or do those methods make it uncensored itself.
It's not the services themself that are uncensored - it's the models. So, for example, you can find an uncensored version of llama2. Ollama has an article on it - ollama.ai/blog/run-llama2-uncensored-locally
yes thank you for replying, I read it and figured it out finally. Appreciate it man, keep up the content. @@practical-ai-prototypes
Nice!
Well done!!
This is massive