Easy Machine Learning on Arduino/Raspberry Pi with DFRobots HuskyLens!
Vložit
- čas přidán 25. 07. 2024
- This is a tutorial on how to easily use an Arduino and a Huskylens to do complex artificial intelligence such as facial recognition, object detection, line following, object recognition and more!
DFRobot has created an amazing device which does a wide number of machine learning tasks. In this video I'll demo each one, but also talk a bit about machine learning as it took me a bit of understanding to figure out how this is different from other items such as the Arduino Sense modules.
This is now part of a 3 part series which ties this into Arduinos and controls an arcade setup!
Part 1) Introduction to Huskylens, the AI device that powers the facial recognition - • Easy Machine Learning ...
Part 2) Controlling Attract Mode Displays with keystrokes - • Insane Arcade Project ...
Part 3) Combining Huskylens and Arduino Leonardo to recognize a layer using facial recognition - • Facial Recognition and...
The summary is that due to this being a self contained module, it can offer a very fast processor, as well as contained modules, so that all of the processing is fast, offloaded, and handled for you. This also means that you can VERY easily hook up an arduino and be up and running in minutes for tasks that usually would be out of reach for beginners in electronics. Things like Facial recognition, object classification, and object recognition are all super simple to do with this.
It includes a screen, buttons, and a user interface to allow you to register items simply and effectively (Note: It has the models included, so it doesn't really 'learn' so much as you tell it what you're interested in). One other cool thing is that it can do more than just face recognition...it can actually identify faces. It also does motion detection and more!
If you're wanting to add AI features to your project, I think that this is a super simple way to get started and you get the benefit of trained models. You can even use the sensor to test things out before you even write a line of code.
This is the first in what will be a series of using this device in various gadgets. I'm building up to a really cool arcade idea that I posted on instagram.
Get the libraries at:
github.com/HuskyLens
Huskylens from DFRobot: www.dfrobot.com/huskylens.html
Huskylens Wiki (they did a GREAT job documenting this!): wiki.dfrobot.com/HUSKYLENS_V1...
Affiliate links for this project if you'd like to build it and help me out:
DFRobot's Husky lens: amzn.to/3qwg2SG
Arduino Leonardo (Cheapest I've found it!) amzn.to/2PE0iQz
Mini breadboards - amzn.to/3eoyhXv
Arduino Sense: amzn.to/3rxgph7
For more behind thes scenes follow me at:
Instagram - / geektoolkit
Facebook: - / geektoolkit - Věda a technologie
Great rundown nd review!
Glad you liked it! It's a super fun device
Very nicely done video tutorial I really appreciate you taking the time to review the product. I own two of the HuskyLenses and would encourage you to do a second or maybe even a third video if required on the advanced features. Features such as saving a model to the sd card and saving a photo to the sd card and how you can access the facial recognition/color recognition etc... from code. Once again thank you and I must add probably one of the most informative videos I have seen on the HuskyLens. I look forward to seeing more videos from you.
Thankyou! I'll look into that. I'm honestly still exploring and learning it! I have facial recogntion plus keystrokes working using an arduino leonardo which opens up some fun things. I'll keep digging into it...I haven't gotten into the sd card yet, and wasn't sure if I could load my own models...I"ll have to look into that!
A love this video. I’m curious, can it learn to detected a person’s covered face like a gowning process? I’m working on a project and I’m using a ESP32-CAM but all I can make it do is to identify if a person is using a mask by not detecting a face.
Wow!
Great video! Can be this be connected to esp32 devices please?
Thanks for this nice video it really explains a lot and easily. My only question is; is there a way to copy the "learned face / objects" to another huskylens. I've searced their original web site, had a look at the docs -with no answer. Already googled on it (maybe I'm asking wrong questions don't know). It won't be feasible for me to run thru the learning curve every time I make another bot... And again thank you for this video.
I’m glad it helped! As for your answer I don’t know but I don’t believe so. It’s very good at quick prototyping but to translate learned models you may have to look into a tensor flow solution.
just seeing this now. I would need it to detect something new, orange traffic cones. Can it be trained to do that reliably? Are external models usable, or do I have to point it at 100 different cones and push the button each time?
It would be interesting to integrate it with Home Assistant... for domotics. Do exist any elaborations out there? Thanks!
not yet. I'm planning on trying that in a few months when I move into my new house and set it up though...it'd be VERY cool for sure. I'll post an update then
Sir, if I want to teach it some hand custom gestures, is it possible? Because its object recognition might not pretty well.
Very cool. Is there a way to feed it video data from a different source?
There is not sadly. It’s all a built in system
How does the object tracking mode works for huskylens. I mean what output does the huskylens send to arduino for tracking objects
You get basically the x/y position and bounding box if I recall right. But the actual video stream itself never leaves the device.
Huskylens can be used with the raspberri PI3 + plus?
Yes via python!
Can the camera be extended away from the board with a longer ribbon cable?
You'd have to ask the maker on that one. Some sensors are incredibly sensitive to the trace and cable lengths, others have some play. I'm not sure.
hey there! i know this things has object detection and machine learning I'm currently building a walking robot similar to the Boston dynamics dog. Does this this lenses allow it to detect stairs and climb them?
That sounds awesome!
I don't think this would be the sensor for what you're looking to do. It's good at detecting an object, but something like stairs is a bit complex. If you want your dog to recognize you, or chase a ball, or use QR codes to know what room it's in...this would help there. But stairs is a repeating 'object' that I don't believe this would help with sadly. I think you may need a sensor array, and that this would however be useful for other scenarios (like the ball one I mentioned)
@@geektoolkit nice thank you so much, and thank you for the reply
I found a similar AI camera like huskylens which is 'esp32 Cam '
It is a lot more cheaper than huskylens
And can do all those operations like face recognition, tag recognition, object recognition ,etc so esp32 works in similar manner like huskylens or it is different
And which will be better for me if I'm planning to build a advanced robo
What camera is it?
@@XO_PT huskylens
How to keep teens from unhealthy games? Here we go! Thank you so much! That's really a great solution!
I wish I had this when I was a teen....I would’ve probably not cared about games... This would’ve been the game!! Glad you liked it!
Where can i find the algorithm code of face recognition ?
It’s part of the firmware for the huskylens. You’d have to ask DFrobot
Is it possible to use this on arduino turret? Would be great to see you di this if possible.
I no longer have access to mine, so I couldn't tell you, but it sends pretty standard serial descriptions from the device, so if you can map the x/y coordinates of what the camera sees to 'real space' then you should be able to have a turrent follow someone. Please don't do anything terrible with that info :)
i have a question, like can i get an audible output from this haskylens by using a raspberry pi 4 and earphones??
another question... can i put another model like text reading or text recognition and reads that ticket??
There’s no mic and the video is never passed through. So no audio from the camera stream. For models I’d contact them directly to understand what you can and can’t upload to it. It states it had model updates that could be done but I didn’t test that feature
@@geektoolkit oh okay,, so i need a help,, so now i am working on a project for helping blind people with a smart glasses which its concept works as an input a video and an output which will be vibration or some loud tunes from a buzzer,, now i would use that haskylens as an object detection and as a feedback for what it detects it will make a vibration....
So can haskylens help me with that or using and programming a normal lens will be more efficient however i will use raspberry pi 4 and I don't have much time as it's a competition...
So i need some advices from someone professional as you
That is a really cool gadget. You mentioned you don't have to upload your own models because of the built-in capabilities. Are you still able to use your own custom TensorFlow models if you want to?
From what I can tell it uses a format called Kmodel. The devs mention you can upload your own trained models how ever in the forums those that have tried haven’t had luck yet. It’s also mentions that if you do, you’d have to upload one of the types that it already supports. So short answer is you should be able to but apparently doesn’t work. So ..I guess no. :)
Can it recognize dogs as an 'object'? I have a project in mind that would need it to recognize my dog.
Not that I could see when I used it (it's been a while). I ran through all of the things it did at the time when this was made..but it may have updates or you can reach out to them to see if they have updated the models. If you've got local network support, I know that deepstack running in docker can process and detect things like cat/dog/bird and such.
Okay, only 6 chess pieces to learn, and there is a few free already build chess databases for arduino / RPi .. I just don't understand how to hook them together.. I'd like to 3D print a Robotic ARM , and use a HUSKYLENS as a camera and AI for the chess pieces etc.. to move the correct piece and have it play against me.
Id love to see that project done!!!
Hello, can you help me with the vision sensor?
What is it you’re Looking to do?
Hello, I'm looking for the code that the servo works with through the optical sensor. I can't find an Arduino library that works, so what should I do? Can you send me a code with the library, please.
@@user-ek6pn6dm7f I don't have anything put together there currently to send you. Do you have servo code outside of the optical sensor that works? I usually use the sample servo code and then past that into the ino file and go from there.
@@geektoolkit Yes I have and I control it with the joystick
This modul is great, most should be patterned like this.
Yeah! I’m really impressed with how well it works and just how simple things were. I am now excited to come up with scenarios for it :)
Can this thing be used for OCR?
No it doesn’t have an OCR model built in
@@geektoolkit can you recommend any?
I can’t I haven’t used any myself
I’ve been looking into something like this for a quick object recognition for my robot, is it possible to switch between the different detection modes in the Arduino code?
can it recognize fast moving object(hockey puck)?
No sadly. I think you'd need something with maybe 120fps camera for that, and one heck of a processor. That would be an amazing project though! This just doesn't have that level of performance
OK, thank you for the quick response. I’ve started watching your video so you do good work so I have now subscribed… Do you know of a vision system that would detect a puck?
@@devanlynk7909 I don't offhand. I think one thing I can help with is what you want is not only something that can detect a puck, but an algorithm and then the compute to process it. I'd say you may be best off with a high FPS camera and a small form factor PC to pull that off so you can tweak the algorithm and such, and separate the need of a high FPS camera with the computing power needed
Im wondering about the range.can it recognize a human face 20ft away?
no. I just got to test this, the max range I was getting reliably was about 8feet. 20 feet I think you'd need something with a lens
@@geektoolkit Thanks
Im disappointed because I had a scenario where it would’ve required 20 feet myself!!! If you find anything that can do 20 feet let me know please!
@@geektoolkit Details in the face get distorted as they get further away this is the reason for the issue. Since the camera is a ov2640 you might find a fish eye or wide angle lens that will fit it and that would give you a greater distance.
@@jeffro5713 Oh I like that Idea! I may actually have a lens that I can try..I'd gotten a 'lens kit' a while back. I'll have to give that a shot.
:)
who disliked this?
People dislike videos for all sorts of reasons, and I don’t mind that. Those that appreciate them is why I do it and where I focus!