Using Image Recognition to Automate More Mario Minigames
Vložit
- čas přidán 4. 08. 2024
- To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/CodeNoodles. The first 200 of you will get 20% off Brilliant’s annual premium subscription.
In this video I automate some more Mario minigames from New Super Mario Brothers on the Nintendo DS.
This video was sponsored by Brilliant
LINKS
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Support the channel: ko-fi.com/codenoodles
Itch.io: codenoodles.itch.io/
GitHub: github.com/OfficialCodeNoodles
MUSIC
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Shoutout to @TheNobleDemon for making awesome video game music remixes! Check out their channel if you liked the music in this video!
• Super Mario World: Ove...
• Super Mario 64: Snow M...
• New Super Mario Bros: ...
█▀ █ █ █▄▄ █▀ █▀▀ █▀█ █ █▄▄ █▀▀
▄█ █▄█ █▄█ ▄█ █▄▄ █▀▄ █ █▄█ ██▄ - Věda a technologie
To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/CodeNoodles/ . The first 200 of you will get 20% off Brilliant’s annual premium subscription.
Hi! I did the moles minigame in C# a few months ago! The video on my channel : czcams.com/users/shortswjhrn0oKg8g
Woohoo I'm one of the first 200 ! :D
Love your videos Noodles !
I won't even be mad if you decide to milk this concept, love it so much
U ain’t Ted ed
Potato cheese
Fun fact: it's physically impossible to hit all the Montys in Whack-A-Monty, even if you're TASing. The game simply can't register touch screen inputs fast enough for you to hit them as fast as they show up near the end.
That makes me feel a lot better about my script 😆
Great video as always. I watched it at 82x speed, just to make sure I could comment early.
That's a great skill to have!
how did u get 82x speed?
@@theanonymusguyis actually possible with entering some JavaScript into the f12 console. I used to watch videos for class on 4x speed xd
@@theanonymusguyhe’s a hacker
@@theanonymusguySkill issue
He didn't automate these, he's just really _really_ good
Oh no, you caught me 😆
i swear, i see you everywhere now-
For the last minigame I'd suggest using color recognition instead of images, since the colors are not really close together. It also seems to run very slow judging by the jittery mouse movement so maybe it improves with that then :)
yea I was thinking all it really needs to do is check for anything bright orange, that'd include the walls and the flame breath
That's what I'm doing with my autohotkey bot that automates a mobile game I play. I'm digging through it and replacing every imagesearch command I can with pixelsearch commands that only check the color of a single pixel.
I'd love to see some further optimizations to these. I know image recognition gets clicks or whatever, but for whack a monty, all you really need to do is check the color values at specific pixels. If you wrote a C program that used the Win32 API, you could grab a bitmap of the ds screen, check certain pixel indices for the right color, and simulate an input event at each location. I reckon it'd be blazing fast compared to your python script with all that pyautogui and image recognition overhead.
Yeah, i was thinking that needed more optimization. Watching the playback it really missed the bottom row a lot
Rust has rsautogui, and processing data in-language is way faster. Using it, I made a 7 line script that uses Tesseract as well to get 7500wpm on the Human Benchmark typing test.
Overkill. The processing almost certainly does not take longer than 30fps or whatever sm64ds runs at.
For the last mini game with the fireball. What about this strategy: you view the fireballs as electrons (negatively charged) and the player as a proton (positively charged) such that the movement of the proton is dictated by the sum of the electric forces of the electrons.
That's a really cool idea! I actually made a magnet simulator a few years ago, and I could definitely see that doing fairly good with this minigame.
It'd be cool if after you finish up all the mini games. for SM64 DS if you could go on to do Mario Party minigames. or maybe make a program to play through all of certain mario games
Thrilled to see a sequel to this! There’s at least 2 really close calls in Danger Bob-Omb, so this hit box must be really interesting. Thank you for making another!
If you could automate the board section of Mario Party DS that would be really cool. Then you could combine it with the automated mini games to make an entire game of Mario Party played by an AI. That'd be really cool to see!
It would be more like "played by a TAS bot" since AI would have to learn every aspect of the game instead of being programmed to do exactly what it needs to do.
The first image recognition video is what helped me discover this channel in the first place and it was great, so I'm glad to see it revisited! These are always so cool.
that bob-omb one made me wonder.... touhou?
This is my favorite thing on your channel
It's so fun and also gives me nostalgia.
That score is higher than my highest score on Whack-A-Monty. My highest score is 79 Moles. I don't remember my highest score on Danger Bob-Omb Danger, I haven't played that game in ages. And I never play Snowball Slalom because I could never finish it. I think that I made it to the end once or twice though.
Based on how the Bob-omb minigame was going, you have to make it play and beat Touhou next.
Would love to see the project continued to the point where all of the mini games in NSMB and SM64DS are automated, and would love to see how you tackle the Poker and memory games.
We are just going to ignore the fact that the top screen of Whack-a-Monty shows all of the Monty Mole corpses the player smacked to death.
Yessss this is so good!! I love your other videos on minigame automation, thank you for doing more!
We need more of this for sure
Thank goodness, computers still can't beat me at the final 2 minigames.
absolute legend. my siblings and i played these when we were children and seeing them broken has me in awe. thank you for this!
The nostalgia plus the computer science is a great duo! I'd love to see more.
You reminded me of playing these minigames during the holidays and made the current ones a little better. Thank you for the great video :)
I love these videos so much
It's awesome to see these little mini games from my childhood again xD
I cannot stress how much I love these videos, and how badly I need more of them
I don't leave comments on videos ever, but this is one of my favorite series and I would love so much to see more of this!
Thanks, I'm glad you enjoy the series!
I'd love to see you take a crack at the Luigi Poker game. Working probability analysis into it would be interesting
love the style of the video! Amazing ideas and oh man... the music in the background, so nostalgic, takes me back to the good old DS days
I love this. Love the code, love the editing, love the ideas. Great work!
I would love to see this further expanded on, aka do every minigame... i wish, ha ha
Alternative Title: Using Image Recognition to make the Nintendo Ninjas find me
Looks fun to code this. Looking forward to seeing more!
I am very excited to see you doing more of this! I’ll be excited to see Mario party get mastered too!
Let's goooo, I was waiting for more of these lol
More minigame automation would be great!
I am really curious, how you will handle the desert puzzle minigame.
awesome video! if you make another part, you should try to further optimize the snowball game! it would be awesome if it didnt bump into anything at all, even if its just lucky!
Sick video as always man!
Yessss new video
Merry Christmas!
I love my favorite mini games being cheesed with image recognition. ☺️☺️☺️
Lessgoo new codenoodles video
This was nice, and hope you feel better
Thanks!
Np
I love your content man
Hey, there's this game called Backpack Battles on steam which is basically an auto battler where you have to buy items that synergize best with each others and defeat your opponents in a total of 18 rounds. It's apparently NP-hard and the well known knapsack problem to make an AI. Would be a real challenge to create an AI that can defeat humans?
Good remix taste my man. TND is majestic.
awesome and great job, its fun watching a fellow coder solve problems, opens my mind to different ways to tackle problems i previously wont have thought of.
really cool
keep the good work up
We need more
WOOO NEW CODE NOODLES YAY
Nice job bro
There is a shooting range game in kirby superstar ultra for the ds and I would like to see the ai get a perfect score.
Anyways this is a great video 😊
Great video!
This seems fun, I’m gonna try it myseif
Super cool man
Automate the entire mario vs luigi mode
wow great job as usual
Thanks, I really appreciate it!
1:00 sir that's Luigi abuse. Thats illegal!
good job 😊
Yes i need more
Cool videos
You could try using voronoi diagrams to optimize the bowser one… you ideally want to move along the lines in the voronoi diagram, and you would want to target resting in voronoi vertices that are very large distances from any fireball. You can pathfind using the path with the largest closest distance you’ll ever be to a fireball, so you’ll be able to stay in the safest zones and take the safest path to get there.
I would imagine this is very close to how a human plays the game! Except, of course, instant and never gets tired, never blinks, never gets distracted, and never loses track of fireballs
Im a little late, hope this vid is as good as the original! if not better sinze you have grown since then
What is this, a early Christmas gift? 😍
Cool a video ! Btw when Minecraft 2d update ?
6:56 Carl from Aqua Teen Hunger Force looks surprisingly happy for once
Cool
still waiting for 2 (or more) ais fighting in nsmb minigames
Now do whack a luigi on the monty minigame
or you do the opposite of what you're supposed to do, hilarous but probs not worth the effort doing the whole idea
Lore of Using Image Recognition to Automate More Mario Minigames momentum 100
MORE!
Automate that one Yoshi flower petal game!
Do you plan to do Mario 64? Like, the trampoline one or the piranha plant one?
I've thought about it. I might take a crack at it next year.
1:00 Isn’t that the pose he makes on the Luigi’s Mansion box?
loved the video, something id suggest especially with coding or anythng creative, show some of your fails(things that just go wrong or horribly wrong) it gives the video progression and incentive for the watcher to keep watching (long story short, people love when things go wrong)
I definitely make plenty of mistakes 😆
i don't usually comment on videos, but i wanted to say, that while the video itself was interesting, your approaches were understandable, but not very optimized. you did mention it at the end, but i still think you could have improved your designs by a long shot
That's completely fair. I'll try to optimize the scripts more in the future.
Holey moley!
how many minigames are even left in this game??
Last year? Stop making me feel old
Yeah, I know right 😆
Would these count as Tool-Assisted Speedruns/Superplays?
i wanna see u automate warioware and i just realized halfway thru typing that that that will be near impossible and not fun
They used a python? I can’t even see sharp!
Are there any minigames you CAN'T do with image recognition? It'd be interesting to see if the entire game can be completed with scripts.
EDIT: Oh, one of them requires a neural network. So maybe not.
I hate the snowball one…
❤
I’m st-epp-ing a-way
From, my re-grets of yes-ter-day!
As I remember I made 5000 points in Danger Bombomb. So it's not very impressing
Where is the code for bomb danger?
I thought you were think noodles
Lessgoo
I got an ad at the beginning of the sponsor 😭
LETS GOOOO
The method you used for the snowball minigame seems kind of... bad. I mean it only learned to navigate that one specific track, and if memory serves me right the layout of the penguins and rocks are randomized each time you play it. Also at the end it hit the wall a few times and slowed down. I feel like the best solution would be one that can handle any track given to it and doesn't hit walls.
Still love the video btw great work as always just wanted to share my opinion on your approach to that minigame
Yeah, the layout is randomized. I tried a couple of different methods to react in real time to the obstacles, but none of them worked correctly. Next time, I will try and avoid using this method.
Trampoline
Just add controller button noises, and claim you’re the best player in the world.
ye
"This one is extremely difficult to last long in" 😏😏😏
good
bro makes tas look weak