Video není dostupné.
Omlouváme se.
This AI Learned Some Crazy Fighting Moves! 🥊
Vložit
- čas přidán 1. 10. 2021
- ❤️ Check out Perceptilabs and sign up for a free demo here: www.perceptilabs.com/papers
📝 The paper "Neural Animation Layering for Synthesizing Martial Arts Movements" is available here:
github.com/sebastianstarke/AI...
github.com/sebastianstarke/AI...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Haro, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, Bryan Learn, Christian Ahlin, Eric Haddad, Eric Martel, Gordon Child, Ivo Galic, Jace O'Brien, Javier Bustamante, John Le, Jonas, Kenneth Davis, Klaus Busse, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Mark Oates, Michael Albrecht, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Ramsey Elbasheer, Steef, Taras Bobrovytsky, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: discordapp.com/invite/hbcTJu2
Károly Zsolnai-Fehér's links:
Instagram: / twominutepapers
Twitter: / twominutepapers
Web: cg.tuwien.ac.at/~zsolnai/
#gamedev
Finally, my boston dynamics robots will test how good humans are at standing
"I now hold the stick... *And I hold it better than you ever did."*
Oh how the turntables
Underrated comment
Atlas: Who's kicking who now?!
@@oat1000 its fine, 2nd place isnt bad at all
Though i dont really care if my character's moves are realistic; cool looks matter more in games. In real life and simulations though..m
Being able to control a realistic AI boxer in a multiplayer game would be so fun
First 30 minutes bruh
Or animation and anime fight scenes, would be amazing
imagine being a real life thai boxer (which is what this is) and play in vr with your movements being perfectly replicated. Instead of hitting the bag in your moms stinky basement when your adhd get too much you can go into vr instead.
I have dreamed a long time of making AI's copy real boxers and. From film analysis. Then have them to fight eachother. Tyson vs Ali etc..
@@adrianflo6481 Im a martial artists of 28yrs. I also enjoy fighting games. These things are two COMPLETELY different things. For one thing, you cant get any feedback in-game, when throwing a kick in VR. This means, for example, that your attacks will easily over-shoot the VR character.. because the Physical Persons body, is not actually there to stop the movement on Impact. If you try to stop the kick mid-air yourself... it will be and react, completely different.
Then you have combinations, such as kicking the low leg, to the high head. Or planting your foot on the OPs hip, to leap up to the OPs shoulders. Without "purchase" of an actual physical body... these things cant be experienced / performed in VR.
But more the the Actual point: A martial artists gets a completely different level of development and satisfaction, from martial arts training, and combat practice. I worked hardcore... and in maybe 5 months time.. I went from having a clumsy weak "dough-boy" body... to being fit, coordinated, and hard as Iron. That alone, gave me a Life Changing satisfaction, that no VR game can ever give someone.
Continuing: I gradually built up real physical fighting skills, that when I fully mastered, was able to be performed flawlessly and effectively, in heavy impact sparring sessions.. typically against fighters 2x my own mass and strength. Being able to defend yourself properly, under adrenalized stress... is yet another high that no VR game can give a person. Its just not even close to being the same thing.
Hell... just the act of sparring itself... produces a level of thrill and adrenalin, that cant be compared. Your very bodily life is actual on the line. If you screw up... you will easily suffer great pain, and likely some mild to severe injuries. If a VR model gets hit... you cant feel it. Even with Haptics, or mild physical shocks.. its not even close to the same effect.
Then there is Live Feedback. This is even more relevant to combat. In the highest level combat... we relay on heavily on TOUCH instead of the EYES. Why? Because there is a processing delay between what your eyes detect... and the visual processing center of the brain. As a result.. its easy to make the hand move quicker then the eye can detect. By extending your arms further away from your body... you can use them to not only give you more space and time.. (keeping the OP further away) but also, to protect and divide the 3d space up. Then, if the OP attacks.. you can sweep the general area of the direction they are attacking. Once your arm intercepts theirs.. you will INSTANTLY know everything about their attack, based on FEEL... and so you can react to it accordingly, and correctly.
For example.. I can throw a finger strike at your eyes, and just about fully retrace it, before you even realized I threw it. However... if a small insect lands on your arm.. you know exactly when it happened down to the millisecond. You know how big it is. How heavy. How much force it came in with. And you know the vector direction it was flying. You also will know if / when it changes is actions. If my arms is attached to yours... I can tell if you are putting more vectored energy towards the center of my body... or towards the side of my shoulders. I can also tell, if you try to change levels... from high to low gate... as you are still attacking. This allows me to formulate the best response, to be able to re-direct your arm and body, with almost zero effort. All within a "Fraction of a Second" worth of time.
Again... you cant do that in VR. You cant feel the vector of an OPs arm and massed paths.
Also realize... that because combat movements can happen in fraction of second timeframes... that you dont have time to "Think" about what to do. If a person throws a non-telegraphed jab... especially if its a counter-strike... the OP is typically Hit before realizing that attack was even thrown. In the best situation, of a telegraphed strike.. the OP might be able to roll with a strikes impact... such as rolling the head to the side, with the sideward hook, to reduce the impact potentials.
All of this boils down to your very ignorance about the depth and complexity about actual combat... and your own laziness and personal issues with having a good work ethic, to achieve good results in physical challenges.
Using the musty smell of a damp basement, is a crappy excuse. Its also a very easily solvable thing... by installing a simple dehumidifier, and putting air air ionizer down there. If the smells were extremely bad.. one could seal off and blast the area with an Ozone generator for a few hours, as that bleaches away all nasty scents. Once the room clears of the ozone... it will be fresh, clean, and smell-free (its how the repair smoke damages from house fires). Most of that smell is merely mildew, mold, and moisture, that can easily be cleaned up, and eliminated.
As a person that didnt initially have a place to train, I trained anywhere and everywhere, that I could. For example... I put on hard leather bottomed dress shoes on, and heel+instep kicked a tree for about 1hr, in four 15 min sets. Each set was Nonstop kicking, full speed, full impact potentials. The foot stings with each impact. Heck... even if you didnt have a thick tree around... you can perform a similar method by either flat-footing a concrete wall (Ive done this as well), to a slightly lesser skill.. but at least to get the conditioning, you can stomping the concrete ground flat footed as well.
Anyway... as much as I love video games... and would like to experience VR to a level beyond the limited phone demo crap... These things will never be even close to equal, without a radical feedback system. Im talking... the actual ability to physically Stop your swinging leg. Its actually possible... but the costs of such a device, will unlikely be realistic for typical consumers.
In 20 Years there's gonna be a Martial Art developed by an AI called Cyber-Fu which is the most effective, physically possible way to defend yourself.😅
Then you will download them unto your central nervous system and know cyber-fu.
@@tuseroni6085 Cool, I'll be a 62 Years old Cyber Fu Grandmaster ! 💪🧓🤜
And it's just "don't go somewhere where you'll get attacked"
@@wafflescripter9051 What do you mean ? Outside the House ? No, I'm staying Home in fear.
@@mushycookies6470 I don't walk around fearing being attacked, but if I did I'd be better off walking with friends, carrying a weapon, and avoiding places I felt were dangerous than learning martial arts.
Martial arts aren't useless for self defense, but they usually aren't the best option. If someone really does jump you, martial arts are unlikely to help if you're stabbed or outnumbered.
Now let’s make physics-driven AI models with good kinematics and train them to beat the living daylights out of each other. Perfect VR boxing opponent!
VR? Load it into an Atlas robot, and get a real boxing partner.
Wow. You have really bad problems in life. Talk to other in real life, express your fellings ! It was a great attempt here and I en courage you to do so, but man. Internet is not life. Keep that in mind. 👍🤗
@@numero7mojeangering Wow. You have really bad problems in life, feeling the need to put people down must mean that nobody in your life likes you! Why don’t you try to talk to people, instead of picking fights on the internet. CZcams is not life! 😊
@@planetdesign4681 I was not trying to pick fights ! Encourage people to not get discouraged ! Yes CZcams can be life at a certain limits ! I'm sorry if it's how you get what I write 😸
Yeah my judgement is quite rude here and I'm sorry for that. Will try to not judge that much next time but was quite stressed because of the recent évènements of my life ! So your right in certain areas of the discussion ! 🤗👍
As an Animator I'm very excited to see this, Animating with AI assistant will be soo much faster
I'm sure if some One was crazy enough they could capture hundreds of hours of motion capture data of doing daily activities like making coffee and stuff and with all the physics and simulations getting real someone can make a realistic ass movie with just this AI and simulation stuff
Let's say you have a boxing movie and the boxers are just two people playing this with the metahumans from unreal
Faster? I don't think that's the right word here. This would finally be something worthy of actually being called "animation".
Seems less like making it faster and more like making it the job of an AI. What is there to animate if you start with a skeleton and a skin and then apply the AI to get all the movement you need, pre-mapped to controller input?
@@ChinoxBoi Not exactly from unreal, but I'm pretty sure there's a movie of that but with actual robots.
It's probably still far off, but I can imagine something like this being used to smooth out movements of virtual reality rigs. It would mean you don't have to map every point on the body to every point on your virtual body, yet still get realistic movements. Also, it could help someone who doesn't know how to fight be able to make realistic fighting moves in virtual reality games, for example.
Then, when we're finally able to funnel a lot of biometric data into game engines, game developers could start using your heart rate to make you faster in the moment and level of fatigue to make your character more sluggish over time.
How are we not already past that point? This paper is about an AI that does all of what you describe, client-side, in real time, isn't it? All you need to do is program a 20-bone skeleton, a skin, and train the AI on a couple hours of relevant video footage.
@@michaelleue7594 we need gamers with phd
You read my mind 3 hours in advance! This would be awesome!!
I can just imagine fighting an AI like this. Just think of the vr game Thrill of the Fight but even more realistic (hopefully with better graphics too lol)
@@aeryfirst4189 We need graphic artists and programmers with the skills of a year 1 college student, plus this AI. Also we need gamers with...two thumbs. Seems doable.
Potentially I can see this system being able to contribute to Martial Arts knowledge in general. Finding out new techniques never done before based upon the framework of what we already know. Weeding out what doesn't work, and potentially changing how we see martial arts.
This is an amazing step in my eyes.
i dont know man it dosent look vary good at all now
thay would have to acount to a lot of things
@@user-lz2dy1uf1m not now, but probably within our decade. The researchers will probably have to use more realistic models and physics to simulate real movements and damage, which definitely takes more processing power
@@lucasfranke5161 wow you can text someon?!??😲
do you know baki the grappler? 🙂
Do u think ai will change storytelling? i dont
I do boxing in the back yard, its cool
@@user-lz2dy1uf1m
Your name probably fucked up CZcams's formatting
The writer of Kengan Ashura already pointed out a problem with advanced level immigration. It doesn’t truly capture the attributes of the person who made the tactics work for them so something will always be off
2045: Scientists using AI have figured out a martial arts technique to cook chicken
😆😆
Simulate how many punches it takes to cook a chicken
@@vgtgoat 69
this has already been done... you just need to slap it.
video is on youtube somewhere
@@Old299dfk My comment is in reference to that video.
It seems you need further explanation, to slap the chicken until cooked, fast enough, is not humanly possible.
I was saying that ai could invent a new way of moving the human body we hadn't thought of to generate the energy required to fullfil the videos goal.
The future of fighting games is now VERY promising!!
You love fighting games like me ! 😜👍 (Literally)
@protec & attac Fire in the shape of a ball 🏀🔥 realisticality created with psychic energy from you hand
Yes and this also means some games in works would be delayed for some time to implement this.
You're confusing the appearance of animations with game mechanics. They are two completely different things.
@@voidabstraction
Many video games already utilize a relatively primitive technique for physics-based, procedural animation!
Data like this would not be very difficult to implement into a more efficient engine "one or two papers down the line" ;-)
2021 : It would make fights more realistic.
20XX hold on my papers: you can feel those punches and get kicked.
20XX is 2021, too!
@@NicolaiWeitkemper Great 👍 an optimistic person ! Continue to encourage people around you 😜
Don't be jealous of what I said to Nicolais
20XX: Or you can ask for a brother/sister. pretty much the same
@@johmbon 😂
Step 1: hold on to your papers
Step 2: if step 1 performed, now squeeze
I died laughing.
You must be new here, if Dr Zsolnai-Feher has a well known catchphrase, that'd pretty much be it.
I love how smooth the interaction between the characters is. That's really amazing. Now I just need to see the transformation between seperated movement and interaction
How does a human beat an android that has the exact same knowledge/skill base? I have a theory...
Unplug the grid. That is how
Hit harder
Pee on it.
"You just have to hit really hard"
By peeing and vomiting on it if it isnt waterproof
A rough estimate for these things to start appearing in modern video games would be cool. We have had some oldschool attempts of dynamic motion in the past but this outstanding work would open a whole new world of immersion for all kinds of applications.
A very basic version of this is already in UE5 with adaptive root motion.
2years would be the fastest
@@voidabstraction ive used root motion to create a vault in ue5 but nothing like this sort of freeform movement, could you explain a little more or give me some keywords to look into? And what is the snake at the foot of these IK rigs I keep seeing, is there a word for that?
Teaching AI to more efficiently eliminate the human race is a brilliant idea lol.
Tay +these skills = Armageddon
Brilliant? They do not gaf about human unlike humans...all humanity is useless once AI controls everything
AI gladiator games anyone? As long as we don't let it leak into a physical robot everything should be fine.
poison gas? radiation? this is all way over engineered to kill.
Boxing is not an effective method for doing that.
Some day I'd like to see an AI come up with its own martial art, and see how it compares to current ones.
I'd really be interested in seeing this applied to Braziliion Jiu Jitsu considering it's very similar to a chess match. Imagine if AI could invent new submissions or sweeps. Incredible!
Honestly so many software and AI guys are into BJJ that I think this is feasible
It’s literally human chess, imagine the possibilities
probably not any new submissions, but definetly new setups for those and some novel strategies, as it does in actual chess
@@Chris_Preese i don’t see any knights or bishops in bjj matches you are lying
@@jooot_6850 i personally train with a royal englishman and a horse, so you're wrong
I would love to see AI like this do gymnastics. Given some "realistic physics" it'd be interesting to see how it generates the momentum it needs. Position of arms, angle of take off, etc.
Can’t wait for AIFC, coding companies fighting with their developed AI fighters
Then Kengan Ashura shits. (The premise of the show is that companies settle their disputes by hiring champions to fight in an underground MMA or some shit.)
I've been waiting for something like this to be practically added to a game. I was watching a video about Dark Souls and the various attacks, and how starting an attack would "lock you in" to the full move, because it was "realistic" that you couldn't just shift one move into another like you can in many other games. But the actual realism is that if you start one move and then cancel into another, yes, it wouldn't just jump into that new animation, but you wouldn't be locked in either, it would just awkwardly shift the momentum of the first movement into the intentions of the second, which humans do many times per day, but when is hard when working with keyframed animations. But with AI animations, it can realistically smooth between one animation and another, taking, say, a heavy overhead strike, and converting it into a sideways strike, where all the weight and momentum of the first move is carried into the second, either improving it, or perhaps making it less effective, depending on when you made the change-over.
after two more papers down the line implement this in a game, and I'd love to play it
Honestly the reason why i watch this channel so often is to see the tech games will be using in 5 years lol.
It would be amazing if the next GTA game implemented this into their game.
If you for example wanted to kick an enemy, all kicks would be slightly different, making the fight more dynamic.
Also generating combos that are true to the original move, but always behaves slightly different.
@BigBoyPeter Haha true, the ragdoll when being hit out of balance was pretty fun in gta 4.
Gta 5 was too static, both vehicles and characters.
Given that Rockstar have about another 10-20 years of milking GTA V yet, it could happen!
@OneTech but the GTA 4 fighting sucks. People act like it’s super dynamic, but it’s really stiff
How to not only explode your computer but quadruple development time lmao
Gta 4 had it with reactive punching, kicking, dodging but San Andreas had it with the different fighting styles like boxing, kickboxing, and karate.
Gta 6 should improve on the fighting mechanics and have multiple fighting styles.
Imagine having an AI coach as an mma fighter that analyzes your opponents' fights and trains you accordingly.
This would be outstanding for immersion in hunting games, god technology is the best.
Just the fact that it can iterate the most efficient moves it's going to teach us how to become the perfect fighters.
if we can substitute various kinds of non-violent behaviour for the boxing and use the controller for those actions, that might already be good enough for background characters and a step closer for foreground characters (in films). progress on the dreaded foot-sliding looks pretty good, too.
That's true. But I think we can already do that. The thing that was missing was active realtime self active response and it's is day passed !
Yeah I invented some terms, it's my daily life
@@numero7mojeangering the realtime part is very interesting for making characters move differently and apparently more as they would in real life. if one had a lot of background characters in a scene it would probably still be better to have the AI work out the movements and interactions autonomously.
@@juliandarley yes absolutely
OMG i was waiting a fighting paper one! Thanks you!!
3:06 That wouldn't work, the motion to one side needs a wave to go back to the other side. attack movement cannot have force in such a situation in real life. But, the work is very promising, it's really good to have an opponent where you can test lethal moves, because sparring u don't want to hurt your opponent, plus you both are getting better and if you're hurt you can't practice and reach that point (obviously). So this has very real implication for better training, whether soldiers, police or martial arts enthusiasts.
This looks very good. The future of animation is looking very good !
I would like to see the next assassins creed using something like this in their parkour stuff.
thank you for all your amazing work and inspiration. I started doing AI watching your channel, one year in the field now (even if only amateur) and perecptilabs its helping me a lot with my graphic novel! So much fresh and innovative! Love it! Thank you!!
The narrator sounds like a cool uncle presenting a cool toy to his nieces and nephews. Also, the voice is hypnotising.
interesting.. for a video game you could use the AI but impair the fighter in certain ways. For example, make him kick less effectively with his left than his right, make him sometimes lose his balance, etc.. That way you could have different fighters. Same training but different capabilities.
@@dikdik969 no silly, I meant like make his left leg slower than his right. Or less flexible.. etc.. as a real person would be.
Imagine watching an AI fight
Watching live stream of ai fight on twitch/CZcams
I just did?
Just watch Tyron Woodley
I got interested in AI 16yrs ago, after watching Street Fighter Alpha animated movie in which they made an AI learn from Street Fighter's fighting data and made a robot better than all of them. I was into martial arts, sci-fi, physics and creative stuff. I'm pursuing AI ever since and worked on similar Game AI, Vision and RL ideas too.
The foot sliding "artifacts" are a new move the AI created in MMA. It's called "moonwalking."
combine this with the evolutionary boxers from that other paper and then we'll have something to really deathgrip our papers for.
it looks pretty funky
Learning has never been more fun with this channel.
If I slipped and countered like that, my trainer would laugh at me. Still some way to go but man, most impressive.
Thank you. All these armchair “martial artists” in the comments don’t know the difference between theory and practice
You'd get a smack in the head if you slipped a cross and had your right hand down. Plus the AI figure throws his left hook, after the slip, but without any momentum. It's basically a flick. He's not using any power. It looks cool but it's very far from real combat.
Yes, teaching machines how to exterminate humans is a good idea.
Best comment here bro
Let's take a moment to hold on to our papers and revel at the amazing moves the AI strung together. Marvelous sight to be seen! What a time to be alive...
Yes. The last 10 years of humanity are awesome.
Thank you - beautiful. The spinning backfist (et. al.) looked pretty realistic. Amazing
That foot sliding artifact is what real humans do. In a slippery gym or in a street fight you see this
I want to see someone run this type of ai on an already existing game like tekken see what kind of crazy tech it can come up with
"Everyone has a plan until they get punched in the face." Tyson
Man the implementations of all of the recent papers in future video games is gonna be next level.
Amazing coverage on the siggraph paper
khabib would beat ai
I wanna see ai generated epic anime fights
Watch Kengan, it's not AI generated. But the fight choreography is epic. I'd say the best in anime.
I want to see more of Anubis decorating his flat.
The smoothness of that animation is mine blowing.
Imagine if fire suddenly learned how to make itself.
Your mind is gonna be blown when you find out about lightning 🌩️🤯
I could see a cool as game where people scan themselves irl whilst doing martial arts and the ai then gets trained on them after witch people Duke it out with their characters using controllers
I hope we will be able to see some new fighting games that utilize these techniques.
Köszönjük Tanár úr, mint mindíg, érdekes és jó a videó prezentáció!
please add this to every NPC in every game, thank you.
This is so exciting!
whoever programmed these movements did an absolutely incredible job
I will think of this video while a robot multiplies my ribs and bends my arms backwards in a post apocalyptic wasteland
I'll be honest, I didn't expect our robot overlords to be Muay Thai experts.
This will soon be like the Javis analysis on Captain America fight pattern in Civil War and come up with counter measures. Holy @#$!
This is truly incredible.
Love these "too many peppers" video updates.
I hope this moment mark the birth of the Future of AI athletes, where we can see sport events only for AI, they all have same physical attributes but each trained with different paper, may the best paper win
thatd be sick
thrilled for the next step of this where you can instruct the AI on having stylized elements so that we can get prodecural real time wire fu and anime duels, or a fighting game where the developer can set time guarantees on certain moves for balance reasons and tweak a variable saying how much they're willing to compromise on realism to make each move happen
Can't wait for an entire game to be made out of this!
Thats fookin awesome!
the counter attack in 3:04 should be with right punch , but Amazing Video and amazing progress!
A polished version of this and I could see trainers using it for their fighters. Could you imagine breaking down all of your competition with AI and using it to come up with strategies for a fighter's competition? Has a lot of potential will become more amazing than it already is.
NO WAAAAAY.
I've been wanting someone to do this to see the perfect mma fight.
You just threw in the clinching at the end. WOW! That's impressive
I love this guys videos
One step closer to robot gladiators who can showcase optimal human combat unlike anything we've seen before. Now that will be the pinnacle of spectator sports.
the most mind blowing part was how the egyptian guy walked through that gap at the end. so fluid
this could be such a good tool for future game animators and/or developers. So interesting
id sit there and watch the whole process its just to cool
Finally someone is working on realistic animation and physical interaction... I thought we would have to wait until the XXIII century for that.
Good job!
This is not just for fighting games, I train and the moves it comes up with can help fighters in many ways!
I remember losing a tournament with those combos
Of course more exciting papers from Starke
wow man what a beautiful motion
Time traveler : "and this my friends , is how the Tesla bots took over humanity "
Now you can look for possibilities of a massive fight between just one fully trained AI and see how he handles a bunch
It is getting closer indeed, one step at a time
Getting the kinesiology and physics right in the model is the most important step before expecting an AI to teach people how to move.
4:33 When your drunk aunt and uncle have a slow dance at a family wedding.
Yesss I love the combat videos!!!!
The funny thing is, seeing a fighting training ad selected by Google's AI for a scientific video about AI learning some fighting moves.
the potential for this in games is amazing
Very cool. The controlling aspect is a problem with many martial arts games, as due to controller limitations it is difficult to control all the movement required. Example: controlling the upper body with analog and the lower body simultaneously, while still having access to the main face buttons. It can be done despite it being not ergonomic by those who practice or developed methods to do so. The tetris controller method is a good example. Lol
"What a time to be alive!" indeed.
great work
WHAT A TIME TO BE ALIVE!!!!
This is going to make adventure games look and feel amazing
3:17 I squeezed my papers as hard as I could and still can't handle how awesome that is
I just love that some day I will put on my vr band and suit and fight my ai opponent, feel the punches and choke them out
I can’t wait to see this same concept done with swordfighting.
They rendered a solid package on that boxer.
As a fighter myself, I have to say, the AI’s form on some of those punches where better than my own!
It would be amazing to have these in VR fighting simulators and test every mind of strategy and technics, imagine how good fighters could become fighting with those