Learning Robust Autonomous Navigation and Locomotion for Wheeled-legged Robots

Sdílet
Vložit
  • čas přidán 23. 04. 2024
  • In our new Science Robotics paper, we introduce an autonomous navigation system developed for our wheeled-legged quadrupeds, designed for fast and efficient navigation within large urban environments. Driven by neural network policies, our simple, unified control system enables smooth gait transitions, smart navigation planning, and highly responsive obstacle avoidance in populated urban environments.
    With the Swiss-Mile prototype robot, we have conducted kilometer-scale missions for months and proved the feasibility of our system for real-world applications.
    Project website: junja94.github.io/learning_ro...
    Paper link: www.science.org/doi/10.1126/s...
  • Věda a technologie

Komentáře • 279

  • @yoyomemory6825
    @yoyomemory6825 Před 2 měsíci +23

    Wow! this version of robot dog is amazing!!

    • @leggedrobotics
      @leggedrobotics  Před 2 měsíci +2

      Thank you 🙏 there are many more videos of the robot. Even standing on two legs 🤘

  • @rodrigobarraza
    @rodrigobarraza Před 2 měsíci +22

    Amazing work guys. Been following your progress for a long time. My favorite robot dog of all!

  • @Jayang5540
    @Jayang5540 Před 2 měsíci +40

    Good job! When it's in all wheel mode, maybe you can use some mechanical locks to fix the joints to save more electricity for the acutator on these joints. Keep only the necessary ones unlocked for steering left/right

    • @lolzdatguy4987
      @lolzdatguy4987 Před 2 měsíci +4

      The ones moving the legs up/down act as a kind of suspension from what I can see. Locking those would only be possible on mostly flat terrain

    • @leggedrobotics
      @leggedrobotics  Před 2 měsíci +4

      Good idea 👍

    • @Jayang5540
      @Jayang5540 Před měsícem +2

      @@lolzdatguy4987 A lock pin with a piece of rubber, crusing on "mostly flat“ terrain :P

    • @johgude5045
      @johgude5045 Před měsícem

      or just turn these axis into an end stop so motor power of these actuators can be turned off. A position with the main body close to the ground to also reduce aerodynamic drag

    • @yinyang2385
      @yinyang2385 Před 19 dny

      I'd love to see this in a fight to the death with boston dynamics SPOT.

  • @zonta71
    @zonta71 Před měsícem +4

    We have arrived at the template for autonomous public carts. Finally something that works

  • @laviedealain5855
    @laviedealain5855 Před měsícem +3

    Speed, climbing and jumping !!! That's amazing !

  • @TheRealityWarper08
    @TheRealityWarper08 Před měsícem +4

    This would be a really good replacement for the current food delivery robots, which are far too slow to outrun people with malicious intent!

  • @Tech_Planet
    @Tech_Planet Před měsícem +1

    Easily the most advanced robotic dog platform!

  • @TinyShaman
    @TinyShaman Před 2 měsíci +9

    This is brilliant. I absolutely love the combination of wheeled and legged locomotion, and the way they interact and complement each other, not just switch. Can't wait to see these things learn and become more agile and graceful.

    • @leggedrobotics
      @leggedrobotics  Před 2 měsíci +1

      The wheels even help when going up the stairs :)

    • @TinyShaman
      @TinyShaman Před 2 měsíci

      @@leggedrobotics Exactly. If you guys keep at it, the thing will be hopping and leaping around like a mind-blowing wheeled gazelle. 😊

  • @gufran_
    @gufran_ Před měsícem +5

    Congratulation 🎉 to the team who designed this revolutionary concept of locomotion.

    • @honestjakes
      @honestjakes Před měsícem

      It was "The Wheelers" in the movie Return to Oz (1985) with Fairuza Balk. They are awesome characters, and this needs to be dressed in that costume.

  • @ashan725
    @ashan725 Před měsícem +4

    INCREDIBLE DESIGN

  • @kennethattans5566
    @kennethattans5566 Před měsícem +2

    This is a game changer in autonomous navigation. Kudos to the team who made this possible.

  • @homefreedome217
    @homefreedome217 Před měsícem +4

    Good job guys!

  • @polygonpanda
    @polygonpanda Před měsícem +5

    Oh shit! It's like a robotic Wheeler from Return to Oz.

    • @Mortague
      @Mortague Před měsícem +1

      Exactly! My childhood nightmare is now real 😂

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      The wheelers are coming 🚴

  • @claudiabaran-konarska8409
    @claudiabaran-konarska8409 Před měsícem +1

    I love the idea. Pure leg-walking is so inefficient

  • @NoosaHeads
    @NoosaHeads Před měsícem +3

    If this is real (ie, not CGI) then it's very impressive. What troubles me is that robot voice. It lends a synthetic air to the entire video.

  • @dasularavinath
    @dasularavinath Před měsícem +1

    Man, that looked like one badass transformer...🔥🔥🔥

  • @futsk01
    @futsk01 Před 2 měsíci +2

    This is such a joy to look at

  • @olis999
    @olis999 Před 2 měsíci +1

    very cool work excited to see how anymal has progressed over the years and for what comes next

  • @zambani
    @zambani Před měsícem

    I've always said that the robot that we will ultimately use for general purpose won't look like a human and have normal fingers and legs. If you gonna build something to physically assist us why start with a human frame with its known limitations. These guys have it right. Take the best parts of as many species and vehicles as possible.

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      That’s correct! Do not copy nature if we have different tools to build machines.

  • @marijnstollenga1601
    @marijnstollenga1601 Před měsícem +2

    Impressive policies! Amazing that the policies learned in simulation transfers to the real word

  • @zazouille2264
    @zazouille2264 Před měsícem +1

    Great job. The combination of modes is amazing!

  • @Markfps
    @Markfps Před měsícem +1

    incredible, this needs further funding, improvement and to be sent to Mars

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      Our spinoff Swiss-Mike is taking care of that 🤘

  • @Covid_19_23
    @Covid_19_23 Před měsícem +3

    if such a robot is much more economical than a robot on legs, then your idea will definitely win in the future!

  • @rob23062007
    @rob23062007 Před 2 měsíci +7

    Cool, make one with handle bars and a seat please

    • @leggedrobotics
      @leggedrobotics  Před 2 měsíci

      Good idea. The next gen motor bikes 🚴

    • @AMPProf
      @AMPProf Před měsícem

      SURE GrandMuters diving Robots lolz

    • @AMPProf
      @AMPProf Před měsícem

      BETTER MAKE it pull a Fairytale carriage

    • @richardpackerandlindapacke503
      @richardpackerandlindapacke503 Před měsícem

      This would be great for a handicapped person to gain more mobility.

  • @ehrichsmiddy4663
    @ehrichsmiddy4663 Před měsícem +1

    Looks like something you’d see in the “Tales from the Loop” books

  • @rtgbhnkbn7004
    @rtgbhnkbn7004 Před 2 měsíci +2

    this is the ultimate solution for robot legs. felixable like human leg, faster than human leg

  • @sethpolevoi4027
    @sethpolevoi4027 Před měsícem +1

    Smart! Can’t believe this isn’t more common

    • @leggedrobotics
      @leggedrobotics  Před měsícem

      We are the first mover!

    • @downthesight
      @downthesight Před měsícem

      Don't worry, robot world domination is coming to us soon enough!

  • @rjung_ch
    @rjung_ch Před 2 měsíci +2

    ETH is top!
    This is getting better and better.

  • @edd2241
    @edd2241 Před měsícem +1

    Wow. Fantastic

  • @mark9294
    @mark9294 Před měsícem +1

    This looks like a winning design.

  • @pchoice0
    @pchoice0 Před měsícem

    우와 충격적인 관절과 대응 타이어에 변화에 대한 허용범위와 대응 그리고 타이어는 바로 정교함에 여유를 주는 요소이고 관절대응은 정말 인간을 넘어서는 순발력이네요 연구진들 대단합니다.

  • @jothamcharles5412
    @jothamcharles5412 Před měsícem +2

    Autobots.... Roll out!!!!

  • @briananeuraysem3321
    @briananeuraysem3321 Před 2 měsíci +8

    “Wake up babe, new Robotic System Labs: Legged Robotics at ETH Zürich video”

  • @MrmmmM
    @MrmmmM Před měsícem +1

    I'd love to know how you picked a scalable framework. Looks great.

  • @fareli91
    @fareli91 Před 14 dny

    I would envision in future where people will ride on this thing like a horse or bike, VERY COOL!!!

  • @motoflyte
    @motoflyte Před měsícem +1

    very smartly done !

  • @WaveOfDestiny
    @WaveOfDestiny Před 2 měsíci +4

    I'm just in love with this thing, i don't get why everyone makes robots with normal feet when you can have this and waste less energy and be faster, especially if you can switch configuration. Are feet just more stable at this stage of learning?.

  • @Lion_McLionhead
    @Lion_McLionhead Před měsícem

    Quite a phenomenon in the last few years.

  • @robertmoore119
    @robertmoore119 Před 2 měsíci +1

    Lol, Wizard of OZ! That robot is really strange and cool. You can see it processing walk or rollkneecaps.
    It also needs kneepads. It was bumping its poor knees.
    Looks a little clumsy, but with more time machine learning, I bet it will be awesome!

  • @minuteman91
    @minuteman91 Před měsícem +1

    Incredible design! Color me inspired

  • @yishujia186
    @yishujia186 Před měsícem +2

    This idea is impressive. I wonder how much this can extend the battery life compared to full walking mode.

    • @leggedrobotics
      @leggedrobotics  Před měsícem

      By a factor of 2 and more that’s 3 times the distance.

  • @kelzagoodman
    @kelzagoodman Před 2 měsíci +1

    Next-Level

  • @abdelkadernechadi7497
    @abdelkadernechadi7497 Před měsícem +1

    The future has already begun

  • @interestedinstuff1499
    @interestedinstuff1499 Před 2 měsíci +4

    Anymal is such a great platform.
    If I were an engineer I'd definitely use wheels, but I'd make them be able to either lock to become just the end of the leg, or pivot out of the way. Relying on just the motor to lock the wheel gives the robot a less stable footing in some situations. Be groovy to teach the robot how to move with its wheel when that's the most efficient, but use feet when the wheels are an impediment. Like the Tachikoma on Ghost in the Shell. (The smart spider tanks. I imagine all the developers on this project are into science fiction).

  • @egementanik2170
    @egementanik2170 Před měsícem +1

    Lassie is onto it.

  • @88NA
    @88NA Před 2 měsíci +1

    woo! this is great.

  • @pyshine_official
    @pyshine_official Před měsícem +2

    love it keep the good work going❤

  • @harold.one.feather
    @harold.one.feather Před měsícem +1

    They need to be strong enough to arm them with Panzerfaust and Tank Killer Rifles, first strike and fixed defensive positions are perfect for these killer robots

  • @alejandrocastro211
    @alejandrocastro211 Před měsícem

    this is absolutely impressive

  • @RichardLucas
    @RichardLucas Před měsícem +2

    The iterations are visibly distant from one another in thresholds and competence. And it's still accelerating.

  • @OriginalJetForMe
    @OriginalJetForMe Před měsícem +1

    This is excellent work! Have you published your source code and trained models?

  • @sylvanobenard6461
    @sylvanobenard6461 Před měsícem +2

    It reminds me of the wheelers from the movie return to OZ

  • @markobjelonic4500
    @markobjelonic4500 Před 2 měsíci +1

    Amazing ❤

  • @fitnessnature
    @fitnessnature Před 2 měsíci +1

    YAP ! Wheels/legs combination is the best for robot moving, if I make robot it will do the same.

  • @drancerd
    @drancerd Před měsícem +1

    Amazing! Now bombs are 10x faster in 10 km of autonomus range! ❤

  • @johneisnor
    @johneisnor Před měsícem +2

    What is the runtime for this robot before needing to be recharged? I could see something like this doing security for a compound, or, search and rescue etc, but only if it had several hours of charge

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      Our startup Swiss-Mile is commercializing the robot for security. Their new robot can run for 5h.

  • @Charles-Darwin
    @Charles-Darwin Před měsícem +1

    can you train it to skate along like an inline skater? I could see it hitting narrow gaps just balancing on one side and tucking in the the other wheel set

    • @leggedrobotics
      @leggedrobotics  Před měsícem

      We did that already. Check out our other videos

  • @pavolslab7831
    @pavolslab7831 Před 20 dny

    I have seen the future of food delivery here, well done 👏 would love to work for you guys 😍

  • @healingbyqurannow
    @healingbyqurannow Před 2 měsíci +1

    The competition of robots.

  • @casiosx003
    @casiosx003 Před měsícem +1

    'Return to Oz' nightmares

  • @dipakdhanke5296
    @dipakdhanke5296 Před 2 měsíci +1

    Does it give a precise control over the distance it moves?

  • @wisdomhappy587
    @wisdomhappy587 Před 2 měsíci +2

    This is the way

  • @liangcherry
    @liangcherry Před měsícem

    Good video!

  • @kentherapy7022
    @kentherapy7022 Před měsícem +2

    I spotted Sarah Connor in the background in the distance.....👀

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      Haha so you must be German to know Sarah Connor

  • @plaguedoctor6061
    @plaguedoctor6061 Před měsícem +2

    why not make the robot able to lock the wheels when going up stairs or such?

    • @leggedrobotics
      @leggedrobotics  Před měsícem

      Because the wheels even help when going up the stairs. The robot merely rolls over the edge of the step.

  • @alexjuback8127
    @alexjuback8127 Před měsícem +1

    It will be cool when it's real. Notice the blurred image around the robot. Seems very CGI

  • @dowesschule
    @dowesschule Před 2 měsíci +1

    Why is there a unitree B1 or B2 clip at the very end?

    • @leggedrobotics
      @leggedrobotics  Před 2 měsíci

      The company Swiss-Mile started to commercialize an adapted version of unitree.

  • @anthony212459
    @anthony212459 Před měsícem +2

    They stepped progress into hyper drive mode. 😂

  • @user-jc3nn8ud3p
    @user-jc3nn8ud3p Před měsícem

    Wow! AKIRA 炭団 has been realized

  • @RonLWilson
    @RonLWilson Před 23 dny

    A variant of this could be to have a homolid robot ride an e-bike (or e-trike or e-unicycle or e scooter) and then dismount when and push the e-bike et al when needed then remount the bike and ride on.
    This then would extend this controller to humanoid robots where the wheels are not part of the bot but are separate. This allows legacy products that are already optimized to be efficient and already exist to serve the wheeled function and the two, the bot and the bike act as one just as the wheeled robot dog but with even more versatility.
    But the control is much the same the only addition being the AI to mount and dismount the e-bike and to be able to push it when walking. But even that is a plus in that it would be easir for the bot to maintain balance when walking when pushing a bike in that would give it more stability and make it less likely to fall.
    Thus imagaine a humaoid robot riding say a cargo e-bike and doing last mile deliveries where it rides along the street just as any cyclist would then gets off at its destination and leaves it package and then remount its cargo e-bike and moves to the next delivery. This is something a robot dog (even on wheels) would not be able to do.

  • @mhuruuk
    @mhuruuk Před měsícem +1

    хочу себе такой, с местом для пассажира, с джойстиком (или еще каким устройством для управления, конечно чип в мозгу был бы прекрасен)

  • @likekim9387
    @likekim9387 Před měsícem +2

    So how much is it? You can also put a saddle on it

  • @Thetitaniumsteppermotor

    I wonder how this would function with mechanim wheels on it aswell

  • @Flawtistic
    @Flawtistic Před měsícem

    So, Metalhead is gonna have wheels in this timeline of Black Mirror? yay

    • @leggedrobotics
      @leggedrobotics  Před měsícem

      This will become the good version of metalhead :)

  • @zombiekid2424
    @zombiekid2424 Před měsícem +1

    You should make it so that the wheels can change from wheels to stilts or something so it can more efficiently go up stairs or hills
    Ps. If accomplished then in theory the robot could be able to walk 😅

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      Actually by using the wheels the robot can roll up the stairs and be more efficient depending on the kind of stairs.

    • @zombiekid2424
      @zombiekid2424 Před měsícem

      @leggedrobotics I mean I'm not saying it can't but I noticed it skirted a little going up those stairs, so idk maybe more grip but I still think the ability to go from wheels to walkers wouldn't be a bad idea especially if you want the robot to be more versatile, NOT hating LOVE THE BOT just saying thanks for responding 👍

  • @DanielSimu
    @DanielSimu Před 2 měsíci +2

    Great progress on the robot. But why the AI voice? :(

  • @blackhorseteck8381
    @blackhorseteck8381 Před měsícem +1

    Aren't you guys using the Nvidia Omniverse for simulation?

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      This work uses the one that was developed in-house.

  • @user-rk8vv5kv1o
    @user-rk8vv5kv1o Před měsícem +1

    Здравствуйте, Подскажите, пожалуйста, А могли бы установить кресло для инвалидов на этого робота? Интересно посмотреть, какой вездеход ступенькоход получится для инвалидов - колясочников.

  • @Schmogel92
    @Schmogel92 Před měsícem +1

    Just skip the wheel motors and have it rollerblade around!

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      The first robot we designed 7 years ago had rollerblades. There is a video of it on our channel.

  • @Rareme530
    @Rareme530 Před měsícem

    Probably a naive question, but why don't we use both legs and wheels together? wherever legs are better then wheels can be folded up likewise legs.

    • @leggedrobotics
      @leggedrobotics  Před měsícem

      It is using both even when going up the stairs.

  • @Varvarmisanthrope
    @Varvarmisanthrope Před měsícem +1

    2:13 Terminator detected

  • @markobjelonic2225
    @markobjelonic2225 Před měsícem

    ❤❤❤

  • @RafaelMartins-qn9lk
    @RafaelMartins-qn9lk Před měsícem +1

    Agora testa numa favela aqui no RJ

  • @xcidgaf
    @xcidgaf Před 2 měsíci +1

    What’s the battery life like?

    • @leggedrobotics
      @leggedrobotics  Před 2 měsíci +1

      It depends on the mission. Roughly around 2 hrs for the missions in the video

    • @xcidgaf
      @xcidgaf Před 2 měsíci

      @@leggedrobotics not bad.

  • @rodrigoapaza8086
    @rodrigoapaza8086 Před měsícem +1

    Nature is precius

  • @RandomRoulett3
    @RandomRoulett3 Před měsícem

    Id like to see one that skates on ice.

  • @methord
    @methord Před měsícem +1

    지상 드론 같은 느낌이다.

  • @adrianperez3375
    @adrianperez3375 Před 2 měsíci +26

    I enjoyed the robot, but was thrown off by the ai narrator. Its okay to use an ai narrator, but use a better one. And please dont have him read the titles in your script.

    • @leggedrobotics
      @leggedrobotics  Před 2 měsíci +11

      Thanks for the feedback. Next time, we will use a real voice

    • @OriginalJetForMe
      @OriginalJetForMe Před měsícem +1

      @@leggedroboticsThank you!

    • @HarveyMercer-io2zf
      @HarveyMercer-io2zf Před měsícem +1

      That. Look 5

    • @realSethMeyers
      @realSethMeyers Před měsícem +1

      ​@@leggedrobotics As a professional voiceover artist for the last 10 years who's been seeing less and less work due to AI, thank you

    • @damag3plan
      @damag3plan Před měsícem

      I offer my voice free of charge🤙

  • @raphaelvibar7481
    @raphaelvibar7481 Před měsícem +2

    Fuchikoma predecessor

  • @Blockistium
    @Blockistium Před měsícem +1

    this is just irl Puppytruck by Sean Dick

  • @MoonchildTWXZG3000
    @MoonchildTWXZG3000 Před měsícem

    every day you know new artificial form of life automatized

  • @Featherless1
    @Featherless1 Před měsícem +2

    That thing is nothing but another moving target...
    *THE WOODS AIN'T SAFE!*

  • @AMPProf
    @AMPProf Před měsícem +1

    Please Have one pull Fairytale Carriage

  • @igrokopilka4585
    @igrokopilka4585 Před měsícem

    какой ёмкости аккумулятор, какой расход энергии ?

    • @leggedrobotics
      @leggedrobotics  Před měsícem

      Check out Swiss-Mile the startup. They have now 5h. :)

  • @richardwatkins6725
    @richardwatkins6725 Před 2 měsíci +1

    scale that up for my iron horse.

  • @totumamedzade1994
    @totumamedzade1994 Před 2 měsíci +2

    Hello how make dansing

  • @omnianti0
    @omnianti0 Před měsícem

    i guess usage of motorised wheels is a failure
    instead of using rotating ankle/wrist that will allow to induce rollerskate moves and many others climbing abilitys

    • @leggedrobotics
      @leggedrobotics  Před měsícem

      We started with rollerskates and the performance of motors in the wheels allows for higher performance.

    • @omnianti0
      @omnianti0 Před měsícem

      @@leggedrobotics i meant the rollerskate move need a diferent ankle motor for pushing like a oar
      obivously the spped is limited

  • @jackburton5085
    @jackburton5085 Před měsícem +2

    ohh noo ooohhh nooooo Return to Oz becomes reality!!!

  • @jenabner
    @jenabner Před měsícem +1

    i need a car like this plz 😨😨

    • @leggedrobotics
      @leggedrobotics  Před měsícem +1

      How much are you willing to pay? 🤔

    • @jenabner
      @jenabner Před měsícem

      ​@@leggedrobotics
      lets make a deal? i brought up the idea to turn this epicness into a car and then you will make history. Youre company will be remembered for the first to make the legged robot car. Therefore i think i deserve at least one of the first you sell?✔✔

  • @Csinovnyik3000
    @Csinovnyik3000 Před měsícem

    Early tachikoma.