AI vs. Stairs (deep reinforcement learning)

Sdílet
Vložit
  • čas přidán 28. 01. 2024
  • AI Teaches itself to Climb Up and Down Stairs!
    brilliant.org/AIWarehouse/
    If you want to learn more about AI and deep reinforcement learning (how Albert is trained), there are amazing courses teaching those exact concepts on Brilliant! You can use my link to get a free 30 day trial with 20% off! I've personally gone through the course "Introduction to Neural Networks", and it's one of the best courses on Neural Networks I've ever seen. They're paying us to promote them, but they're genuinely a great service, I've had a Brilliant account for over 5 years and can't recommend it enough :)
    In this video an AI Warehouse agent named Albert learns how to walk up and down stairs and get through other obstacles to escape. The AI was trained using Deep Reinforcement Learning, a method of Machine Learning which involves rewarding the agent for doing something correctly, and punishing it for doing anything incorrectly. Albert's actions are controlled by a Neural Network that's updated after each attempt in order to try to give Albert more rewards and less punishments over time. Check the pinned comment for more information on how the AI was trained!
    Current Subscribers: 305,109
  • Zábava

Komentáře • 2,6K

  • @aiwarehouse
    @aiwarehouse  Před 3 měsíci +2074

    Everyone seemed to really love the video of Albert learning to walk, so I thought I would make a video improving that walk! In this video Albert starts with the brain he developed in the walking video, and he uses that knowledge to learn how to climb up and down stairs, walk on uneven terrain, drop off ledges and even climb up a backwards escalator! Albert is getting better and better:D
    If you’re interested in learning more about exactly how Albert works, I’ll do my best to explain it here in a simple (but correct) way, but this explanation is nothing compared to what you would learn going through the “Introduction to Neural Networks” course on Brilliant. Despite them sponsoring the video, they’re not paying me to write this comment, I’m writing this because the course is genuinely the best introduction to neural networks (like Albert) I’ve seen, and access to all their courses is completely free for 30-days if you use my link Brilliant.org/AIWarehouse to sign up for a free trial. The 30-day free trial would give you plenty of time to get through the relevant courses “Introduction to Neural Networks”, “Reinforcement Learning” and “Artificial Neural Networks” completely for free:) It's also a great way to support the channel, as you know it takes months to make these videos, and just starting a free trial using Brilliant.org/AIWarehouse would help me out so much! Anyway, onto how Albert works!
    If you're interested in training your own AI like Albert but don't know how, there's now a really easy way to do it! Luda, an AI lab, recently built a web app that allows you to create and train your own AI using deep reinforcement learning (just like Albert) completely for free in your browser! You build your own character (called a Mel) with lego-like building blocks then watch it train in real-time on their website in just a few minutes (really). It's an awesome project, and just like my videos, makes deep reinforcement learning so much more accessible, which is why I love it so much. This section of the comment is sponsored by Luda, but these words are entirely my own, it's an amazing project that I would have been obsessed with had they released it before I built Albert. I've genuinely been looking for a sandbox/game exactly like this since I was a kid. They're still early, but they're giving my audience first access to their closed dev build. Make sure you check out their site and create an AI agent for yourself!:D prealpha.mels.ai
    NOTE: It may look like there’s only one Albert training, but there are actually an additional 280 Alberts training simultaneously behind the camera to speed up the training time (and also reduce the amount of footage we need to sift through).
    HOW THE BRAIN WORKS
    I’ve explained this in previous videos, but Albert is controlled by an artificial brain called a neural network. His brain has 5 layers, the first layer consists of the inputs (the information Albert is given before taking action, like his limb positions and velocities), the last layer tells him what actions to take and the middle 3 layers, called hidden layers, are where the calculations are performed to convert the inputs into actions.
    Albert starts off using his brain we trained in the walking video, and we use reinforcement learning to further train his brain for this new task of climbing stairs. The only things that matter when it comes to deep reinforcement learning (reinforcement learning with a multi-layered neural network) are figuring out what information to give the agent (the observations/inputs), and when and how much to reward and punish it (the reward function). Almost all of Albert’s inputs are exactly the same as the inputs we gave him for the walking video (like the position, rotation, velocity, angular velocity, strength and contacts for each limb, plus some sensor observations), in this video however, we also have a sensor sticking out in front of each foot which tells Albert the distance between his feet and the stair in front of him, if there is one. These sensors are the only way Albert can ‘see’, and they only detect stairs, so Albert is essentially blind!
    Just like in the last videos, Albert was trained using reinforcement learning. For each of Albert's attempts, we calculate a score for how 'good' he performed and use an algorithm called proximal policy optimization (PPO) to make small, calculated adjustments to his brain to try to encourage the behaviors that led to a higher score and avoid those that led to a lower score. You can think of increasing Albert’s score as rewarding him and decreasing his score as punishing him, or you can think about it like natural selection where the best-performing Alberts are most likely to reproduce, so the genes that lead to better behavior will get more prevalent with each generation. As long as the reward function (how we reward/punish Albert) is set up robustly, these small adjustments to Albert’s brain over (sometimes) hundreds of millions of attempts leads to Albert getting very good at completing the goal defined by the reward function (climbing up and down stairs).
    REWARD FUNCTION
    Climbing up and down stairs is very comparable to walking so most of the heavy lifting for the reward function was done in the video where Albert learns to walk. In that video, I had to deduce exactly how and when to reward/punish Albert to get him to take steps, so for this video, I used that same reward function to encourage Albert to continue taking steps, just with one additional punishment; punishing Albert when he stands too still. I’ll get into why I had to add this reward in a couple of paragraphs. The reason we have levels for Albert that increase in difficulty is because if we were to throw Albert onto the escalator with only his knowledge of walking, he would have no hope of coming even close to getting through the course since he would need to learn many very complex motions to make even a little bit of progress.
    Also, I just made a community discord server! If you want more updates on Albert and learn more about exactly how he works (and just talk AI in general), make sure to join! discord.gg/jM2WkNuBnG :)
    The first level is as simple as we can make it; just a few single steps. These steps are designed specifically to make Albert trip, that way he’ll eventually learn to associate detecting the step with a new environment that needs a different behavior. Albert (and reinforcement learning agents in general) tend to learn to do whatever is easiest while still improving their scores. In this case, Albert originally realized it’s easy to just stop walking and stand still when he detects a stair, and when he does that he no longer trips and falls over the stairs, so just standing still is the easiest way for him to get a higher score. That’s why we added the additional punishment for standing still, we pushed him so he stops getting stuck in that local maximum reward. After doing that he was much more willing to try to step over the stairs and sure enough, after a bit of time, was able to do it consistently.
    OBSERVATIONS
    As mentioned above, we give Albert the same information we gave him in the walking video (limb positions, rotations, velocities etc.), except this time we give him 2 additional observations in the form of sensors coming out of his feet to detect stairs in front of him. Giving him these 2 new observations means I had to retrain Albert’s walking from scratch with 2 additional null inputs, then continue the training on this new brain, since otherwise there wouldn’t be any room on the input layer to give him the sensor data. Thankfully, since the walking behavior had a very carefully modeled reward function and I didn't need to record the training, it didn't take long for my computer to train it again from scratch (about 45 minutes). Adding new observations to this stair-climbing brain would be much more laborious since I would need to train each room at a time. While the walking AI didn’t actually need all the rooms to train properly, this one did.
    FINAL CHALLENGE
    The final room was very hard for Albert and unfortunately I ran into a big issue I didn't anticipate. I realized too late that since Albert is only given the distance to the ground under his feet and the distance from his feet to the stairs in front of him (if there are any), he isn't able to differentiate normal stairs and the escalator, but the motion required is very different, so it makes it impossible for him to only use one brain. I didn't plan on making him go up an escalator, that was an idea I had later on in the development, and because of that, in the final run he actually uses 2 different brains, he uses his main stair brain until he hits the escalator, then uses the escalator brain, then when he reaches the top of the escalator, I swapped it back to his main brain. There is definitely a way to have one brain work for the entirety of the final room, all that's needed is to give him an extra observation of whether or not the stair in front of him is moving, that would have trained the escalator behaviour into the main brain, unfortunately I just didn't have time to re-train everything to make this work, since it already took 3 months to make the video lol.
    We're looking to hire people to help make these videos! If you're a talented Unity game developer you can apply for a full time position here forms.gle/ko54z1LQmZNUT9Vp8 And if you're a talented AI developer (ML-Agents), you can apply here! forms.gle/Uou1Vwb5Q9VccaAY7 We're looking for full time employees, but part time works too, what we're really looking for are skilled and passionate people, so feel free to apply if you're interested! :D
    Thanks so much for reading and watching!

  • @wackjallace
    @wackjallace Před 3 měsíci +2120

    I cannot wait til we get to the point where Albert is put in an open world and is given a list of quests and adventures

  • @Phroghetti
    @Phroghetti Před 3 měsíci +3382

    Us: Robots won't take over because we haven't given them a reason to
    Also us: *Alberts in a lot of pain right now*

  • @Franwow
    @Franwow Před 3 měsíci +749

    Can we get a "Albert learns to backflip"?
    That is clearly his dream, we would love to see it as (virtual) reality.

  • @blazryvlogs2535
    @blazryvlogs2535 Před 2 měsíci +149

    This man did what no one else could
    He made a sponsored segment actually enjoyable to sit through

    • @schizoposter1499
      @schizoposter1499 Před měsícem +2

      This was a first for me

    • @DefinitelySpirit
      @DefinitelySpirit Před měsícem +4

      I'm not gonna lie more sponsors should be formatted this way. The subway surfers mentality isn't always too bad.

    • @enzogabrielmoraes3660
      @enzogabrielmoraes3660 Před 14 dny

      ​@@DefinitelySpiritWHAT DO YOU MEAN, I FUCKING HATE SPONSORSHIPS WITH ALL MY FUCKING BURNING FUCKING PASSION

    • @_sola1re_
      @_sola1re_ Před 5 dny +2

      @@enzogabrielmoraes3660 lol?

    • @Delibro
      @Delibro Před 4 dny

      Jay Foreman: Am I a lie to you?
      😀

  • @dr.criston9489
    @dr.criston9489 Před 3 měsíci +1646

    Fun fact, the binary code graffiti on the wall of the second stage spells out "help"
    Very humane AI living conditions, I see

    • @sixeleven637
      @sixeleven637 Před 3 měsíci +51

      Knew i wasnt the only one that noticed it

    • @sirjeff2396
      @sirjeff2396 Před 3 měsíci +96

      its seven lines so i think it might be h/e/l/p/ /u/s

    • @wolfsyncc
      @wolfsyncc Před 3 měsíci +47

      albert arg when?

    • @GigiBranconi
      @GigiBranconi Před 3 měsíci +14

      I wish I could help Dx
      Maybe Albert will one day save them all

    • @fireball787b
      @fireball787b Před 3 měsíci +32

      It says 'help us'. Im glad to see that im not the only one who checked it❤

  • @TangoCharlieWhiskey96
    @TangoCharlieWhiskey96 Před 3 měsíci +3577

    I’m a simple man. I see AI warehouse posted a new video of Albert learning, I click like.

    • @eastwoodclint6953
      @eastwoodclint6953 Před 3 měsíci +60

      im gonna massage my keyboard iofjgiojgiotiotihtrjboibtrhjiyhotskpafoghyekotgpyknpomnim,gpågkjhoitp,gjihokboihowpjgkothlår,vgotykhjy,vktohyktpkhptkgoåk,opfjg9065jh9å635jtrl kotn kt lkfmote,repltp5iy0965iu69ujkbopetkyhoeyjhopetmbioåetypjmhboptkbnopyrkj0+ptlhotåji0kr+tkhn0956ei6kh0´+tyk0+etjknh0ytk,hb0ytoknopytkhäoyxnptgjyphnåkytk0ojunykoåkojyijomynjimonkonkoyn,onyok,nk0rnk,rngmopnomiojm

    • @LittleSealPupper
      @LittleSealPupper Před 3 měsíci +7

      Smae

    • @alisonbomber6358
      @alisonbomber6358 Před 3 měsíci +1

      sameee

    • @Axoy2024
      @Axoy2024 Před 3 měsíci +7

      am a simpler man

    • @lolgoodbye8197
      @lolgoodbye8197 Před 3 měsíci +5

      Oh so where does that magical like button appear from? You gotta be a bit more complex like me, I click the video to be able to click the like button

  • @vixboi
    @vixboi Před 2 měsíci +39

    "If you beat everything, I'll let you out" DUDE YOUR'E GLADOS

  • @steeledminer616
    @steeledminer616 Před 25 dny +4

    That final walk though, that arm swing just makes the music even better

  • @WerstoftheWorst
    @WerstoftheWorst Před 3 měsíci +1272

    I'm so invested in Albert's development
    Also i like the idea of a person just casually doing a backflip to not fall on the stairs

    • @genericuser984
      @genericuser984 Před 3 měsíci +17

      it feels like something that would happen in Grappler Baki

    • @molten2010Again
      @molten2010Again Před 3 měsíci +8

      That happened as I was reading this comment. Wow.

    • @grokcaveman
      @grokcaveman Před 3 měsíci +12

      6:08 he ran into the wall and gave up lol

    • @asterlofts1565
      @asterlofts1565 Před 3 měsíci +2

      That reminds me of the Boston Dynamics robot called Atlas.

    • @gabrielv.4358
      @gabrielv.4358 Před 3 měsíci

      yesss

  • @heartisles
    @heartisles Před 3 měsíci +837

    Is no one going to talk about the simplicity and beauty of that sponsor placement? From the way it starts with the map of Albert's brain to make you think "What am I looking at?" right into the placement (with the lesson examples) of "You can learn this and more with Brilliant. Here's my code." Well done

    • @heartisles
      @heartisles Před 3 měsíci +1

      Also I've used Brilliant (free and premium versions) before. It's really neat and a wonderful service. I can personally vouch for it

    • @SphereBoxCube
      @SphereBoxCube Před 3 měsíci +38

      And it's not intrusive at all

    • @squadbroken962
      @squadbroken962 Před 3 měsíci +26

      Agreed, take note CZcamsrs 'cause that's how you do a sponsor RIGHT

    • @Chicken_o7
      @Chicken_o7 Před 3 měsíci +10

      I think it's very smart placement. It's in the background of Albert walking, so people have the incentive to watch the whole thing instead of just skipping it

    • @X-pqiryiwqo
      @X-pqiryiwqo Před 3 měsíci +6

      This is an absolutely brilliant way of showing you can do sponsor/ad in a non intrusive way! High respect for channel owner.

  • @muscasgames7143
    @muscasgames7143 Před 2 měsíci +6

    I hold my breath every time Albert gets close to his goal. This is more suspenseful than TV drama.

  • @ARTPLAYSGAMES86
    @ARTPLAYSGAMES86 Před 3 měsíci +66

    Two great things about this.... No annoying voice over. And good grammar.
    Both of those are overlooked these days imo.
    Amazing content! New subscriber here

    • @tritonis54
      @tritonis54 Před 2 měsíci +4

      How is voiceover a bad thing again ?

    • @pancakedev6
      @pancakedev6 Před měsícem +3

      @@tritonis54 because most voiceover nowadays is just MAKE SURE TO LIKE AND SUBSCRIBE AND SMASH THAT LIKE BUTTON!!!!! and then 900 hours of sponsorship and begging for subs

    • @tritonis54
      @tritonis54 Před měsícem +2

      @@pancakedev6 How dare they try to rentablise their activity. It also bring more humanity, help with the rythm, make it easier to explain and add details.

    • @pancakedev6
      @pancakedev6 Před měsícem +1

      @@tritonis54 i am having a stroke while trying to understand what this means

    • @tritonis54
      @tritonis54 Před měsícem +2

      @@pancakedev6English is not my mother tongue but come one, I perfectly know it was not *that* obscure.

  • @HelloTurbo
    @HelloTurbo Před 3 měsíci +477

    I’m so proud of Albert!
    Figuratively, he’s gone very far. But in a much more literal sense he’s still that same little back-flipping orange box with vacant eyes. :)

  • @oatmealcookie02
    @oatmealcookie02 Před 3 měsíci +292

    I love how Albert discovered his love for backflips in the process... also this is the best AD integration I seen for my twelve years of being addicted to youtube

    • @bendubz9000
      @bendubz9000 Před 3 měsíci +13

      Doing the worm when learning to crawl, and loving backflips, AIbert is a thrillseeker!

  • @nuriafabrega7410
    @nuriafabrega7410 Před 2 měsíci +2

    That video was so amazing! I was so happy to see a new video posted by you, I've adored all of them to pieces! And the way you showed your sponsor was the smoothest way I've ever seen any youtuber do it. Great job!

  • @YashvardhanMemoryTricks
    @YashvardhanMemoryTricks Před 3 měsíci +9

    I have been doing some research on reinforcement learning models for my AI classes and this video is a great excuse for me to enjoy the shenanighans of Albert in the name of research. I love AI warehouse ❤❤.

  • @Spasmission
    @Spasmission Před 3 měsíci +374

    Albert inspires me to learn artificial intelligence so I can make a family for him.

    • @Pingviinimursu
      @Pingviinimursu Před 3 měsíci +13

      Do it! You'll be so glad you did when you're done! :)

  • @Pingviinimursu
    @Pingviinimursu Před 3 měsíci +302

    That's probably one of the most effective sponsorships I've seen on youtube. Had I not already taken university courses on the topic, I might be tempted to check them out myself. Very rare that Brilliant sponsorships do that to me.

    • @phoenix402
      @phoenix402 Před 3 měsíci +35

      i guess you could say it was a.. *brilliant move*

    • @yangliu6901
      @yangliu6901 Před 3 měsíci +10

      @@phoenix402chess moment

    • @Mo_2077
      @Mo_2077 Před 3 měsíci +3

      @@phoenix402great one

  • @Henry00
    @Henry00 Před 2 měsíci +2

    Thank you for adding the complete run at the end, that makes it all the more impressive!

  • @chapteronefrog
    @chapteronefrog Před 2 měsíci

    I love how the narrator began this series so nice and compassionate to Albert and as time went on, they got progressively more critical and sadistic. It's a really interesting and clever kind of subtle storytelling, and I'm excited to see where it goes from here

  • @JeSuisMrCraft
    @JeSuisMrCraft Před 3 měsíci +555

    This channel rarely uploads and it takes alot of time and resources to get them done. Thank you for making these wonderful AI videos!

    • @eastwoodclint6953
      @eastwoodclint6953 Před 3 měsíci

      yes but i think my keyboard needs a massage i haven't given it a massage in like 6 minutes so yes im gonna massage it gtisbniningrvirginbeetnnegtodrngiortngbirnbhiotgrjnmbhiotrjbitrjbitjmitohmbjtihbtiohmbtiomgrbihyjiyjhmobgmpoyhoko,lbmgthyjioml,föbmäihjyootbgmfbhmtoi,bmhotmb, lkgdijnmoipgö,nkitymnbpogfmjiodtrlsf, bmöhtrkmf,lvöägkhopbdmrtfhioglvzdsöfnhjmfxodklbmdlgkbm oöfadjnbmopägmjhbioköldfbn+0p,ujposerjmhblötdkmhnölykoögxcmnbiödkgmn okbpyk,npå+gokn,påfg,bpogfknohnmgopijnkåpgdhojnk09kothjiut09pofjuh5åojh0åoypkjh0+kponopdtykjhobfgokjgowrpjigbk+opm,g+0trojbkpgtkhb0+dgrpkogvpotkhpetrs-al,bvpko

    • @eastwoodclint6953
      @eastwoodclint6953 Před 3 měsíci

      hm i think i need to massage my keyboard mmmmmmmmmmm jijgvitbtytjnyuytntbintngitenitnbneeingbgtiojtgiotgsiotntrijotriotrniot wenemenciosama nfviejbijbiojbietjbjjvijvrejgiejgijgijgorejgojbgoejbiotjbhitboitjbtibtinrijntjhbotkboptkbotjotrjnorjotrjorthmotj turip rjgiojhbotrjbiotjbmiojmbiorgjbmotibotgjboirjbiogjnoitrjojiojotrjbojtbiotrijmobtrkobtrobjmtrob

    • @jackwright2012
      @jackwright2012 Před 3 měsíci +11

      It takes about 300 hours for each video due to learn bots just as being dumb as newborn babies. The only difference is that learn bots remember. Not hating on anyone. Just the truth

    • @JeSuisMrCraft
      @JeSuisMrCraft Před 3 měsíci +1

      ​@@jackwright2012I do remember that this requires super strong CPUs, it's got to be really expensive

  • @gheee317
    @gheee317 Před 3 měsíci +107

    When he started hopping 2 stairs at a time at 11:22 I actually went "oh my god he's insane"

  • @Phenomenoia
    @Phenomenoia Před 3 měsíci +1

    The sound design in this video is incredible, great work!

  • @WeskerUmbrella4
    @WeskerUmbrella4 Před 3 měsíci +2

    We're so proud of you, AI-bert!
    Learning on your own, one step at a time ❤

  • @gabrielmoreno7112
    @gabrielmoreno7112 Před 3 měsíci +92

    "So Albert is in a lot of pain"
    Albert: *proceeds to die while flopped once again*

  • @amarasa2567
    @amarasa2567 Před 2 měsíci +1

    Love the sassy commentary, I can't resist watching another one of your videos when I eventually see one on my feed 😊

  • @moonwatcher164
    @moonwatcher164 Před 2 měsíci +11

    Episode 2834: Albert learns to care for children while his wife tries to divorce him

    • @oliverfife208
      @oliverfife208 Před měsícem

      It's not deep reinforcement learning
      It's just learning that cuts deep

  • @Psychodog_
    @Psychodog_ Před 3 měsíci +126

    I would really enjoy like a five hour video of just training footage. With barely any editing, just the stuff you recorded for the montage anyway. Would be great for studying or gaming. Everytime there's a break, you can look over at how far the AI has come. Anyway, quality over quantity. Great work from you!

  • @JustShotsForMeh
    @JustShotsForMeh Před 3 měsíci +165

    Albert is like a competitive gamer.
    The moment he feels any adversity, he just sends it and griefs all the way.

  • @un-event-ful
    @un-event-ful Před 3 měsíci +2

    I KNEW IT! This series had potential for some secrets and the binary on the wall in level 2 was perfect! I didn’t even catch it until watching it back a second time. Plus the ending was great too!

  • @A_Nerdian
    @A_Nerdian Před 2 měsíci +2

    Ive seen a LOT of Brilliant sponsors but I have never seen one like this where it just fits perfectly into the video where it just doesnt look like a cut in part and it caught me off guard. Very interesting.

  • @BioticBlitz
    @BioticBlitz Před 3 měsíci +185

    I've been here since the very beginning of albert's journey and it makes me SO PROUD TO SEE HIM IMPROVE! I think a really cool thing for him to try now would be learning to grab, push, pull and carry things! Maybe he has like a key he needs to take somewhere else or pull on a rope to open the door.
    No matter what he learns next I can't wait to watch!

    • @stanisawkrzyzaniaktheoviraptor
      @stanisawkrzyzaniaktheoviraptor Před 2 měsíci +4

      Oh that gives me another idea! Albert and his friends learn teamwork!

    • @shortndeadly9977
      @shortndeadly9977 Před 2 měsíci +4

      I was thinking it could be cool seeing him carry a glass of water and trying to not spill it while walking through obstacles.

  • @scorpioftw
    @scorpioftw Před 3 měsíci +118

    I loved the hidden "help us" message at 3:50 hahaha
    Nice easter egg!

    • @gaychinloong462
      @gaychinloong462 Před 3 měsíci +3

      Wait, that's "help us" in binary code? That's a cool detail

    • @The_Dr_Fate
      @The_Dr_Fate Před 3 měsíci

      the floor?

    • @Byzz2077
      @Byzz2077 Před 3 měsíci

      @@The_Dr_Fate no, the binary on the wall

    • @amemeadaykeepsthedepressio9761
      @amemeadaykeepsthedepressio9761 Před 2 měsíci

      I could be going insane but I think the floor also says help us

    • @Byzz2077
      @Byzz2077 Před 2 měsíci

      ​@@amemeadaykeepsthedepressio9761I think you are going insane /j

  • @goodguyguy5022
    @goodguyguy5022 Před měsícem +1

    That sponsorship was brilliant putting it in the middle so it doesn’t interfere with the video

  • @adlwilliams
    @adlwilliams Před 2 měsíci

    The editing on these videos is always superb

  • @schleepy6362
    @schleepy6362 Před 3 měsíci +41

    8:44 when in doubt, backflip out

  • @UnCommentator
    @UnCommentator Před 3 měsíci +51

    It would be interesting if the punishment for falling were based on how much a human would feel from a fall, like the speed of impact and such, so he learns to catch himself when he falls

    • @Twi_543
      @Twi_543 Před 3 měsíci +5

      Yep good idea

    • @Pingviinimursu
      @Pingviinimursu Před 3 měsíci +4

      I believe velocity and point of contact with a "damage mapping" based on where he hits himself would be enough to learn it. More damage from head, less from feet, etc.
      To make it even more accurate, the mapping could be a function of both velocity and point of contact, since at some speeds it's ok to catch yourself with your palms or even forehead, but not at higher speeds 🤔

  • @NeedsMoreBirds
    @NeedsMoreBirds Před 2 měsíci

    It’s neat seeing how he swings his arms to keep his balance while he’s going down the really big steps at the very end. His improvements are very impressive!

  • @chatfluo2022
    @chatfluo2022 Před 2 měsíci

    That's the best ad implementation I've ever seen. And amazing video by the way.

  • @reeceshugrue6167
    @reeceshugrue6167 Před 3 měsíci +149

    9:42 - 11:37 Albert doesn't need to hear all this, he's a highly trained professional!

    • @Holy-Crusader
      @Holy-Crusader Před 3 měsíci +8

      this comment is too underrated

    • @marvinarellano3087
      @marvinarellano3087 Před 3 měsíci +1

      *Residence cascade*

    • @asterlofts1565
      @asterlofts1565 Před 3 měsíci

      ​@@marvinarellano3087
      Half-Life reference. :)
      No, seriously, seeing how video games evolved, A.I. and many more things related to electronics and the virtual is amazing... in almost 30 years, these things have grown so much... and soon we will have massive virtual worlds (VR) or at least, that compete with the traditional games we know today in day. In addition, there are techniques from several years ago in computing/video games that are still used today, such as the flashing lights in Half-Life games.

    • @asterlofts1565
      @asterlofts1565 Před 3 měsíci

      ​@@theshortsbuster
      Hahaha, is Albert Freeman (LITERALLY, HE PURSUIT THE FREEDOM).

  • @fxrrari
    @fxrrari Před 3 měsíci +75

    3:24 I cant even backflip! Well done Albert!😂

  • @blacklistnr1
    @blacklistnr1 Před 3 měsíci

    The ad run was absolutely Brilliant!

  • @RaGodEgypt
    @RaGodEgypt Před 2 měsíci

    I love the dedication you put into these videos. Keep doing like this :D

  • @Tubeytime
    @Tubeytime Před 3 měsíci +36

    I'm so impressed at this little guy's ability to fall down and remain upright! Seeing him walk from a first person perspective would be very interesting.

  • @leighkenneally7969
    @leighkenneally7969 Před 3 měsíci +54

    2:19 "It's only up from here!" They say, as a set of downward stairs are literally on the screen lmao. Anyways I'm such a huge fan of this channel, keep doing what you're doing.

  • @Freequense
    @Freequense Před 3 měsíci +1

    Idk if its my aspect of view or your video but I learned how improving in life works. So inspiring man. Please keep up the great work.

  • @rupe6990
    @rupe6990 Před 2 měsíci +1

    Magnífico. Sois increíbles, he pasado un rato verdaderamente divertido con Albert 😂 esperaré por el siguiente vídeo. Felicidades, es un increíble trabajo, ¡ánimo equipo!

  • @Mr.Stizblee
    @Mr.Stizblee Před 3 měsíci +58

    I just want to say that I appreciate that you didn't interrupt the video with the ad.
    Keep up the good work and congratulations on the sponsorship!

  • @ethanlittlejohn2536
    @ethanlittlejohn2536 Před 3 měsíci +9

    "And they say *you're* the one being tested" is such a GLaDOS line

  • @Average_Guy_
    @Average_Guy_ Před 3 měsíci +1

    your by far the best deep reinforcement learning channel

  • @TehHomicidalPhone
    @TehHomicidalPhone Před 3 měsíci +2

    I don't know why but watching Albert climb the escalator makes me so proud and happy, all warm and fuzzy. I teared up a little ❤

  • @AllExistence
    @AllExistence Před 3 měsíci +28

    That final walk was really impressive.

  • @caspergaming9345
    @caspergaming9345 Před 3 měsíci +23

    10:22 I like how it can detect a square but it never draws a square

  • @jonathanbrown6439
    @jonathanbrown6439 Před 2 měsíci

    I love that last stair set down to the green button. The way Albert jumps down it is so human hahahah.
    It seems like all the individual obstacles he was trained on helped with all the rest too. Albert ended up super stable on the final obstacle course

  • @ZacharyStiles
    @ZacharyStiles Před 3 měsíci +2

    Probably the best integrated ad I've ever seen on CZcams 😂

  • @r_kinesis8860
    @r_kinesis8860 Před 3 měsíci +37

    babe wake up new ai warehouse video
    are you one person btw? i've been seeing a lot of content farms but the way you upload it feels like you're one person

    • @aiwarehouse
      @aiwarehouse  Před 3 měsíci +55

      I started off as one person but our team is starting to grow! I promise you though, the videos will never feel like a content farm, I have no intention of ever lowering the quality of our videos, I'll always just be trying to make them faster and better :)

    • @LordDragox412
      @LordDragox412 Před 3 měsíci +15

      " I started off as one person, but after implanting myself with A.I. you can call us *LEGION.* "

    • @The_Dr_Fate
      @The_Dr_Fate Před 3 měsíci

      ​@@aiwarehousecan u make a face reveal for u and ur team when u will have for example 1 million subs?

  • @felipecantarero3107
    @felipecantarero3107 Před 3 měsíci +35

    7:18 9yr old me on the mall:

    • @sethmichaelson1612
      @sethmichaelson1612 Před 3 měsíci +8

      And then you'll be pissed cause they ask you to use it correctly, which now that I think about it, they're right.

  • @RussianSpy4632
    @RussianSpy4632 Před 27 dny

    I really hope albert gets friend, rivals, and has a whole series with him as the main character. The Training arc goes crazy

  • @nickgirdwood3082
    @nickgirdwood3082 Před měsícem

    I love how there's CC for this repeating all of the written out text in the video. Redundant CZcams is great.

  • @lauraalba3564
    @lauraalba3564 Před 3 měsíci +75

    7:38 Looking at this FFW, looks like the staircase is going UP rather than DOWN xD
    As always, great work, for Albert making throught the obstacle course, and AI Warehouse for making it possible :) I wonder what will be Albert's next lesson.

    • @AquaQuokka
      @AquaQuokka Před 2 měsíci +6

      Glad I wasn't just seeing things

    • @amethyphoenix
      @amethyphoenix Před 2 měsíci +1

      @@AquaQuokka Welcome to the world of optical illusions

  • @seanthefurcorn4859
    @seanthefurcorn4859 Před 3 měsíci +47

    11:59 Bro got yeeted to space.

  • @CrazyZebra-fv4lp
    @CrazyZebra-fv4lp Před 13 dny +1

    wow smart sponsor cant skip or skip the vid because you wont take a brake from the main vid.

  • @andydataguy
    @andydataguy Před 3 měsíci

    That was such a great ad for brilliant! 👏🏾

  • @CtrlCe
    @CtrlCe Před 3 měsíci +14

    Albert’s pain is my source of energy.

  • @samariumproductions5287
    @samariumproductions5287 Před 3 měsíci +15

    the only sponsor that doesn't ruin the video

  • @EdgarXPlay
    @EdgarXPlay Před 2 měsíci

    Your videos are pretty cool, Im learning NN myself and its interesting to see how learning works from your videos. Hope to see some more of Albert's adventures :)

  • @FrozenBrawlStars
    @FrozenBrawlStars Před 2 měsíci

    Love the new editing style

  • @frostfar
    @frostfar Před 3 měsíci +17

    i still remember when little albert doed the worm break dance step, trying to walk... now hes chosing his hobbies... they grow so fast 🥰

  • @blakewhite3131
    @blakewhite3131 Před 3 měsíci +24

    Awesome way to integrate sponsors in a way that doesn't interrupt or impede the video in any way!! While also being prominent, visible and relating to the video. I love Albert, but I'm also impressed with how creatively you think.

  • @Haxihoovis
    @Haxihoovis Před 2 měsíci +4

    9:00 Albert's steps sync to the song "Fine" by Lemon Demon!

  • @CarsonG1017
    @CarsonG1017 Před 3 měsíci

    I love that the text has video game dialogue highlighting

  • @fusionneoseeker
    @fusionneoseeker Před 3 měsíci +28

    Congrats on the sponsorship with Brilliant! This seems like a perfect partnership for your content so I'm happy to see your channel getting recognition for the amazing high quality content you provide. That sponsorship segment was incredibly well done and made me want to sign up for a free trial. Thanks for inspiring learning and curiosity :)

  • @Kram1032
    @Kram1032 Před 3 měsíci +72

    First of all, that's one of the best sponsor message integrations I've seen: Just keep going with the content that just so happens to take place in the message
    Second, Albert is getting really good these days! Albert is walking really nicely in this one by the end.
    Still hoping to see some of the suggestions I've given in the past, like slippery floors.
    I think walking downstairs is generally harder than walking upstairs, so a downwards backwards escalator would also be a great addition.
    And slopes.
    Some randomization would also be good: It looks like Albert learned a more or less specific path over the rough terrain, rather than learning to deal with any rough terrain in general. So randomizing that terrain each time would presumably make him far more robust with that

  • @CrackThrough
    @CrackThrough Před 3 měsíci

    this is the best way ive seen someone handle a sponsor. i hope you get paid a lot for it

  • @dasmenschlp8705
    @dasmenschlp8705 Před 2 měsíci +2

    Babe wake up, new AI Warehaouse video just droped!!!

  • @andresolbach
    @andresolbach Před 3 měsíci +17

    That music is fitting perfectly at 9:09
    love it!

  • @TheserialdesignationNfan147
    @TheserialdesignationNfan147 Před 3 měsíci +22

    4:32 B A C K F L I P

  • @charmander3261
    @charmander3261 Před 3 měsíci

    Ok but we have to admit that those backflips are SICK.
    Also congrats on your first sponsor!

  • @RaizenandYour
    @RaizenandYour Před měsícem

    Glad this got another vid for Albert liking to backflip must have been the repeaters of walk with the push of other leg for walking

  • @tannerbean2273
    @tannerbean2273 Před 3 měsíci +11

    Bro Albert’s flipping skills are elite 3:24 3:50

  • @cryozen2467
    @cryozen2467 Před 3 měsíci +6

    I love how after a certain point, every time Albert almost fell backwards, he tried to do a backflip. I guess he learned that if you're going down, you gotta go down in style! ✨

  • @uchennaibeziako4226
    @uchennaibeziako4226 Před 2 měsíci

    Albert my lovee😭 i was literally so proud

  • @rothven
    @rothven Před 3 měsíci

    Amazing, especially at end) thank you)

  • @firebladee-sportsgirl
    @firebladee-sportsgirl Před 3 měsíci +93

    Albert doing sick backflip is always so funny to me.

  • @RandomationsOfficial
    @RandomationsOfficial Před 3 měsíci +5

    I love how Albert learns and grows just like a kid

  • @xXxXx-----xXxXx
    @xXxXx-----xXxXx Před 2 měsíci

    Albert is the best! I'm sure he can learn a lot more :)

  • @0Rookie0
    @0Rookie0 Před 3 měsíci

    This was thoroughly enjoyable! One thing I'd like to see, is the real time hours it took Albert to escape. He really was carving through those interactions!

  • @iceypumpkinhead
    @iceypumpkinhead Před 3 měsíci +4

    One must imagine Albert happy.

  • @mr.whimsic6902
    @mr.whimsic6902 Před 3 měsíci +70

    Nice sponsor integration, I wish more youtubers had theirs involved with the video itself, like how you did it.

  • @user-nq8wv9bn3y
    @user-nq8wv9bn3y Před měsícem

    I love your Chanel! Pls make more videos and quicker, I enjoy them soo much

  • @Rhigamer22
    @Rhigamer22 Před měsícem

    Sorry I’m a month late to comment but can I say, that I love Albert! He makes me smile and laugh when I watch the videos you make of him! Keep it up and hope to see more of Albert!

  • @wolfpearl2734
    @wolfpearl2734 Před 3 měsíci +7

    I really love how you can see the difference between his walking skills at the start of the video compared to the end. He's doing great!

  • @alexkingsley2364
    @alexkingsley2364 Před 3 měsíci +5

    You should teach Albert how to jump! He really wanted to backflip in the video, maybe he'd like to learn jumping?

  • @JohnnyTiscali
    @JohnnyTiscali Před 2 měsíci

    That sponsor integration was pretty smooth actually, I liked it!

  • @Hadeshy
    @Hadeshy Před 3 měsíci

    Wow, that was incredible. The way he was leaning forward and moving his arms in the escalator just like a human would actually do.

  • @Kappq
    @Kappq Před 3 měsíci +7

    Your channel destined for success. The video quality, Albert's engaging journey, clever easter eggs, entertaining music, and polished editing are the reason why I'm able to sit through a 10 minute video of an AI walking. Not to mention the brilliant (I'm sorry) sponsor placement. Kudos on the great work - keep it up!

  • @destructchronos3125
    @destructchronos3125 Před 3 měsíci +3

    2024: Albert learns about stairs
    2030: Albert learns to conquer de world

  • @ItzFarhanKhan9
    @ItzFarhanKhan9 Před 2 měsíci +6

    WE are just watching a child grow.

    • @Holy_Bible_Reads_Ai
      @Holy_Bible_Reads_Ai Před 20 dny +2

      That child is going to take over our old ways of understanding and life. Once it learns to walk down stairs

  • @yuplookdatsme
    @yuplookdatsme Před měsícem

    That's the most brilliant ad placent I've ever seen. Haha, the only time an ad didn't annoy me 😂