GradIEEEnt half decent: The hidden power of imprecise lines

Sdílet
Vložit
  • čas přidán 30. 04. 2023
  • Before the invention of CZcams comments, most people could make remarks that were slightly technically incorrect without fear of immediate public rebuke. The one exception was professors, especially if the classroom included an annoying student such as “Tom 7.” The invention of CZcams was doubly revolutionary: Now anyone can experience being a professor being corrected by an annoying student, but also, corrections can be made years after the fact, and at significant length, as the student cannot be told to “take this offline.” This video is such a lengthy correction and digression, and perhaps itself a fount of mistakes.
    Due to the esoteric detail and prodigious whiteboarding, it is almost a “Tom Academy” video. But since I grew a moustache to film it, it qualifies for the Main Sequence.
    Keywords: Gradient descent, half-precision floating point, linear operations, F=MA, rounding, exotic transfer functions, machine learning, MNIST, CIFAR-10, chess, fractals, Frobenius, cryptography, fluint8, Motorola 6502.
    For SIGBOVIK 2023.
    Paper, impenetrable code, etc.: tom7.org/grad/
  • Věda a technologie

Komentáře • 1K

  • @HBMmaster
    @HBMmaster Před rokem +1686

    he can't keep getting away with it

    • @PC_YouTube_Channel
      @PC_YouTube_Channel Před rokem +184

      I think I'm supposed to say "hey it's the rhythm haven guy"? But I always think of you as the conlang guy

    • @DemonixTB
      @DemonixTB Před rokem +18

      and yet he does

    • @32th
      @32th Před rokem +70

      @@PC_CZcams_Channel to me, he's the guy who taught me how floating point numbers work

    • @tom7
      @tom7  Před rokem +351

      who's gonna stop me... FROBENIUS??

    • @ShieldStop
      @ShieldStop Před rokem +49

      ​​@@32th jan misali and pannenkoek are better teachers than any of my professors(and tom7 but we're already here)

  • @Zebra_M
    @Zebra_M Před rokem +2092

    Sorry to hear your professor strangled you to death, glad you got better

    • @tom7
      @tom7  Před rokem +703

      He's still out there hoarding chaos emeralds

    • @jr637-1
      @jr637-1 Před rokem +64

      Tom7 was secretly the beginning of Dr. Robotnik’s villain arc.

    • @treyquattro
      @treyquattro Před rokem +38

      @@tom7 could be worse: could be chaos NFTs

    • @DamonGarfield
      @DamonGarfield Před rokem +3

      @@tom7 🤣

    • @TtEL
      @TtEL Před 8 měsíci

      @@treyquattro😂

  • @WhiteThunder121
    @WhiteThunder121 Před rokem +530

    "For all practical purposes it doesn't matter."
    "What about impractical purposes?"
    Thats the spirit i love.

  • @y.og.i
    @y.og.i Před rokem +2027

    the dopamine rush of tom 7 releasing a 55-minute video is unparalleled

    • @user-nj1qc7uc9c
      @user-nj1qc7uc9c Před rokem +84

      the dopamine rush of tom 7 releasing a 55-minute video is serialled

    • @miweneia
      @miweneia Před rokem +14

      its even more unparalled for me cause yesterday I craved some of his vids so I came here and rewatched a few, and he uploaded a brand new one right just after I went to bed!

    • @jumbledfox2098
      @jumbledfox2098 Před rokem +8

      i just got a big goofy grin

    • @NithinJune
      @NithinJune Před rokem +2

      YES

    • @ineverknowdoyou
      @ineverknowdoyou Před rokem +2

      same

  • @syncrossus
    @syncrossus Před rokem +645

    This is so genius it looped back around to being stupid, then back to smart, then back to stupid.

    • @tom7
      @tom7  Před rokem +434

      I should have done an odd number of loops :(

    • @ssj3gohan456
      @ssj3gohan456 Před rokem +122

      @@tom7 You'll see from an exhaustive search of all possibilities in the design space that there is no situation where it can loop an odd number of times.

    • @ryanm.9363
      @ryanm.9363 Před rokem +27

      ​@@tom7 honestly, this comment and the response to it were the best part of this entire video. Perfect payoff

    • @AiOinc1
      @AiOinc1 Před rokem +2

      I smell sbemail

    • @lucahighton9173
      @lucahighton9173 Před rokem +4

      Every suckerpinch video is like that. That's why it's so fun

  • @Kaiasky
    @Kaiasky Před rokem +1014

    I was just waiting in utter joy for "but we can't decide which instruction to execute, so we'll just do every single one and multiply 255 of them by 0" to drop. My favorite part of shader code is 'why branch when you could multiply by 0' and this is a delightful, horrifying project.
    I'm SHOCKED it can do an entire frame in 10 seconds.

    • @MarieCrossbow
      @MarieCrossbow Před rokem +38

      The "do all of them" reminds me of Stephen Wolfram's Ruliad 😂

    • @satibel
      @satibel Před rokem +76

      tbh if one were to write this in shader it would probably run at over 20 fps.

    • @Ben-do1bf
      @Ben-do1bf Před rokem +125

      My immediate reaction was "8 cores? Why only use 8 cores when you could force a poor GPU to do this for you?"
      The gpu only wants to play Monster Hunter why do we force it to do these tasks?

    • @Kavukamari
      @Kavukamari Před rokem +77

      Suckerpinch proves Math is a hammer for destroying problems indiscriminately

    • @squelchedotter
      @squelchedotter Před rokem +21

      This surprisingly is kind of how CPUs actually work at a hardware level

  • @ripvanwinkle6940
    @ripvanwinkle6940 Před rokem +76

    I saw someone describe this video as a "Terrifying perversion of computation" and I thought you'd be proud to hear that.

    • @tom7
      @tom7  Před rokem +16

      I’ll take it!

  • @lysikasaito
    @lysikasaito Před rokem +446

    "The Mandlebrot Set is the Radiohead of Fractals" I did a real spit-take all over my computer and am typing this as the water seeps in. Wish my computer a swell retreat into the afterlife.

    • @tom7
      @tom7  Před rokem +268

      If you don't water the computer, how will it grow?

    • @Jay_Tau
      @Jay_Tau Před rokem +11

      The battery will probably swell!

    • @NoNameAtAll2
      @NoNameAtAll2 Před rokem +4

      what's radiohead?

    • @rehorizon
      @rehorizon Před rokem +36

      @@NoNameAtAll2 nothing much, hbu?

    • @lysikasaito
      @lysikasaito Před rokem +4

      @@tom7 I thought we were trying to avoid unfettered computer growth!

  • @isaaclinn2954
    @isaaclinn2954 Před rokem +759

    The hardest I ever worked in college was when my professor told me that something wasn't possible. The pure spite powered me through. It's an amazing force for sure

    • @OscarSommerbo
      @OscarSommerbo Před rokem +145

      Like when my computer teacher insisted that "crashing the stack WILL harm the computer". I wrote a simple asm snippet that locked up the PC but left it unharmed in 10 minutes (It was intro to ASM). That teacher hated me and excused me from the entire module with top marks, muttering "I have nothing to teach this wiseass"

    • @float32
      @float32 Před rokem +3

      Well, was it possible? Or was he right?

    • @smiley_1000
      @smiley_1000 Před rokem +80

      ​@@OscarSommerbo And then everybody clapped

    • @freshtauwaka7958
      @freshtauwaka7958 Před rokem +12

      @@OscarSommerbo what did he even mean by "harm"?

    • @benjaminmiller3620
      @benjaminmiller3620 Před rokem +70

      Haha! Had similar: ASM class. Assignment is to write a simple machine code program to accomplish a task, but he would award an extra mark for programs close enough in size (I forget how many bytes), to his own reference program. I got mine 6 bytes smaller than his.

  • @willoww285
    @willoww285 Před rokem +237

    The question was: "Okay, thanks professor, so I understand the mathematical point that the transfer function must be linear but when we implement this on a computer we’ll use some approximation of the real numbers like IEEE-754 floating point, which doesn’t have all the mathematical properties that we’re assuming here like distributivity and associativity, so doesn’t this mean that the doesn’t necessarily hold? like you could in principle have a transfer function that was “linear” but nonetheless exhibited irreducible complexity because of rounding error or things like that, or in principle transfer functions based on values outside of the reals, like NaN and Inf? Plus what about -0? Actually are linear operations even differentiable because when you think about it, they all take discrete
    steps so it’s really …"
    (for those of you who don't want to go frame by frame through it, as I have)

    • @ihrbekommtmeinenrichtigennamen
      @ihrbekommtmeinenrichtigennamen Před rokem +32

      Raptor Pro Tip: You can use the comma and dot keys on the keyboard for stepping through videos frame-by-frame.

    • @efkastner
      @efkastner Před rokem +23

      one of the most glaring omissions in the mobile apps :(

  • @PC_YouTube_Channel
    @PC_YouTube_Channel Před rokem +235

    When Apr 1 came and went, I went through the five stages of grief over the lack of a Tom7 upload.
    Then the madlad uploads on May 1.

    • @tom7
      @tom7  Před rokem +213

      Happy May Fool's Day!

    • @lifthras11r
      @lifthras11r Před rokem +44

      @@tom7 Mayday! Mayday!

    • @Vaaaaadim
      @Vaaaaadim Před rokem +17

      It's the out of season April Fool's upload.

    • @Dong_Harvey
      @Dong_Harvey Před rokem +1

      That was the Tax joke

  • @0oh_no
    @0oh_no Před rokem +230

    I haven't understood anything for the past hour but i have never enjoyed something more

    • @tom7
      @tom7  Před rokem +140

      I'm okay with this

    • @SianaGearz
      @SianaGearz Před rokem +58

      I understood almost everything.
      I envy you. I'm in SO MUCH PAIN.

    • @tom7
      @tom7  Před rokem +57

      @@SianaGearz I'm also okay with this

    • @SedoKai
      @SedoKai Před 8 měsíci +10

      Tom's videos are awesome because the more you understand them, the more unreasonable they become.
      This is difficult to accomplish in practice, but when done correctly the entertainment value increases exponentially.

    • @hrishikeshaggrawal
      @hrishikeshaggrawal Před 4 měsíci

      gahahaha

  • @patroka
    @patroka Před rokem +124

    *Raises hand* Actually, technically, we didn’t murder you in cold blood. Rather, we murdered you in pretty hot blood.

  • @Wyatt_James
    @Wyatt_James Před rokem +575

    This feels like a victory lap of many prior Tom7 videos. Congrats!
    Now it's time to train an AI model to approximate the NES CPU, no?

    • @bigprovola
      @bigprovola Před rokem +28

      The Tom VII cinematic universe is real 🤯

    • @pafnutiytheartist
      @pafnutiytheartist Před rokem +6

      I'd start with Atari 2600, it has a tiny amount of RAM, should be easier

    • @evanbarnes9984
      @evanbarnes9984 Před rokem +3

      ​@@pafnutiytheartist I can't believe anyone managed to make working games for the 2600, it's such little RAM!

    • @vurpo7080
      @vurpo7080 Před 11 měsíci +3

      @@evanbarnes9984 The differencw between then and now is that back then, all your code, graphics, sound and everything was in ROM on the cartridge. RAM would _only_ be used to store the changing state of the game, like player and object positions, score, and such. So if you imagine a game where you just have a player, a few non player characters, maybe an object or two, you might find that it just takes a few bytes to keep track of the state!

    • @kargaroc386
      @kargaroc386 Před 11 měsíci +6

      Atari 2600 is tiny, but the code in atari 2600 games is so precisely written that if you sneeze on it it breaks completely.
      The 2600 had CPU-drive graphics. And I don't mean like the ZX80 where games would write to VRAM at their leisure, and then later on the CPU would push those VRAM bits out to the screen - the 2600 doesn't have enough RAM for that.
      No, I mean that, when it came time to draw the screen to the TV, a 2600 game would *use game logic to render a scanline of graphics in real-time as the beam crosses the screen.*
      It would do this for every scanline. It would use most of the CPU's time (leaving the vblank period for higher level game logic, a reversal of the typical arrangement), and if code wasn't tuned perfectly it would completely break. There wasn't enough RAM to do anything else, nothing ever did anything like that ever again, and its one of the craziest ways to render a game ever conceived.
      Meanwhile, anybody who's watched a Vinny corruption stream knows how much you can break an NES game and still have it keep on going.

  • @adsilcott
    @adsilcott Před rokem +118

    I've had a beef with the way epsilon is used in programming for a while, so I was already laughing when you started complaining about it, then lost it when you revealed that you wrote a whole paper on the topic. The paper was delightful, as usual, and now I have something to send to people who I have petty internet arguments with -- oh sweet vindication!

    • @tom7
      @tom7  Před rokem +48

      That's what I call pedantry teamwork!

  • @empty5013
    @empty5013 Před rokem +354

    I really love being a bit lost on a new concept for a minute or so, then touching base with a concept I am familiar with, only to see Tom totally abusing and doing evil things to the 5% of the greater whole I understand.
    Really keeps me reassured that despite the calm demeanour and pretty diagrams, even the parts I don't understand are pure evil and crimes against numbers.

    • @tom7
      @tom7  Před rokem +140

      Technically, numbers could sue me in civil court, but it is not a crime.

    • @DuringDark
      @DuringDark Před rokem +15

      misdemeanors against numbers, maybe disorderly conduct?

    • @ts4gv
      @ts4gv Před rokem +7

      @@DuringDark disorderly conducts a good one lol
      i'd also add libel and slander to the the list of charges

    • @JuDGe3690
      @JuDGe3690 Před 20 dny

      ​@@ts4gvAdd intentional infliction of numerical distress to the list.

  • @alexmueller7864
    @alexmueller7864 Před rokem +378

    Tom, you are my hero. I am inspired by your tenacity in pursuing problems simply for the heck of it. Watching your videos makes me want to write math papers about equally ridiculous topics.

    • @tom7
      @tom7  Před rokem +165

      Thanks! You should do it!

  • @timmydoza
    @timmydoza Před rokem +181

    Fun fact about the newest version of Stockfish (15.1) - it no longer uses pawn values in the evaluation. From the changelog:
    "An evaluation of +1 is now no longer tied to the value of one pawn, but to the likelihood of winning the game. With a +1 evaluation, Stockfish has now a 50% chance of winning the game against an equally strong opponent. This convention scales down evaluations a bit compared to Stockfish 15 and allows for consistent evaluations in the future."

    • @efkastner
      @efkastner Před rokem +31

      Kind of like the gold standard

    • @stdcall
      @stdcall Před rokem +29

      inb4 keynesian pointnomics

    • @tom7
      @tom7  Před rokem +55

      Whoa!

    • @ts4gv
      @ts4gv Před rokem

      @@efkastner haha

  • @lepi9577
    @lepi9577 Před rokem +239

    Just incredible stuff. Absolutely heretical behavior

    • @tom7
      @tom7  Před rokem +111

      That's why we call it the Association for Computational Heresy!

    • @_fudgepop01
      @_fudgepop01 Před rokem +5

      @@tom7the acronym is equivalent the sound I make when watching these amazing videos and getting my mind blown - ACH!!

  • @AlphaPhoenixChannel
    @AlphaPhoenixChannel Před rokem +94

    literal spit-take at "maybe we should do this on the computer." - although I started to follow it a bit less at the computer implementation, I enjoyed every second

    • @kyay10
      @kyay10 Před rokem +12

      I wish to see you getting nerd-sniped by this and somehow do floating point maths with analogue waves or something, maybe even build a whole (super basic) computer using the weird differentiator and integrator components.
      As a starting seed, note that you can get ln through integrating 1/x, and through ln you can get abs(x), and through that you can practically make arbitrary circuit.
      Don't know how useful or practical this is, but hey, maybe you end up discovering something video-worthy.
      I have some more ideas btw, mainly stemming from trying to (ab)use Desmos to define Boolean algebra and, hence, to create functions for equality and less than etc so that I'm able to define piecewise functions without any piecewise notation. I'd share a link to that here but CZcams is fussy about links.

    • @efkastner
      @efkastner Před rokem +4

      @AlphaPhoenixChannel I’m so delighted to see you here. The venn diagram between your content and Tom VII’s is the best of all

    • @hadinossanosam4459
      @hadinossanosam4459 Před rokem +1

      @@kyay10 Side note: you don't need to integrate 1/x (analog integrators sorta suck), a BJT's transfer functions gives you exponentials (and logarithms via negative feedback). That's actually a somewhat standard trick, e.g. to get root-mean-square averages in an analog way. Analog computers were/are a thing, just that noise+imprecision limits the amount of stages you can cascade, and therefore the amount of cool stuff you can practically do
      And getting piecewise linear functions is pretty easy with step(x) = abs(x)/x ;) Used tricks like this to write text as graphs of functions on my calculator in boring math classes, the fun part is getting two lines above each other (interleaved with sign(sin(N * x)) or so)

    • @AlphaPhoenixChannel
      @AlphaPhoenixChannel Před rokem +6

      @@efkastner I feel really smart when I understand the multitude of jokes in a video on this channel =D This one had me in stitches until the last act when I could tell he was over my head. I sent this video to multiple people before I was done watching it. Tom, if there's ever a brilliantly impractical project you need something built IRL for, hit me up - I know I can't compete on the code side ;)

    • @thomascole2933
      @thomascole2933 Před rokem

      @@AlphaPhoenixChannel An AlphaPheonix and tom7 collab video would be the pinnacle of my life. It would all be downhill from there no doubt.

  • @heitortremor
    @heitortremor Před rokem +63

    New suckerpiiiiiinch!!!

    • @binaryrainbows
      @binaryrainbows Před rokem +4

      new suckerpinch!!!!!

    • @TheCrewExpendable
      @TheCrewExpendable Před rokem +2

      Just now realizing it’s Suckerpinch and not Suckerpunch.

    • @LeoStaley
      @LeoStaley Před rokem +2

      Let's gooooo!!

    • @ts4gv
      @ts4gv Před rokem +3

      nnneeeewwww suuuccckkerpinnnnchhhh
      in a wrestlemania announcer voice

    • @organicwaste
      @organicwaste Před rokem +3

      (distributing cold ones to the cheering crowd)

  • @adora_was_taken
    @adora_was_taken Před rokem +47

    tom7's professor was dr robotnik vii and i think that explains a lot

    • @tom7
      @tom7  Před rokem +33

      Right after he killed me he took my chaos emeralds right out of my backpack :(

    • @snoozbuster
      @snoozbuster Před rokem +14

      "I miss my wife, Tom"

  • @gameofpj3286
    @gameofpj3286 Před rokem +58

    The running every instruction on copies of the state and then only keeping the right one is definitely reminiscent of quantum bogo sort :D

  • @masscreationbroadcasts
    @masscreationbroadcasts Před 8 měsíci +11

    40:33 "Wait, did I already write this paper? Damn it!"
    Comedy gold right there.

  • @Snort70
    @Snort70 Před rokem +24

    "We want it to be able things that are complicated like XOR or human thought"
    Idk why this made me spit out my water laughing

  • @coarse_snad
    @coarse_snad Před rokem +95

    I cannot even describe the positive impact these videos provide throughout the years. Every april i am enlightened with suboptimal solutions to problems noone has.

    • @siarez
      @siarez Před rokem +5

      " suboptimal solutions to problems noone has." hahaha

  • @Kaiasky
    @Kaiasky Před rokem +64

    So, one theoretical result of this is that, pretending we're working with reals for a second, you could multiply all of these linear operations out into one single matrix, right. Obviously, multiplying by the matrix does absolutely nothing, but It'd be kinda fun to see what the "NES emulator state transition matrix" ends up looking like.

    • @stanleydodds9
      @stanleydodds9 Před rokem +15

      I would guess that a lot of the operations will turn out to just be the zero function, or just some small constant, because a lot of the time we are trying to eliminate everything except for the error (in order to magnify it and use it). But by doing that with precise linear operations, everything would exactly cancel out. It's hard to know if this would eventually result in the overall matrix being the zero matrix, or just some very degenerate matrix, or maybe I'm completely wrong in assuming this at all.

    • @Kaiasky
      @Kaiasky Před rokem +6

      @@stanleydodds9 Yeah, I'm guessing that the instruction selector manages this, because it's zero-everywhere disregarding floating point error

  • @YouReyKarr
    @YouReyKarr Před rokem +75

    I love that I feel I understand the individual steps he's taking and the results, but I never understand what the premise of the video actually is. Yet still some of my favourite content on CZcams

    • @SianaGearz
      @SianaGearz Před rokem +22

      The premise is to make something impractical by abusing the inherent non-linearity of floating point hardware to perform operations that fundamentally shouldn't work.

    • @YouReyKarr
      @YouReyKarr Před rokem +15

      @@SianaGearz It was rhetorical, but thanks

  • @AntiVectorTV
    @AntiVectorTV Před rokem +13

    "Cryptography = fractals - drugs"
    I love the way your brain works.

  • @RobertMilesAI
    @RobertMilesAI Před rokem +10

    Because I know you appreciate pedantry (and maybe this was deliberate), the phrase "in cold blood" means the crime was done in a calm/systematic/premeditated way. The murderer was cool and/or chill at the time. Getting so frustrated that you snap and strangle a student is definitely a murder in hot blood, not cold

    • @FelixHdez
      @FelixHdez Před rokem +1

      If I were suckerpinch I'd hide this comment

    • @tom7
      @tom7  Před rokem +12

      It's because my professor was a reptilian

  • @snoozbuster
    @snoozbuster Před rokem +26

    The floating point errors used here remind me of another April fool's research piece, pannenkoek2012's "How to Crash SM64 using a pendulum". An excellent watch as well!

    • @user-gr1vv4pk2i
      @user-gr1vv4pk2i Před rokem +6

      Yeah that was a pretty interesting coincidence, I doubt they were aware each other's videos were in production simultaneously.

  • @keiyakins
    @keiyakins Před rokem +30

    that gag of mimicking the Practical Engineering intro got a genuine laugh outa me

    • @1224chrisng
      @1224chrisng Před rokem +5

      too much concrete and acrylic, not enough hello fresh, 3/5 stars

  • @TheAqissiaq
    @TheAqissiaq Před rokem +39

    I was actually just at an academic conference where a similar problem was discussed! (The paper is Model Checking Linear Dynamical Systems under Floating-point Rounding at TACAS 2023)
    The authors want to verify certain linear programs, but find that with rounding it is undecidable for the same reasons as Tom: They can construct a computer. Their computer is a Turing machine, which I think we can all agree is much simpler than the NES, but it's the same idea.
    They go on to show that restricting the programs to non-negative coefficients makes the problem decidable again, because it forces the behavior to be somehow periodic.

  • @phrygianphreak4428
    @phrygianphreak4428 Před rokem +5

    This video reminded me of something learned, but have since forgotten, during my time in the CS dept:
    Never stop listening when the PhD is talking. If you do, even for a minute, you will be completely lost.

  • @nagoshi01
    @nagoshi01 Před rokem +7

    "The Mandelbrot set is the Radiohead of fractals"
    I.. uh... Ok, sure.

  • @bassguitarbill
    @bassguitarbill Před rokem +21

    The 3d Mandelbrot set had me ugly laughing, this video is magnificent

    • @lancesmith8298
      @lancesmith8298 Před 7 dny

      The true majesty of it didn’t dawn on me until today, when I actually paid attention to the zoom-in. On top of being a cursed artifact to render, it’s also inexplicably made up of beans

  • @foul-fortune-feline
    @foul-fortune-feline Před rokem +30

    Love your videos.
    They're just far enough outside my knowledge base I have to stretch my brain to understand what's going on. But when I figure it out it always is delivered with something approximating comedic timing, and I squeal with mischievous delight.

    • @tom7
      @tom7  Před rokem +16

      That's pretty much what I'm going for, so thank you! :)

  • @WangleLine
    @WangleLine Před rokem +23

    this really descends my gradients

  • @snowleopard9749
    @snowleopard9749 Před rokem +6

    I admire your persistence to replicate important results, but worse.

  • @vitorfray
    @vitorfray Před rokem +214

    Is it normal to feel like a complete illiterate while watching this? That math is out of this world, and yet he explains it like it's trivial stuff!

    • @catmacopter8545
      @catmacopter8545 Před rokem +20

      he took neural nets in college and so on and so forth

    • @soranuareane
      @soranuareane Před rokem +60

      I've been doing computer science for longer than I care to admit. I teach (privately), I write a ton of code, I love zany nonsense, and that's just the tip of the iceberg.
      I, too, had difficulty understanding this (and I teach the damn stuff!)

    • @satibel
      @satibel Před rokem

      it's not regular bullshit, it's advanced bullshit.

    • @Reptonious
      @Reptonious Před rokem +12

      I never know with this channel, as a tech illiterate, if something will be made with me in mind. And worse yet it usually won't be clear until halfway through. Genuine criticism of the format.

    • @samuelthecamel
      @samuelthecamel Před rokem +24

      He probably wanted to explain it more thoroughly but couldn't because the video would be over 2 hours

  • @eragonawesome
    @eragonawesome Před 5 měsíci +4

    "Yes it won't work, but we can just do it!"
    Brilliance

  • @Ben-do1bf
    @Ben-do1bf Před rokem +41

    I had the realization yesterday "Wait, April 1st and SIGBOVIK passed without a new tom7 video", and checked the channel to confirm my fears, so I guess I willed this into existence you're welcome.

    • @NoNameAtAll2
      @NoNameAtAll2 Před rokem +2

      what's sigbovik?

    • @screwaccountnames
      @screwaccountnames Před rokem +8

      @@NoNameAtAll2It‘s a non-serious mathematical conference, happening every April 1st.

    • @kaitlyn__L
      @kaitlyn__L Před rokem +3

      @@screwaccountnames well, it’s serious maths, just used in silly ways ;)

    • @Ben-do1bf
      @Ben-do1bf Před rokem +3

      @@kaitlyn__L Oh plenty of people find ways to write whole papers on things that are purely non-serious. It makes finding the ones with serious math for pointless reasons that much more worth it.

    • @kaitlyn__L
      @kaitlyn__L Před rokem +2

      @@Ben-do1bf exactly! :D

  • @OrangeC7
    @OrangeC7 Před rokem +4

    Someday, you're going to say "This is ill-advised, but nobody is stopping me," and you're going to crash the simulation. I can feel it

  • @alengm
    @alengm Před rokem +4

    "He's like howtobasic but smarter" - a friend when I showed him one of your videos

  • @lydianlights
    @lydianlights Před rokem +6

    Oh god I haven't watched the video yet but I can only imagine the roller coaster I'm about to embark on based on the title alone...

    • @lydianlights
      @lydianlights Před rokem +4

      40:11 omg I literally yelled "noooooo!" in the most pained voice at this part lmao. Pretty sure I scared my cat.

  • @evanbarnes9984
    @evanbarnes9984 Před rokem +33

    I actually had no idea how to compare floats or doubles and really needed that for a recent project, so I'm already lost down a rabbit hole having paused the video 8:00 minutes in. (Programming is just a hobby for me). Exactly what I love about your videos!
    Edit: 25 minutes in, and the baffling numbers are awesome as an ex math teacher! The Bafflebrot is great

    • @jamesflames6987
      @jamesflames6987 Před rokem +16

      FOR GOD'S SAKE DO NOT USE THESE TECHNIQUES IF YOU ARE LEARNING PROGRAMMING.

    • @limyongchin1
      @limyongchin1 Před rokem +3

      @@jamesflames6987 I love how there's an actual need for an actual disclaimer

    • @chainingsolid
      @chainingsolid Před rokem +3

      What you do for comparing will depend on your specific problem. Most cases = < > work fine and == has, well gotchas

    • @jamesflames6987
      @jamesflames6987 Před rokem +4

      @@chainingsolid

    • @evanbarnes9984
      @evanbarnes9984 Před rokem

      ​​@@jamesflames6987 don't worry, I was already fully aware of the problems of floating point math in programming, and had solved that previous problem by going down a really convoluted path with integer math. I'm not doing stuff with money or anything super critical though, I'm slowly trying to make my own paragliding flight instrument, which means figuring out sensor fusion with a 9-axis IMU, GPS, barometer, thermometer, and eventually a Pitot tube for airspeed. Because I want to learn how it all works, I'm trying to do it all from scratch, writing my own Kalman filters or whichever type I go with, for example. There will be regions of this project where making somewhat fuzzy comparisons of floating point numbers will be useful and sufficiently accurate. That's an excellent warning for people who aren't aware of the pitfalls of float math, though!

  • @yoyoyonono
    @yoyoyonono Před rokem +28

    Always looking forward to the yearly sigbovik video. I'm honored to be published alongside you in this year's conference.

    • @efkastner
      @efkastner Před rokem +1

      wow congrats! what was yours?

    • @yoyoyonono
      @yoyoyonono Před rokem +3

      @@efkastner VOACaloid, the first paper in track M

    • @efkastner
      @efkastner Před rokem +1

      @@yoyoyonono haha well the Abstract has me hooked, can’t wait to read it later :)

    • @yoyoyonono
      @yoyoyonono Před rokem

      @@efkastner thank you!!

    • @tom7
      @tom7  Před rokem +6

      Thank you for not trying to predict the future!

  • @regularsalamander
    @regularsalamander Před rokem +17

    TWO VIDEOS IN THE SAME YEAR?

    • @tom7
      @tom7  Před rokem +5

      I'm not sure! I didn't get much sleep last night!

    • @user-gr1vv4pk2i
      @user-gr1vv4pk2i Před rokem

      ​@@tom7 Get some rest! You deserve it

  • @clashblaster
    @clashblaster Před rokem +6

    "the Mandelbrot set is the Radiohead of fractals" wiser words have never been spoken

    • @RobertMilesAI
      @RobertMilesAI Před rokem

      I like that absolutely no elaboration or justification of that statement was given or in fact needed

  • @Templarfreak
    @Templarfreak Před rokem +5

    there's a _lot_ of good qoutes in this one. here are some of my favorite:
    "and if i scroll all the way to the bottom, i can see that my results are in fact the worst results of all time. aw well that's not _too_ bad."
    "my professor was wrong, you in fact CAN do this as long as you dont need it to be good or fast."
    "and basically it's the same as before but more careful about intermediate computations so that it doesnt touch infinity by accident."

  • @janberentsen9890
    @janberentsen9890 Před rokem +3

    You know that saying "If you can't dazzle someone with your brilliance, baffle them with your bullshit"?
    This is both.

  • @skylerlehmkuhl135
    @skylerlehmkuhl135 Před rokem +4

    Making complex machines out of slight differences in behavior is very reminiscent of how computers themselves work, with small differences between electron propagation in various silicon impurities being combined in complex ways to produce integrated circuits.

  • @devjock
    @devjock Před rokem +54

    The only person that can make both computer scientists and computer science teachers reee into high supersonic range. They only harmonise when Tom's not in the room.

  • @TankorSmash
    @TankorSmash Před rokem +9

    Oh man, the procrastination tax comment really speaks to my soul man. Super interesting video!

  • @jukmifggugghposer
    @jukmifggugghposer Před rokem +7

    The pure joy I felt when you pulled up that chess matchup chart...

  • @Ikkepop
    @Ikkepop Před 2 měsíci +2

    You are one of the few youtubers who's videos just tickles me pink. I adore how far you go to make technology do stupid impractical things.

    • @tom7
      @tom7  Před 2 měsíci +2

      Thanks! That’s the suckerpink brand promise!

  • @AngryArmadillo
    @AngryArmadillo Před rokem +17

    Enjoyed seeing you present at SIGBOVIK this year. You come up with the craziest stuff :)

    • @tom7
      @tom7  Před rokem +6

      I'm glad! That was a very last-minute presentation!

  • @rayflyers
    @rayflyers Před rokem +4

    RIP, Tom 7. ...20 years ago, apparently. 😢

  • @duncathan_salt
    @duncathan_salt Před rokem +6

    mr. 7, one day i am going to create a computer as ridiculous as one of yours. you're a true inspiration, and in fact your printable C project encountered many of the same problems as my planned project will. one day i hope i can show you

    • @tom7
      @tom7  Před rokem +6

      Happy to hear I could inspire you! The world needs more crazy computers. Consider sending it to SIGBOVIK when you're ready :)

  • @khatharrmalkavian3306
    @khatharrmalkavian3306 Před rokem +8

    So that's what happened to Tom 6...

    • @1224chrisng
      @1224chrisng Před rokem +1

      He was afraid of Tom 7, because Tom 7 ate Tom 9

    • @ivanjermakov
      @ivanjermakov Před rokem

      @@1224chrisng what happened to TomCat?

  • @andriypredmyrskyy7791
    @andriypredmyrskyy7791 Před rokem +4

    I can't believe there's YET ANOTHER entry in the extended chess AI cinematic universe!

  • @55jeb
    @55jeb Před rokem +37

    Christmas has come early this year. Tom7 videos are the best on CZcams: theatrics and fun concepts!

  • @wrong1029
    @wrong1029 Před rokem +17

    the AI art really adds to the comedic effect, love it

    • @Fynmorphover
      @Fynmorphover Před rokem +2

      I would have thought it would have been controversial by some people

    • @timmccormack3930
      @timmccormack3930 Před rokem +4

      Agreed. This is the first time I've seen AI art used well. This is what it's *for*.

    • @EggBastion
      @EggBastion Před rokem +4

      28:16 HACERR / ACCESS GRANTED
      37:12 plain crash / ACCESS GLARDED
      46:39 hands holding hands

  • @silverymoonthing
    @silverymoonthing Před rokem +2

    the phrase "I like to work at the intersection of theory and impractice and practice and entertainment" is my new life slogan, thank you

  • @chasebrower7816
    @chasebrower7816 Před rokem +3

    Always my favorite math/compsci videos. Highly informative but extremely fun to watch from start to finish.

  • @jlco
    @jlco Před rokem +9

    I _aspire_ to understand even half of this video. I can only assume that this man's name is where the word "tomfoolery" comes from.

  • @DemonixTB
    @DemonixTB Před rokem +10

    I've read the paper as soon as you published it and I could not wait for you to upload the video, it feels like a culmination of so many other projects and it's such a perfect tom7 video.

    • @tom7
      @tom7  Před rokem +5

      Great! There should be many crazy computers in the world. :) Send it to SIGBOVIK!

  • @jimhrelb2135
    @jimhrelb2135 Před rokem +4

    In the world full of distractions, you have managed to capture my attention for the full video. What a feeling I’ve not felt for quite a while. Take my video of the year award.

  • @MrPopeZilla
    @MrPopeZilla Před rokem +5

    I can already be sure this will be my favorite video of the year.

  • @AntiVectorTV
    @AntiVectorTV Před rokem +7

    I was impressed when you managed to turn these algorithms (heuristics?) into a silly way to play bad chess _again,_ and I was doubly impressed by how they actually managed to outperform most of the ones you made for that video!

  • @RikerLovesWorf
    @RikerLovesWorf Před rokem +1

    I was just thinking about your channel yesterday randomly, and how I always look forward to your videos.

  • @michaelcalvin42
    @michaelcalvin42 Před rokem +1

    Thanks for always doing these ill-advised but surprisingly entertaining projects. I can't even imagine the time it took to put all of this together.

  • @MM-cz8zt
    @MM-cz8zt Před rokem +3

    Wow! I've been in this field for over a decade. I did my graduate research in Applied ML. I've been to countless lectures and discussions on the topic... and this has to be one of my new favorite discussions of all time. What a masterful expose. Thank you for this!

  • @lucythebrazen
    @lucythebrazen Před rokem +3

    You are one of the most insane people I "regularly" watch, and I mean this in the most endearing, loving way imaginable ♥

  • @DocJade
    @DocJade Před rokem +1

    Im so happy whenever you release a new video, thanks for making these!!!!
    bending the limits constantly is hilarious :)

  • @Verrisin
    @Verrisin Před rokem +2

    This man will escape the matrix one day ...
    "Given the microscopic rounding errors in quantum mechanics, I have found a way to ..."

  • @johanngambolputty5351
    @johanngambolputty5351 Před rokem +3

    Should we use linear or non-linear functions?
    Tom: Yes

  • @Scum42
    @Scum42 Před rokem +7

    You are such an inspiration because you are living proof that there is no excuse for acting haughty and superior no matter how overwhelmingly intelligent or talented you are. You prove that there is no limit on intelligence where humor dies by turning incredibly stupid things into anything you desire, just because it's silly and fun.
    Thank you, Tom!

  • @iconi1355
    @iconi1355 Před rokem +1

    I watched an answers in progress video before this about how the youtube algorithm works and how sidecart recommendations are made to uphold a certain vibe. It was hugely nerdy, far from reality and very satisfying. The sidecart recommendations appear to be working

  • @eyeiaye
    @eyeiaye Před rokem +1

    Your content is the absolute best. Thank you for the countless hours of hard work for our hour of amusement!!

  • @KlausKlass
    @KlausKlass Před rokem +4

    LOL I'm a student at CMU right now and my prospective research actually involves neural nets, floating point numbers, and breaking up the computation into linear subproblems and cryptography. There's a good chance I'll reference your SIGBOVIK paper if they'll allow it...

    • @tom7
      @tom7  Před rokem +4

      How could they not allow it!? It's the world's most prestigious venue!

  • @MrJord137
    @MrJord137 Před 5 měsíci +3

    Desperately awaiting the next Tom7 video

  • @xavierdemers-bouchard2747

    I so love to see that notification about a new video from you. I shoo away my guests, get a drink and sit down for the entirety of the video. Thank you for your "work" on this subject

  • @RealChairNotFake
    @RealChairNotFake Před rokem +1

    Your videos are amazing. They're hilarious, they're unique, they're interesting. Please continue this impracticality extravaganza!

  • @cemacmillan
    @cemacmillan Před rokem +9

    I got suspended and shifted to non-college preparatory high-school for questioning Dr. W. over a technical imprecision (I was right of course), so all I can say is, man, I felt that, in the first skit.
    Strange to find myself laughing so much, at the subject material too, but not quite as strange as how relevant some of your work in imprecision seems based on what were learning about how to build better NN today.
    My intuition would have been that your linear NN would have done slightly worse than random before I thought about it really carefully. I'm still astounded by the image recognition test results in particular.
    Great video!

  • @vanderkarl3927
    @vanderkarl3927 Před rokem +3

    I can't believe it. He brought together like, the majority of his previous video-documented projects into one amazing piece of impracticality. Glorious.

  • @liv5645
    @liv5645 Před rokem +2

    No line in a youtube video has ever affected me like "This is the world's most boring Nintendo game ... You can't win it or even play it. It exists only to destroy your mind." in that style of delivery. I am in tears

  • @crckrbrrs
    @crckrbrrs Před rokem +1

    your videos are a beacon of information, entertainment and above all, impracticality. thank you for everything that you do.

  • @sorenwestrey4925
    @sorenwestrey4925 Před rokem +7

    Loved seeing this presented at SIGBOVIK this year!

  • @Finnnicus
    @Finnnicus Před rokem +3

    the mandelbrot set truly is the radiohead of fractals

  • @jacefairis1289
    @jacefairis1289 Před rokem +1

    the surreality of these videos really just washes over me as i watch them, like lying down on an alien beach as the tide comes in

  • @Charlieee1
    @Charlieee1 Před 7 měsíci +1

    I'm impressed by the amount of skill you have to present a complicated topic I don't understand (past the 10 minute mark), and make me enjoy an almost hour-long video, which I normally don't enjoy watching.

  • @jobjitdip6161
    @jobjitdip6161 Před rokem +4

    Don't let anyone strangle you ever again, please! You need to be protected at all costs!

  • @Dther99
    @Dther99 Před rokem +16

    I'm a struggling CompSci student. I post these videos to my group chat of friends. My friends are largely artists and labourers, who are the *opposite* of this video's target demographic. I don't know why I do it. Maybe I just want them to be as confused as I am.

    • @kaitlyn__L
      @kaitlyn__L Před rokem +4

      The real trick is finding artists who also love computer science

    • @Dther99
      @Dther99 Před rokem +14

      @@kaitlyn__L Unfortunately, artist-programmers tend to go insane, or worse, become game developers.
      source: me

    • @krallja
      @krallja Před rokem +2

      @@Dther99 “go insane, or become game developers, but I repeat myself.”

  • @noel.friedrich
    @noel.friedrich Před rokem +1

    unironically, this channel actually makes me want to learn this stuff in depth. thanks!

  • @jamesflames6987
    @jamesflames6987 Před rokem +1

    The algorithm sent me here because you said the word "vaporwave" and I'm so happy it did.

  • @NithinJune
    @NithinJune Před 2 měsíci +3

    our yearly suckerpunch video should be coming up soon

  • @Addoagrucu
    @Addoagrucu Před rokem +4

    tom i haven't watched it yet but i'm excited for the technical chicanery you have in store for us this time

  • @zombieassaultman
    @zombieassaultman Před rokem +2

    I swear, Tom could talk about literally anything at length and I would still be there every time. Great video as always.

  • @noseman123
    @noseman123 Před rokem

    I watched all 55 minutes of this, and did not understand even one second of it.
    It *did* get me to binge my favorite Tom7 videos, as is tradition for all Tom7 uploads, so the upload was most welcome indeed.