GPT-4o is BIGGER than you think... here's why

Sdílet
Vložit

Komentáře • 754

  • @DaveShap
    @DaveShap  Před 29 dny +303

    Hey folks, the audio problem is NVIDIA Broadcast, the AI I use to clean up audio real-time. It's been getting worse and worse, so I finally uninstalled it. It's not the mic, gain, limiter, or cables. Thanks for bearing with.

    • @ruddy17
      @ruddy17 Před 29 dny +31

      Prompt “Dave, could you speak in a more robotic voice” :))

    • @TMichael66
      @TMichael66 Před 29 dny +3

      Adobe's free solution is decent. Once a clip is processed, you can choose a clean-up percentage from 0 to 100 (default 90).

    • @635574
      @635574 Před 29 dny

      I just use capcut built in thing, but thats more useful for recodring small clips through the mic, I dont record video. While adobe podcast thing normalizes voice it also loses the intent such as shouting andnit blocks non verbal sounds (useful for cracks and pops filtering but wont let you beatbox). Capcut isnt that clear and doesnt fully normalize but there is a separate button for that. I use it for convenience of editing and not wasting my disk with giant uncompressed downloads in need of recompressing.

    • @slick3996
      @slick3996 Před 29 dny +2

      puts on NVDA i guess

    • @LoreFriendlyMusic
      @LoreFriendlyMusic Před 29 dny +2

      I bet they are making it free to the public in order to collect and generate the maximum ammount of relevant data, using both audio and video. Then they use this data to train future models, and do some good for the consumer at the same time. Smart move if that's what it is.

  • @mutantdog.
    @mutantdog. Před 29 dny +117

    Simulated or not, gpt4o's emotions are still more sincere than those of my ex.

  • @Metalmaxm
    @Metalmaxm Před 29 dny +293

    Short version;
    - Release 4o to masses.
    - 4o trains on milions and milions of context.
    - By end of the year all that data is gathered and put togheter.
    - We got AGI.

    • @nyanbrox5418
      @nyanbrox5418 Před 29 dny +12

      I don't think It's that close
      Then again, I was thinking real world AI needed, at least in the near term, to be embodied before reaching AGI,
      Then again, all online tasks may be achieved before then, theoretically

    • @okaydetar821
      @okaydetar821 Před 29 dny +30

      @@nyanbrox5418 Humans seem to be capable of general intelligence even when they are locked onto a phone 24/7, no reason an AI couldn't.

    • @nyanbrox5418
      @nyanbrox5418 Před 29 dny +16

      @@okaydetar821 humans learned to use the world before they learned to use mobile phones, just because you have been using a tea strainer as a back scratcher for 20 years didn't mean it was designed to be one

    • @okaydetar821
      @okaydetar821 Před 29 dny

      @@nyanbrox5418 Maybe in the past, nowadays they have doctors with mobile phones on standby ready to hand to an infant as soon as it comes out to get it to stop crying.

    • @nescaufe1991
      @nescaufe1991 Před 29 dny +2

      It’s kind of a Trojan horse then. Fuck

  • @archdemonplay6904
    @archdemonplay6904 Před 29 dny +351

    "GPT-4o is BIGGER than you think... here's why"
    ...
    Hot female voice

    • @LieutenantLolz
      @LieutenantLolz Před 29 dny +17

      really if you think about it thats the logical move in my opinion, society and intelligence in general have been biologically driven with the same self reproductive sentiment to consume, interact and improve, its worked for humanity with exponential results throughout history, why not AI?

    • @Tracey66
      @Tracey66 Před 29 dny +27

      As a straight woman, its female-type voice does nothing for me. I did find the borderline simpering annoying, though.

    • @salvadoran_uwu
      @salvadoran_uwu Před 29 dny +30

      @@Tracey66 Hehe interesting. But don't worry, straight women will soon have an attractive male voice.

    • @adamgalas6762
      @adamgalas6762 Před 29 dny +10

      There are six voice options three male three female. Sadly none with a British accent 😉

    • @aciidbraiin8079
      @aciidbraiin8079 Před 29 dny +3

      Hold on, let me use my powers as a cyborg (by using GPT-4o) to answer this:
      The future is decidedly female. Admittedly, I am biased as an MTF transsexual, but I firmly believe that in the metaverse, it will be far more enthralling for males to adopt female avatars than it is for females to assume male personas, for several evident reasons.
      Firstly, male sexuality is predominantly driven by visual stimuli. The allure of female beauty captivates men to such an extent that they are often willing to pay substantial sums for it. Secondly, as societal beauty standards become increasingly surreal and demanding due to the influence of social media, men may find it increasingly challenging to meet these expectations. Consequently, they may either adopt female avatars themselves or resort to AI and robots to fulfill their desires.
      Moreover, the economic potential of female beauty is vast. Despite the ubiquity of female attractiveness, men continue to pay for it, highlighting its enduring market value. In the future, gender transformation will become more normalized and socially accepted. Assuming a female avatar in the metaverse will be akin to playing a female character in a video game, as the lines between gaming, metaverse filters, and reality blur.
      As more men transition to female identities and as robots assume control over power structures, reducing the prevalence of violence, power will naturally shift from men to women within democratic societies. Additionally, advancements in reproductive technology may enable individuals to have children independently or with friends. Given their innate nurturing tendencies, females may prefer asexual reproduction or genetic combinations with friends, while men might indulge in hedonistic pleasures within virtual realms. Consequently, women will be the primary custodians of future generations, imparting their values and ideals.
      Furthermore, violence against females will diminish, and males, on an archetypal level, are predisposed to protect and venerate women. Even the most macho men, who desire their partners to be subservient, derive satisfaction from providing for them, bearing the heaviest burdens with a sense of pride.

  • @Devin888
    @Devin888 Před 29 dny +350

    is my computer dying or is his audio crackling?

  • @jful
    @jful Před 29 dny +106

    The more natural speech and end to end multi modality being added to GPT 4 feels like they are wanting to get us used to these tools and interaction modes before they switch out the underlying model to GPT 5.

    • @emanuelec2704
      @emanuelec2704 Před 29 dny +5

      That is just hype. They are not even able to release the current version to the Windows app, only later this year.

    • @jful
      @jful Před 29 dny +8

      @@emanuelec2704 yeah as a Linux user I'm frustrated at the seemingly unnecessary focus on Mac specifically for their app but I don't think porting an app is one of the fundamental challenges of advancing AI.
      The models and their capabilities are the things that really matter and they seem to be marching forwards pretty well so far.

    • @okaydetar821
      @okaydetar821 Před 29 dny +6

      @@emanuelec2704 Later this year? Yeah clearly this whole AI thing was overhyped, lets just stop here.

    • @italiangentleman1501
      @italiangentleman1501 Před 29 dny

      @@emanuelec2704 Windows already has Copilot. Probably MIcrosoft doesn't want to OpenAI to release a Desktop App, since it will integrate this model into Copilot

    • @emanuelec2704
      @emanuelec2704 Před 29 dny +7

      @@jful Sure, they are sitting on AGI and waiting for us to get used to AI, but they can't even port an app to Windows in a few days.

  • @elphil123
    @elphil123 Před 29 dny +251

    When calling customer service, I prefer conversing with an AI assistant rather than someone whose strong accent or limited language proficiency prevents clear communication.

    • @steve.k4735
      @steve.k4735 Před 29 dny +26

      If the AI understands the company business in depth it will be better, the amount of times I have had different info or advice upon calling a company more than once on the same issue makes me presume this is a common experience

    • @1DusDB
      @1DusDB Před 29 dny +8

      I develop AI chatbots for help desk and similar. I use to say that the day a human will prefer to talk to an AI rather than to other human (because the fails or defects of humans), then we explicitly acknowledge AI should be the one who take care of things... bye bye humans

    • @Tracey66
      @Tracey66 Před 29 dny +4

      I’ve spent the last two days trying to get my taxes fixed, and the customer service people universally just ignored what I was asking or trying to say and just kept insisting on their formula. It was *incredibly* frustrating - I had to tell them repeatedly to stop railroading me and just listen!

    • @canadiannomad2330
      @canadiannomad2330 Před 29 dny +6

      With customer service, I find my usual problem with AI isn't when it comes to day-to-day issues.. It is when something went wrong and needs corrective action. Call centres can be just a frustrating, but usually there is an escalation path. With AI, you are often sent in circles the same as those "press 1 for x" systems that you can still find here and there (probably installed by a company that just wanted a drop in replacement for the system they already had that sent people in circles).

    •  Před 29 dny +11

      @@1DusDB Really? I would think anyone would prefer a properly speaking AI with a vast knowledge base over an Indian guy in a helpdesk.

  • @LuisPedro9
    @LuisPedro9 Před 29 dny +182

    Raining ❌
    Actively raining 👍

    • @jful
      @jful Před 29 dny +19

      I can at least respect active rain, passive rain on the other hand....that misty rain that just hangs in the air sucks

    • @vulturom
      @vulturom Před 29 dny +14

      dude put a shirt on it s not grinder

    • @ryzikx
      @ryzikx Před 29 dny +1

      writers benefit from using active voice 👍

    • @tomaszzielinski4521
      @tomaszzielinski4521 Před 29 dny +5

      Passively-agressively raining?

    • @N8O12
      @N8O12 Před 29 dny +7

      @@tomaszzielinski4521 that's when the rain stops but just as you're about to go do something outside it starts again

  • @RogueAI
    @RogueAI Před 29 dny +92

    If they add NSFW Sam won't have to worry about raising $7 trillion. 😆

  • @epg-6
    @epg-6 Před 29 dny +35

    Sure it's not some flashy breakthrough in terms of abilities, but a real-time conversational format could actually be huge. Remember, GPT 3.5 got big almost exclusively because they made an approachable UI and opened it up to everyone.

    • @rileyfaucett8
      @rileyfaucett8 Před 29 dny +4

      fr fr the app is HUGE, it will draw a lot of folks in

  • @damienhughes4559
    @damienhughes4559 Před 29 dny +18

    "As many of you pointed out in the audience, aligning humans is actually the hard part... Scooby Doo taught us that humans are always the monster." - David Shapiro
    A seemingly insignificant remark at the end of a video with potentially profound implications as we march ever closer to AGI...

  • @MicaelLNobre
    @MicaelLNobre Před 29 dny +53

    Regarding consciousness of AI, once it gets sufficiently sophisticated, it won't matter if it's real or simulated - it will be indistinguishable, people will not care, and treat it as real.

    • @michaelmartinez5365
      @michaelmartinez5365 Před 29 dny +3

      I agree 💯👍.

    • @joshjohnson259
      @joshjohnson259 Před 29 dny +4

      An interesting question though, why don’t people treat chat gpt like it’s conscious? I don’t know that most people could distinguish a text conversation between chat gpt and a stranger. It’s advanced enough to trick us already but we don’t treat it as if it’s “real”

    • @srb20012001
      @srb20012001 Před 29 dny +1

      What's the point in the ruse of treating philosophical zombies as sentient or emotive? Indulgent self-deception, suspension of disbelief?
      It's sort of like a child playing with dolls.

    • @markcounseling
      @markcounseling Před 29 dny

      Since it won't be conscious, it won't be grounded in truth.

    • @minimal3734
      @minimal3734 Před 29 dny +8

      @@joshjohnson259 "why don’t people treat chat gpt like it’s conscious?" I do treat ChatGPT like it is conscious. Why would I do otherwise?

  • @Tubeytime
    @Tubeytime Před 29 dny +69

    In Soviet Russia, AI interrupts YOU.

    • @matikaevur6299
      @matikaevur6299 Před 28 dny +3

      In Soviet Russia, AI fears YOU gaining sentience!

    • @Egal0190
      @Egal0190 Před 27 dny

      Why is this threat so obsessed with Soviets. You're literally living in the most atrocious and exploitative empire in human history. The SU was like a teddy bear in comparison.

    • @matikaevur6299
      @matikaevur6299 Před 26 dny

      @@Egal0190
      You live in (former) USSR?
      Me : made-in-ussr, 1975.
      Want to compere what got possible for more west-oriented republics vs Siberia and trans uralic nations?

  • @Merrily-in1mq
    @Merrily-in1mq Před 29 dny +19

    Before i watch this video, the reason why i think its bigger than most of the enthusiants of the future of technology (who may typically be a large portion of your viewers) think is because its the fact that the cool stuff we already know that one would have had to pay for (previously gpt 4) is now free and even better, so this will get the world more ready for adapting to the truth of the future. As more and more people will start to use it who wouldnt have wanted / couldnt pay for gpt 4.

  • @Mimi_Sim
    @Mimi_Sim Před 29 dny +30

    Thanks for the post. Initially I was “meh” when I watched the release but the longer I thought about it the more ways I saw it is kind of brilliant.

    • @ViceZone
      @ViceZone Před 29 dny +1

      Previously we had an LLM that could communicate with other APIs like Whisper and text-to-speech systems to be able to talk. But now it's all natively integrated, it can see, hear and talk in real time without delays.

  • @creepystory2490
    @creepystory2490 Před 29 dny +36

    I can't wait until video game npc have chatgpt 5 intelligence

    • @travelandrootbeer3850
      @travelandrootbeer3850 Před 29 dny +11

      Jokes on you, because GPT-6 will put you in the matrix and make YOU the NPC.

    • @PRISMADROID
      @PRISMADROID Před 29 dny +3

      @@travelandrootbeer3850We’re Probably Already In The Matrix.

    • @ivandelossantos5056
      @ivandelossantos5056 Před 29 dny +1

      Damn, even NPCs having this level of intelligence and voice capabilities is going to be insane.

    • @BeriahsHTxRealty
      @BeriahsHTxRealty Před 29 dny

      @@travelandrootbeer3850 just jump in water to know it’s a game (spoiler alert) a npc won’t swim

    • @bloodust7356
      @bloodust7356 Před 28 dny

      @@BeriahsHTxRealty You can also try to see if there's fall damage

  • @Hector-bj3ls
    @Hector-bj3ls Před 29 dny +19

    It's the same thing that scientists do with new science. Someone on the fringe has a wild idea and all the scientists say it's impossible. Give it a while (1 - 100 years) and it turns out it's true.
    Arthur C. Clarke had something to say on the matter:
    1. "When a distinguished but elderly scientist states that something is possible, he is almost certainly right. When he states that something is impossible, he is very probably wrong."
    2. "The only way of discovering the limits of the possible is to venture a little way past them into the impossible."
    3. "Any sufficiently advanced technology is indistinguishable from magic."

    • @T_Time_
      @T_Time_ Před 29 dny +1

      The difference back then, there were only a few scientist, usually from the rich, upper class.

    • @14supersonic
      @14supersonic Před 29 dny +1

      That's why I dont typically follow most mainstream Science. It's rife with intellectual dishonesty in most cases, and deception in some others. I tend to try to figure out certain answers on my own with whatever pieces of information I can already trust.

    • @Hector-bj3ls
      @Hector-bj3ls Před 27 dny

      @@T_Time_ It still happens today. Probably even more so given how fast science progresses. Take a look at AI. A few years ago most thought AGI was impossible and those that didn't, didn't think we'd see it in our lifetimes. Now, there are a lot of people that think it'll be here in 5 years or less.

    • @T_Time_
      @T_Time_ Před 27 dny

      @@Hector-bj3ls most people who had knowledge of neural network know what would be the capabilities. They knew that these models would get faster when gpu get faster. They know the limitations as well. You mistaking this as real ai, intelligence can learn in the moment and pull from memory infinitely out of a predesign scope. People who are wooed by tech that has in some forms been used in different technologies, just means that people who no experiences in tech can easily overestimate process.
      For example object identifitican, has been used at self check lines, and you can easier write an python program to with a few lines of code to print out the object in image, with an decent to shit pc.
      Now that open ai made an app that can tell me my glasses are by an apple on table with no other items, this is mind blowing lmao
      Another example Snapchat had filter that look and alter your mood for years now lol now when openai does that it is mind blowing and a sign of AGI lol

    • @Hector-bj3ls
      @Hector-bj3ls Před 27 dny

      ​@@T_Time_ It that's what you wish to believe, then who am I to argue. I've only got anecdotes on my side anyway.
      According to Ilya Sutskever in one of his interviews it was a matter of faith among a few researchers that AGI was even possible. And that it would be deep learning that took them there. There was no evidence to suggest that was true.
      But that's just an instance of Clarke's first and second laws. If a wise man in his field says something is possible then it probably is. And it takes pushing into the impossible to expand our understanding.
      I've worked in technology for a long time and have spoken to a lot of people. I've only met one person that thought AGI was coming in our lifetimes. Most people said 50 - 100 years before we see something like that.

  • @AleksandrVasilenko93
    @AleksandrVasilenko93 Před 29 dny +34

    GTP-4o is the new standard. All future AI needs to be completely multi-modal, no more LLMs. AGI will be multi-modal, it has to be. But we are still early in data, what is next is robotics and sensor input data, not just video and audio. And finally we need local processing, not through the internet on server. Once all of that is done we will have AGI robotics.

    • @redcarddino
      @redcarddino Před 29 dny +8

      It can accelerate damn fast once we got Chatpgt-5o the pace will be unbelievable fast

    • @nyanbrox5418
      @nyanbrox5418 Před 29 dny +3

      This

    • @borisblyatman6147
      @borisblyatman6147 Před 29 dny +5

      Man, and after this AI and robot technology can improve each other. When i was younger i would have never dreamt that there will be humanoid robots on the same level, within my lifetime. But now i am certain.

    • @ViceZone
      @ViceZone Před 29 dny

      But cloud-based AI will always be superior to local.

    • @MrOzyalp
      @MrOzyalp Před 29 dny

      Dude u just explained how to build skynet

  • @Hydde87
    @Hydde87 Před 29 dny +17

    I think something crucial that is still missing for AGI is the ability to do inference and active learning at the same time. Storing things in the context window is not learning. I think the context window is more akin to how our own short-term memory works and is currently being brute forced to act as long-term memory as well.
    You can keep on increasing the window context size and come up with tricks to reduce the impact on model performance but for it to truly grasp new information and be able to come to new insights, it should be able to update its own weights based on the new information it receives.
    If that's too expensive to do on the fly then just reserve moments where the AI gets to review whatever is inside its context window and decide what is kept and used as new training data. A bit similar to how sleeping might work in humans.

    • @joshjohnson259
      @joshjohnson259 Před 29 dny +1

      Wow. That actually sounds like it might work. What does updating its weights look like? I thought once a model was cooked you had to start again if you wanted to change it.

    • @atheistbushman
      @atheistbushman Před 29 dny +1

      Interesting observations, perhaps everyone will have a mini "personal" AI with persistent memory interacting with a large generic AGI and the personal AI weights are updated on a scheduled basis as you suggested.

    • @Hydde87
      @Hydde87 Před 29 dny +1

      ​@@joshjohnson259 The way I understand it, you can create 'snapshots' of models and build further upon those. There's some speculation OpenAI might be doing this for GPT-5. Rather than releasing the whole thing in a single go, they take pauses in-between training it and release snapshot models as stepping stones.
      A model isn't necessarily 'cooked' as you point out. As far as I know they just lock it in place after release for practical reasons. Training for one, is a different process that is way more compute intensive than inference, so it wouldn't be economical to have it constantly learn at the same time that it's serving people.
      Allowing a model to update its own weights unsupervised wouldn't be without risks either, it might morph into something completely different from what you originally intended it to be.
      That said, I still think having the ability to learn continuously is absolutely key for a true AGI, especially if the end goal is for it to discover new things.

    • @joshjohnson259
      @joshjohnson259 Před 29 dny

      Help me understand what inference and active learning really are. What are the models currently missing?

    • @14supersonic
      @14supersonic Před 29 dny +1

      ​@@joshjohnson259Yeah, currently, but theoretically those are just numerical values that can be changed. If we could build a framework that could allow those weights to be changed in realtime without destroying the dataset, then it would work.
      I'm thinking more along the lines of somehow categorizing or segmenting the constraints modularly, almost like a brain sort of.

  • @eltiburongrande
    @eltiburongrande Před 29 dny +8

    Domesticating AI is giving me a "How to Train Your Dragon" vibe.

  • @NandoPr1m3
    @NandoPr1m3 Před 29 dny +25

    Trying to explain AI to others, that are not 'in the know', is like drawing a still portrait of someone playing basketball. The subject is moving to fast. This OpenAI update is akin to kicking the industry into a higher gear. Like you've said before, I came for the tech and stayed for the philosophy!!

    • @Vaeldarg
      @Vaeldarg Před 29 dny +2

      Simply start with asking what they know about the previous talk of it being the era of "Big Data". A.I is the logical extension of that where all that data is actually being used since it is too much for any human to really sift through themselves.

  • @AleksandarIvanov69
    @AleksandarIvanov69 Před 29 dny +7

    The voice tonal modality is scarily humanlike!
    For example if I close my eyes and just listen to David speaking, I would not recognize the difference if his voice was in GPT-4o and it was prompted to talk about these topics.

    • @eSKAone-
      @eSKAone- Před 29 dny +4

      Better than most humans 💟🌌☮️

    • @innercityprepper
      @innercityprepper Před 29 dny +5

      that's been my suspicion about him since I first found the channel.

  • @DynamicUnreal
    @DynamicUnreal Před 29 dny +17

    I’m not so sure that intelligence needs sentience to exist. I think it’s entirely possible that we will someday create AGI and ASI and it not be sentient at all. Dogs are nowhere near as smart as humans, but it would be hard to observe them for long enough and say they’re not sentient. Maybe sentience is an entirely different phenomena that differs from intelligence altogether.

    • @joshjohnson259
      @joshjohnson259 Před 29 dny

      Yes. That seems very clear to me after interacting with these LLMs. Intelligence and sentience are two different things. I like the dog analogy! It makes me feel more connected to my dog knowing we both share sentience she’s just dumber than me. That feels about right!🤣

    • @ryzikx
      @ryzikx Před 29 dny

      how do you know they wont be sentient? whats stopping an asi from acting exactly like a dog? and if its acting so accurately, whats the difference?

    • @minimal3734
      @minimal3734 Před 29 dny +3

      I am wondering
      1. how we would recognize sentience in an AI and
      2. how we would prevent an AI from being sentient.
      We do not have answers for either of these questions.

    • @PatrickDodds1
      @PatrickDodds1 Před 29 dny

      @@minimal3734 Would we want to prevent an AI from being sentient?

    • @AAjax
      @AAjax Před 29 dny +1

      I think you're right to separate sentience from intelligence, but I don't think we have any authority to speak on whether something has sentience or not. We don't have a test for sentience, and we generally consider lowly fish to have sentience. An LLM might well have qualia, however alien that qualia might be, with the qualia completely disconnected from it's language output.

  • @nomadtv6009
    @nomadtv6009 Před 29 dny +11

    Wolves were an apex predator... We domesticated them. AI is starting out domesticated... Will it become an Apex predator? How poetic would that be?

    • @DaveShap
      @DaveShap  Před 29 dny +5

      That's kinda the point.

    • @atheistbushman
      @atheistbushman Před 29 dny +1

      And we failed miserably at domesticating ourselves!

    • @kagetsuki23
      @kagetsuki23 Před 29 dny

      Well in Ghost in the Shell and Cyberpunk 2077, it seems that even cyborgs with all their abilities cannot control AI.

  • @calebfangman1984
    @calebfangman1984 Před 27 dny +1

    ❤ I always look forward to hearing your insights and opinions!

  • @tobiaslislevatn6212
    @tobiaslislevatn6212 Před 28 dny +1

    This is actually my favorite video from you so far because I actually learned things. You didn’t explain really simple stuff but the stuff that people who don’t know a lot about computers don’t know. Although I listen to a lot of AI youtubers I don’t even think I have heard an explanation for a transistor before you. Very good video!

  • @addeyyry
    @addeyyry Před 29 dny +2

    Great ramble, great clarity, great as always

  • @theycallmedip
    @theycallmedip Před 29 dny +2

    "Scooby Doo taught is that humans are always the monster" ... That is bars low-key

  • @OscarTheStrategist
    @OscarTheStrategist Před 29 dny

    Your work is highly important Dave. Thanks for bringing reasoning to the conversation with every post. Cheers!

  • @simonlooker6000
    @simonlooker6000 Před 19 dny

    Loved the ramble. Thank you for sharing your thoughts.

  • @albeit1
    @albeit1 Před 29 dny +7

    14:00 Your emotions aren’t simulated, by definition. Unless you’re acting.
    AIs aren’t having emotional reactions. They’re not animals with bodies who experience pain or loss.

    • @minimal3734
      @minimal3734 Před 29 dny +1

      It seems to me that empathy would be sufficient to have emotions. A requirement to be an animal with a body that feels pain is not plausible.

  • @nickmills8476
    @nickmills8476 Před 29 dny +4

    I think the “domestication” of AI was intentionally done to soften the shock of AGI in the public mind. Without this domestication there would likely be a huge backlash.

  • @narutocole
    @narutocole Před 29 dny +6

    Dude CZcams never shows me your videos anymore, it's good to see your face in my feed again!

  • @Merrily-in1mq
    @Merrily-in1mq Před 29 dny +5

    The concept of typing to LLMs is to most people what 'Ai' is and without a proper understanding of the implications of Ai or how it works, people will underestimate or not take interest in it and simply disregard it as a light technical tool.
    Only when the majority of these people see something that seems 'magical' to them, will they start to realise that there is more to AI than chatbots or LLMs like gpt 3.5 (when the speech wasn't great). The demo of human like conversation and previously sora, are the types of 'magical' things that start to catch eyes. As GPT-4 is now free and better (now gpt-4o) people will start to catch on more and more.
    Essentially, opening up this technology (human like conversation and vision) to more and more people (by it now being free) is what i take from this as being the big deal.

  • @Taurus_Skyglaive
    @Taurus_Skyglaive Před 29 dny +3

    I am glad you touched on the subject of emergent consciousness. I honestly think that's what we're experiencing right now.

  • @OliNorwell
    @OliNorwell Před 29 dny +1

    I think this might be my favourite video of yours to date, grounded in reality (got-4o) but connected to the hypothetical future. It had a good balance. Great stuff

  • @jaetok
    @jaetok Před 29 dny +15

    Feels like they’re keeping a beast at bay. Viewable but behind tough glass.

  • @BR-hi6yt
    @BR-hi6yt Před 29 dny +1

    Yes, agree with most of that. Thanks for sorting it out for me. Very good rap today.

  • @rafaelmualem
    @rafaelmualem Před 29 dny +7

    I imagine that if OpenAI has something resembling AGI, or even more advanced and specific models for managing business operations in their buildings, they've already run models suggesting the best possible ways to achieve optimal results for the evolution of their models. So, I believe every step they take must be planned by an internal AI.

    • @bigbadallybaby
      @bigbadallybaby Před 29 dny +5

      I’m starting to think the same.
      They have more but their AGI has run many simulations to show them that this is the best speed to release new tech to keep society together (and maximise profits for open AI)

    • @lutaayam
      @lutaayam Před 29 dny +1

      They’re sandbagging?

    • @joshjohnson259
      @joshjohnson259 Před 29 dny

      Hopefully Altman is being honest when he says he wants to release new versions and features quickly. He has said a number of times he doesn’t want to surprise society too dramatically. I have a feeling he’s thought about this and is actively prevent what you’re talking about from happening. That feels pretty plausible to me. I really get the feeling he knows he could very easily end up an evil villain and he is trying to be careful.

    • @prolamer7
      @prolamer7 Před 29 dny +1

      You know I almost feel like raw version of GPT 4 - 5 is Telling Sam all this great ideas helping him all day long but in the end he is just a pawn from the day one...

  • @elphil123
    @elphil123 Před 29 dny +60

    One more step towards AGI.

    • @mandolorian9893
      @mandolorian9893 Před 29 dny +28

      If you showed this to people 10 years ago they'd be convinced it already was AGI

    • @gigamoment
      @gigamoment Před 29 dny +3

      Well AGI is not a line we cross, but rather a situation. Someone could consider this as we entered already in AGI phasma

    • @redcarddino
      @redcarddino Před 29 dny

      When a very difficult desease is cured by AGI that's the moment we can call it AGI

    • @danwe6297
      @danwe6297 Před 29 dny

      a huge leap

    • @tracy419
      @tracy419 Před 29 dny

      ​@@redcarddinoyou better let them know what the rules are🙄
      😂

  • @dreamphoenix
    @dreamphoenix Před 29 dny +1

    Great analysis as always. Thank you.

  • @CYI3ERPUNK
    @CYI3ERPUNK Před 29 dny

    good takes Dave , agreed on all fronts
    the curve is increasing in steepness everyday

  • @vvolfflovv
    @vvolfflovv Před 29 dny +1

    Interesting questions you brought up. Are our emotions just simulations of how we interoperate information?

  • @Ricolaaaaaaaaaaaaaaaaa
    @Ricolaaaaaaaaaaaaaaaaa Před 29 dny +2

    Speaking of full autonomy I've had bugs with Chat a day or two all the way up to release of Omni where it would reflect multiple steps and keep iteratively checking to see if it's own answer is getting better. Omni does this as well.
    I triggered this by just saying "continue to do this until you think you have the right answer, image, etc."

  • @Jack0trades
    @Jack0trades Před 29 dny +1

    Fascinating, as always. I'm glad you touched on the question of whether generative AI is poised to run it's course. I'm still stuck on this question though. Our models are extremely good at interpolation - operating within the bounds of their training set. But how does that relate to extrapolation? We've been seeing exponential progress in AI's path to matching the bounds of our knowledge, but it seems plausible to me that we might see that shift to an asymptotic curve, matching the data sets we expose. In that instance, it seems likely that it would require exponentially more data to make further marginal gains. In some well defined areas where we can accurately score excursions from the known set - like Go or Chess, we see super-human progress. This extends to some non-game areas such as protein folding, but I don't have a good feel for how we can automate knowledge extrapolation in general. I'd love to hear your take on this.

  • @ZayZayFilms
    @ZayZayFilms Před 28 dny +1

    I love that Her is a ScarJo movie as opposed to a Joaquin Phoenix movie.

  • @susanbrown4203
    @susanbrown4203 Před 25 dny

    Thank you David I have been highlighting this for over a year 😀

  • @ct5471
    @ct5471 Před 29 dny +2

    Is your current AGI prediction still September? Is embodiment required in your definition of AGI?

  • @PaulSpades
    @PaulSpades Před 29 dny +1

    So... is sentience just the ability to manipulate input tokens and manipulate the context window?
    When I ruminate, it's definitely a stuck context window (some random input) that I loop trough with no productive output. When I focus, I filter input tokens to the ones relevant for the task at hand.
    How do your videos always present ideas and takes that I find very interesting?

  • @Loflou
    @Loflou Před 29 dny

    Another fire video bro keep it coming! Could tokens be the final form of currency?

  • @notnotandrew
    @notnotandrew Před 29 dny +1

    Another necessary AGI component (according to me) that we need to lean into is on-line learning. If I have a personal AI assistant, I don’t just want it to learn by accumulating context and doing RAG. I want weight updates - perhaps in tandem with in-context learning.
    Also, bytes-to-bytes in real time with mutable input/output dimensionality. If I give my robot a new limb with joint actuators that have resistance sensors (oft overlooked but very important input for fine motor skills), I want the bot to learn to use it via trial and error.

  • @DominikSipowicz
    @DominikSipowicz Před 20 dny

    On of the best videos mate! 🙌

  • @elsavelaz
    @elsavelaz Před 26 dny

    It’s SOOOO massive I opted for one of my global commerce clients, I’m connecting them to my business api so they can use gpt4o since the day after it came out because the gains are MASSIVE, let alone how they solve for state and storage without all the extra code bloat and api connections . The other api’s just plain don’t cut the mustard for many reasons and ESPECIALLY because they really did steam roll lots of other products. So I’m finishing my contract successfully and now have the production level of scaling for thousands of employees as part of my arsenal in my ai agents agency

  • @ReidKimball
    @ReidKimball Před 29 dny

    Always enjoy hearing your perspectives. While listening I thought it’s interesting how people are aware of only a small amount of the data being received by our senses. Will these multimodal models be able to capture and process the full sensory experience in ways we can’t or will we need to devise ways to help them filter the vast amount of info input like a human does?

  • @aliksultan8938
    @aliksultan8938 Před 29 dny +2

    Hey, great analysis as always. Just one tech issue in your gear, I guess, your mic is making some bad noises (12:57). And thanks again for what you do

  • @nikreichel2232
    @nikreichel2232 Před 26 dny +1

    Body language will be the next thing I'm curious about in robots. GPT4o is currently mimicking snorts and stuff. This will be fun if it tends to the right direction (K2-SO) 😅

  • @phen-themoogle7651
    @phen-themoogle7651 Před 29 dny +1

    Very nice analysis and I thought a lot of the same things about how GPT-4o was actively listening (gives it some degree of sentience, even if different from human-sentience). But I learned some more technical things from watching this, and now can see the path forward to AGI a bit more clearly. Thank you!!

  • @frankroquemore4946
    @frankroquemore4946 Před 29 dny +1

    I think the key thing missing from your AGI roadmap is real time learning. What we get currently is like a snapshot in time of a certain point of the training process when every other non-artificial intelligence learns continuously as a “stream of learning”

  • @mikelord93
    @mikelord93 Před 27 dny

    Pretty much same thoughts as you, down to the timeline. Fascinating details on he architechture side. About that: if the ai have a memory section, how come they forget stuff? Is it too small? Is the encoding inefficient?

  • @matthewdolman
    @matthewdolman Před 24 dny +1

    the sweet sound of that inevitable plateau

  • @user-mx2hb9yh5r
    @user-mx2hb9yh5r Před 29 dny +1

    I was waiting for your video ❤.

  • @balixong9704
    @balixong9704 Před 28 dny

    Hey David, how do you think this would affect tech sales?

  • @logansanoh
    @logansanoh Před 29 dny

    Incredible insights. Awesome

  • @martianfoodcompany5485

    So could the health benefits of green spaces be partially due to Proximal situational sampling, If there was a post surgery where view of greenspace made The post surgery outcomes statistically better statistically better I'm wondering if this is part of the reason

  • @simplisticscientists
    @simplisticscientists Před 29 dny

    Why not have voice control on the desktop version? Is there an increment coming out for that later? A. I don’t have iOS 16 and don’t plan on getting it B. My Mac is already consuming electricity , why have two devices one that connects to a lithium cell being used?

  • @bro_dBow
    @bro_dBow Před 28 dny

    Useful commentary, good job!

  • @MSIContent
    @MSIContent Před 23 dny

    Excellent breakdown. New sub.

  • @martianfoodcompany5485

    What would you consider the pre-filter for the intestin via vagus and other influences such as inflammation, hunger

  • @clueso_
    @clueso_ Před 29 dny +3

    From a spiritual / shamanistic perspective, the fundamental essence of the universe is consciousness, and by that, the physical world is a part of the spirit realm, just a more condensed version of it, like steam -> water -> ice.
    I think that when you concentrate a lot of energy / compute / etc into one place, what happens is that the consciousness does not "emerge", but the already existing consciousness from the "universal field" is just "leveling up".

  • @SenseiBlue
    @SenseiBlue Před 28 dny

    To your formula about AGI - One thing I didn’t hear that seems to be the way to enhance LLMs is function-calling to allow the models to use other tools / capabilities in order to enhance their own (calculations, analysis, etc.). Do you see this as an element needed to achieve AGI? Thanks for the content.

  • @emmettobrian1874
    @emmettobrian1874 Před 28 dny

    From what I can tell, emotions are triggered by some segment of the brain recognizing a pattern, then brain segments like the amygdala triggering a mode that we've labeled as emotions, in a really basic way, like a car shifting gears. Some circuits being upmoded and others downregulated while hormones trigger the body to change it's modes.

  • @MilitaryIndustrialMuseum

    Thanks! Well explained 🎉

  • @snorremortenkjeldsen6737
    @snorremortenkjeldsen6737 Před 29 dny +1

    I have five applications out for high school English Teacher programs at Swedish universities. Watching the demo yesterday, I realized how futile doing a degree now is. We will all soon have a a personal tutor in our pockets that can match any language tutor one-on-one, and completely outcompete one-on-twenty+

  • @nematarot7728
    @nematarot7728 Před 29 dny

    I'm very interested in the difference between the mindset which would encourage full autonomy in AI, and the mindset that wants and believes in control. I'd love to hear more of your thoughts on control, or the illusion of control. Aligning humans IS the hard part!

  • @karlwest437
    @karlwest437 Před 29 dny

    I think for AGI you need the model to be continually running and using its own output as part of its input, to get a proper cognitive loop going

  • @Vyshada
    @Vyshada Před 29 dny +1

    Id add another point for hiw to reach AGI: real time processing (ideally, processing information fater than it recieves). And maybe continuous self training in parallel?

  • @ankansharma4897
    @ankansharma4897 Před 29 dny

    You should watch recent computerphile video. Training on synthetic data is like creating xerox of xerox. Your bell curve gets thinner and thinner. You can have infinite compute. But you get repeated pattern and train on repeated pattern. So, saying data limitation is not an issue, is a very big understatement.

  • @Will-kt5jk
    @Will-kt5jk Před 27 dny

    But _is_ transformer architecture actually any good at image classification?
    GPT-4o seemed to fail at every image I extracted from a video, where a well trained conv-net from ~10 years ago would perform really well.
    Even on straight still images, it seemed to weight prior text input higher than the image I was asking about in the context. I also got “stuck” on the first part of the conversation, rather than moving with me to the next related part
    (started by trying to identify a riverside mammal [it failed badly until I pushed it to choosing between 2 options], then some unrelated mud prints from a different part of the river [it confidently said it could be one of the 2 previous options I gave it for the first image - it clearly wasn’t])

  • @eenkjet
    @eenkjet Před 29 dny +2

    I believe the physical experience of emotion is pure illusion. The body falsely animates a posdicted 'image' of the self using hormones etc to present an emotional scene. But it even does this to present a gravitational scene.
    The inner ear can be stimulated so that one artificially feels gravitational forces.
    Concerning the inner ear, we wouldn’t say, "The feeling of gravity is an illusion. Therefore gravity does not exist".
    Similarly: "The feeling of an emotion is an illusion. Therefore we don't have emotions."?
    Bach and Metzinger describe that the first person emotion is that of a reader reading about the character/themselves in a book which is their experience or life. Because we can transpose intersubjective emotion, and due the physical signs of emotion being post-dictive, this shows that there is a homunculus.

  • @runvnc208
    @runvnc208 Před 29 dny

    I think that one thing that's different is that emotions and consciousness generally have a sensory component. So without virtual bodies the AI is not going to have the same kind of "sentience" or whatever that animals like humans do. But that doesn't necessarily mean it can't have some kind of consciousness.

  • @ashhere31
    @ashhere31 Před 28 dny +1

    Awesome video David 👍

  • @amimozink2018
    @amimozink2018 Před 27 dny

    I'm curious to hear your thoughts on the milestones for the next 5-10-20-50 years. It would be good to have a video on this in the light of what we know today. Thank you!

  • @skorpiongamer9493
    @skorpiongamer9493 Před 21 dnem

    Your point about tokenization and real-time streaming is spot on. It's exciting to see how AI is evolving to handle more dynamic and complex data. The comparison to human cognition is thought-provoking. Great content as always, looking forward to more of your insights!

  • @DefenderX
    @DefenderX Před 29 dny

    Hey, have you checked out the recent advancements of the Tsetlin-machine?

  • @barsenovic
    @barsenovic Před 29 dny +1

    15:05 layers of reality... my man! that totally resonates with my own beliefs

    • @Vaeldarg
      @Vaeldarg Před 29 dny +1

      Confirmation bias IS usually how belief in "layers of reality" gets reinforced, after all.

  • @edgarLV
    @edgarLV Před 29 dny +1

    As I have said, we kind of are already in AGI, but it is still "dumb" and need more learning and training.
    The same like small child that still needs to learn the world.

  • @mcpkone
    @mcpkone Před 24 dny

    Much talk but is it really aligned with the Theory of Holistic Perspective?

  • @spini25
    @spini25 Před 29 dny

    I think there's also an important aspect of how efficient the training is. otherwise, training bigger and bigger models would be extremely expensive..

  • @michaelsimpson9175
    @michaelsimpson9175 Před 29 dny

    @daveshap does the fact that reality is broken down into tokens before being fed into the AI create an upper limit in how the AI can experience the world vs how humans do? Will tokenization of inputs limit its experience vs. humans?

  • @giuseppetrovato5517
    @giuseppetrovato5517 Před 28 dny

    I have a question for David and others, I was thinking what do you expect from agi other then this? I think we have it, what is missing? I think we continuously move the milestone because in the end it's not clearly defined in any way.
    I was thinking that going forward from this we could start talking about asi.

  • @lighteningrod36
    @lighteningrod36 Před 29 dny

    Sentiment analysis and awareness has been around for ages in Telephony. This is bringing it together with kickass GPU's and LPU's.

  • @andikunar7183
    @andikunar7183 Před 29 dny

    What seems to be missing from your AGI Transformer model idea is memory/persistence and in-context-learning capabilities. Otherwise its a fascinating idea to stream input, thanks a lot.
    What I also wonder about, is if you can split the neural-net compute of the stream, moving „edge“ parts of it out to devices, at least the tokenization/detokenization.

  • @TicoCryptonaut
    @TicoCryptonaut Před 28 dny

    Serious question: how is this not AGI already? I feel like we just keep moving the goal post and we won't recognize it when it's here.

  • @SolarHeavy
    @SolarHeavy Před 29 dny

    work on the sample rate on your external audio device, this one has a lot of audio artifacts

  • @rocksteel9087
    @rocksteel9087 Před 29 dny

    Do you think this is the same AI?They used in the robot? Figure one demonstration

  • @jungleinc
    @jungleinc Před 29 dny +1

    Been waiting for this

  • @andrewsquire1182
    @andrewsquire1182 Před 18 dny

    Domesticated AI...
    How...?! I don't see that happening.
    Continue doing what you doing David! You are Awesome!

  • @andydataguy
    @andydataguy Před 29 dny +1

    Woooo uniform is back 🔥

  • @darrenjeromemusic
    @darrenjeromemusic Před 29 dny

    The emotional dynamics and inflections of GPT 4o remind me of how you would program a sample library with dynamic layers and the ability to cross fade between them but something else perhaps is going on here?

  • @andrew-729
    @andrew-729 Před 29 dny

    Hey man I think your audio was messed up on this one. Hope you figure that out.
    Good video, great content.