ChatGPT-driven NPC Experiment 2

Sdílet
Vložit
  • čas přidán 28. 08. 2024
  • Experimenting with a ChatGPT-driven NPC. Using OpenAI's Whisper for speech to text, GPT3.5-Turbo for the NPC's "brain", and ElvenLabs for text-to-speech.

Komentáře • 1K

  • @TheStarSquid
    @TheStarSquid Před rokem +2483

    The potential this has for RPGs is amazing.

    • @nickb220
      @nickb220 Před rokem +130

      they really need to nail down how to insert unique attitudes like sarcasm, aggression, indifference, annoyance, etc.

    • @TheStarSquid
      @TheStarSquid Před rokem +69

      @@nickb220 True. Though at the rate AI is improving I don't think they'll be a limit for long.

    • @paxtoncargill4661
      @paxtoncargill4661 Před rokem +78

      Yes, but eventually half the outputs will start with, "as an AI language model, I cannot" because openai decided to lobotomize gpt3.5 and 4

    • @zeno696
      @zeno696 Před rokem +27

      @@paxtoncargill4661 there are many videos you can find which by past restrictions that open AI has. Turning Chat GPT into a NSFW AI. Not sure about legality but it’s not hard to do it.

    • @sashaklin9728
      @sashaklin9728 Před rokem +10

      Also for simulation game. Imagine Crusader Kings with such realistic behavior

  • @pilotmanpaul
    @pilotmanpaul Před rokem +1631

    This is going to shake the industry. If this can be further perfected. You can say that what you will experience is a full fledge Roleplay world where people only know what they know but has their own lives and knowledges that can be imparted to you.
    This is an interesting age we're all living in. From Unrecord's insane photo realistic graphics to this. Just complete insanity.

    • @21EC
      @21EC Před rokem +31

      WOW...thanks so much for sharing the info about that game "Unrecord" - I didn't know about it, never heard of it before or anything, I checked it out and just wow, it looks legit like actual real authentic footage from a real war or something, always wanted and imagined games getting this realistic to the point of not being able to tell if the gameplay footage is real life video or not..this is it ! incredible, at first I thought the mini preview of the video is real footage from a real military combat..sick realism ! when is it gonna be released? is it going to be sold on Steam? it's a must have

    • @pilotmanpaul
      @pilotmanpaul Před rokem +11

      @@21EC Its a PC only Steam game.

    • @MaxLohMusic
      @MaxLohMusic Před rokem

      AI Roguelite came out already over a year ago

    • @JOA5941
      @JOA5941 Před rokem

      Primero averigua cuántas horas, meses, años soportará sus pobres ojos v:

    • @path1024
      @path1024 Před rokem

      Oathlords.

  • @rasmus1600
    @rasmus1600 Před rokem +896

    The fact that the NPC can react to where you're looking and comment about it is insane! If a complete VR RPG game like this comes out, imma go offline with the real world for DAYS

    • @Raulikien
      @Raulikien Před rokem +73

      For days, and eventually forever if they get real enough...

    • @orbit1894
      @orbit1894 Před rokem +44

      @@Raulikien then we are gonna wonder if we already in one.

    • @mack3009
      @mack3009 Před rokem +20

      i wont go ofline the real world, but it would definitly be fun to play such a realistic game

    • @ariwijaya538
      @ariwijaya538 Před rokem +60

      And then people forgets about the real world and begins to develop VR and chatGPT inside the game, and the cycle repeats

    • @TheThink5op
      @TheThink5op Před rokem +12

      ​@@ariwijaya538that plot twist 😂

  • @HMan2828
    @HMan2828 Před rokem +562

    Now imagine NPCs remember previous interactions with you and use those memories in later conversations... After a while of you visiting the same tavern, having a drink, and chatting up the innkeeper, you become a regular. NPCs call you by your first name, initiate conversations, ask for help and give you quests organically... Maybe you mentioned something about looking for work, and the innkeeper relays quests from other NPCs... Or just having multiple NPCs interact with each other... Every encounter would be unique! This is peak RPG!

    • @VarietyGamerChannel
      @VarietyGamerChannel Před rokem +40

      Already possible. Just need to incorporate it into a game.

    • @Nell_Hell
      @Nell_Hell Před rokem +21

      im so immensely hyped for that kind of experience, something like Sword Art Online (except the events that happend in it) like the game itself, that would be awsome

    • @MrValgard
      @MrValgard Před rokem +13

      yep GPT4 have memory module which isn't included in chatgpt(only session) so based on/custom by dev team would be easy to do right now

    • @carlpanzram7081
      @carlpanzram7081 Před rokem +23

      I love parasocial relationships that make me neglect the real life.

    • @tokyyoutube1287
      @tokyyoutube1287 Před rokem +5

      What you describe is what is in the ancestors of console RPGs. It is in the pen, paper & dice role-player game. It still needs a game master though. It is still widely used by players.

  • @Dannnneh
    @Dannnneh Před rokem +234

    2:09 his slow turn back with that smirk and look, too perfect.

  • @thefunkyfish5245
    @thefunkyfish5245 Před rokem +263

    Love the use of the male reguard voice from oblivion. Fits in very well

    • @fatcat9390
      @fatcat9390 Před rokem +27

      I KNEW it sounded familiar!

    • @waitean09
      @waitean09 Před rokem +9

      I thougth he sounded like Laurence Fishburne for a bit there

    • @PureYang0
      @PureYang0 Před rokem +11

      @@waitean09 All redguards are descendants of Lawrence Fishburne

    • @ste7081
      @ste7081 Před rokem

      if these are original oblivion recordings what is chatgpt doing here? 😅

    • @kevorka3281
      @kevorka3281 Před rokem

      I wanted him to sound more like Samuel L Jackson

  • @tamulur
    @tamulur  Před rokem +166

    Some background information: at start, ChatGPT is given info that there is an experienced male warrior, a female mage and a female rogue, but none of them would go on an adventure with a noob. Also, the rogue is known to disappear and appear at will. When ChatGPT is inactive (not processing and not letting the NPC speak), the barkeep follows the player's gaze on his own. Then when I send input to ChatGPT, I send where the player was looking, where he's looking now, any additional info about what's happening, and what he's saying. For example: "[Player is looking at mage] What about her?". ChatGPT replies with info about where the barkeeper is looking and what he's saying, for example "[Looking at mage] Ah, she's a very powerful mage." The most complex input was "[player was looking at rogue, but rogue has disappeared. Player is looking back at you] She's gone!" and ChatGPT replied "[Looking at player] As I told you..."

    • @Gray_Ti
      @Gray_Ti Před rokem +8

      When you looked at the rogue for the first time, I saw the barkeeper initiate the conversation instead of you asking him. Can you explain that?

    • @tamulur
      @tamulur  Před rokem +45

      @Gray_Ti I pressed the record button but didn't say anything. What was sent was basically "[Player looked at rogue, rogue looked away. Player is looking back at you]". In a real game, I would probably send info to ChatGPT like this regularly/automatically under certain conditions, so it can act without the player having to say anything or press a button.

    • @Mega-Brick
      @Mega-Brick Před rokem +2

      It sounds like that approach will be useful in the future, when multiple GPT-driven AIs are present. It'd be interesting to see a game where you can converse with NPCs without even needing to enter some "dialogue mode" like a lot of RPGs do.

    • @FinesseTheBest
      @FinesseTheBest Před rokem

      @@tamulur I'm a layman to AI and it's all too advanced for me. I tried your therapy sequence but the character quota for ElvenLabs was met and now I have to wait for the month-long cooldown. Now, what I'm wondering is if, say, Elderscrolls 6 decides to make use of AI as their primary communication feature with NPCs, how are they going to work around this issue? Like, are people going to have to pay a subscription to use a feature like this?

    • @Kokuswolf
      @Kokuswolf Před rokem

      @@tamulur This is incredible.
      I wonder if the NPC could focus on you (depending on how near you are and maybe other things like "interacted before" or something), but they will only record what they can see/hear for their POV. So the Barkeeper does the same, as long as you were near. And other will interact, when you came near and you got their "attention".
      I know I'm fantasizing, but there could be other triggers, like one NPC decides to create a party with you. This means only a timed trigger for "create a party" and use everything that NPC heard/saw additionally. It's somewhat like your barkeeper, but filtered to what this NPC could possible perceive and an interaction (message from that npc) is started when you and other around you were silent.
      Besides these conditions, the only "hardcoded" action is "create a party with player", but the conversation would be unique regarding your previous dialog. (I have other ideas, but I digress wildly.)
      /subed

  • @Xialoh
    @Xialoh Před rokem +121

    This is incredible. The Elvenlabs text to speech also sounds 100% natural...the future of gaming is bright.

    • @brianwill5929
      @brianwill5929 Před rokem +4

      I caught what you did there. This comment will blow up when people catch your joke.😂

    • @MONSTERKILL2013
      @MONSTERKILL2013 Před rokem +1

      The future for gaming has never been bright

    • @TheFlyingPilgrim
      @TheFlyingPilgrim Před rokem

      @@brianwill5929 For someone ‘out of the know’ what was the joke?

    • @johnjames7668
      @johnjames7668 Před rokem

      @@TheFlyingPilgrim "elven labs"

  • @jarekstorm6331
    @jarekstorm6331 Před rokem +204

    I just want to hang out and get to know the AI NPCs in the tavern. Imagine the endless conversations and relationships you could have. They’d even use your name, and maybe welcome you back when you come and go. Amazing.

    • @sirweebs2914
      @sirweebs2914 Před rokem +4

      exactly

    • @Rudgged
      @Rudgged Před rokem +114

      same thing happens in real life, try it

    • @larion2336
      @larion2336 Před rokem +55

      @@Rudgged Yeah but can you roleplay as an ogre or wizard in an IRL tavern? No you can't. Real life is cool and all, but there's very definable reasons why people like games and fantasy, it allows us to do a lot of things reality doesn't allow for.

    • @MaxLohMusic
      @MaxLohMusic Před rokem

      So far only Ai Roguelite actually uses AI to influences game mechanics.

    • @notanagger4861
      @notanagger4861 Před rokem +2

      @@Rudgged lmao indeed

  • @richardrackley2430
    @richardrackley2430 Před rokem +43

    I know there’s people out there that are really mentally unwell due to loneliness. There’s dangerous potential to AI but there’s also beautiful potential to how it can help people socialize and be therapeutic to those who don’t have people to talk to. I look forward to seeing how we use AI to help those people out, especially through gaming

    • @chuck25
      @chuck25 Před rokem +14

      was thinking the same, but they will potentially stay in this virtual world and it can get even worse.

    • @richardrackley2430
      @richardrackley2430 Před rokem +2

      @@chuck25 Very good point

    • @Mega-Brick
      @Mega-Brick Před rokem +6

      @@chuck25 To a degree, we already face these kinds of problems even though the virtual worlds we can get lost in aren't quite "real". As with all things, it can be a useful comfort so long as it doesn't become a crutch.

    • @KeegansLife
      @KeegansLife Před rokem +3

      @@Mega-Brick it will become a crutch. What happens when the server hosting your AI best friend has some issues and your AI best friend is gone forever, and does not remember you.

    • @bilbo_gamers6417
      @bilbo_gamers6417 Před rokem +1

      ​@@KeegansLife It will be a crutch. But it seems like, in reality, the trend for future AI like this will be towards miniaturization. Google will be releasing models that can be run offline on a single computer soon.

  • @zura17
    @zura17 Před rokem +157

    damn, after 5 years time having AI npc in games will be so cool to see

    • @grass_rock
      @grass_rock Před rokem

      And torturing them would be much more realistic and satisfying

    • @ahtoshkaa
      @ahtoshkaa Před rokem +27

      1 year. man. just 1 or 2 years. I don't think we can imagine what will happen with this technology in 5 years

    • @zaq_hack4987
      @zaq_hack4987 Před rokem +4

      @@ahtoshkaa For sure. There are models good enough to do this, now. If one was trained specifically for NPCs and role-playing games, which would be reasonably easy to do, the most significant part of the time to develop it would be making sure it didn't break the 4th wall or do anything too insane. We already have ways to give bots long-term goals and sub-goals. They don't need to be GPT-4 level to be waaaay more interactive and ... believable, I guess? Especially within the framework of a video game. Guaranteed a dozen game studios are doing exactly this as we write.

    • @ChristopherCopeland
      @ChristopherCopeland Před rokem +1

      @@zaq_hack4987 Of course a niche video like this is where I find discourse about AI that is actually tapped into the fact that it’s not technological leaps we currently lack, rather the time to iterate and implement the power that’s already here. Which, in another two years max, we’ll have systems constructed that will be constructing the models to implement the tech for us. Which will only continue to advance the speed of iteration and implementation in cases like this. In five years, even RPG shit’s gonna be horrifying in an existential way 😂 fascinating times. It’s truly unreal we’re alive during the construction of humanity’s final tool. The odds of being here at such an interesting point are basically inconceivable.

    • @rebar_radar
      @rebar_radar Před rokem

      Given the pace of things, 5 years from now we'll be seeing stuff we can only begin to imagine now

  • @Razorfiend
    @Razorfiend Před rokem +72

    Dude, this is so cool. I watched your interaction with the monk, this is groundbreaking stuff and I can't wait to see it applied more widely to games. It would make games almost infinitely replayable because you would get a completely unique experience every run through.

    • @bazzel1059
      @bazzel1059 Před rokem +2

      I wonder if these ai interactions ever get boring? Sure, the tavern guy won't always use the same words, so it's definitely a huge step up from what we have, but at the end of the day he will know the same things about the people in the tavern and hsi attitude won't really change that much. If the people are randomized and have own personalities with own AI voices it could get interesting though.

    • @uraszz
      @uraszz Před rokem +2

      That would need massive amounts of extra work that I’m not süre every game company would be willing to invest in further. The ones that do, though would be the new AAA players in the sector.

  • @prismaticbeetle3194
    @prismaticbeetle3194 Před rokem +6

    yah psychologists are gonna make a killing treating gamers for broken hearts when they fall in love with a fully realized random NPC

    • @mattrovis-hermann9194
      @mattrovis-hermann9194 Před měsícem

      Who wouldn't fall head over heels for an Ainsley Harriot lookin' barkeep

  • @Tenshihan-Quinn
    @Tenshihan-Quinn Před rokem +55

    This is INCREDIBLE! It's ALREADY comparable to Oblivion's interactions, ...just imagine if this was fully developed!

    • @digitalwayfarer7404
      @digitalwayfarer7404 Před rokem +20

      It's significantly better than Oblivion's. This LLM machine-generated text is better written than Oblivion's hand-crafted dialogue, lmao.

    • @NetherlandsFirst
      @NetherlandsFirst Před rokem +3

      ​@@digitalwayfarer7404Oh please, let's stop bashing Oblivion like so many have done lately. This AI may be impressive in noticing who you're looking at or referring to, but it basically said the same thing twice but in slightly different words: "your level is too low for this companion". And added some stilted "young adventurer" to it a few times. If you think that's better than entire scripts written for long and relatively intricate questlines, you're in denial.

    • @RobotronSage
      @RobotronSage Před 2 měsíci +1

      @@NetherlandsFirst Bro oblivions dialogue is so poor and so poorly scripted that the ''oblivion npc'' meme is applied to real life situations

  • @1231super
    @1231super Před rokem +192

    this is actually crazy! Even the way the AI knows what character you are refering to if you ask the bartender some questions.

    • @benjaminrogers9848
      @benjaminrogers9848 Před rokem +9

      Yes! I wonder how he added non verbal information to the query

    • @MrDezokokotar
      @MrDezokokotar Před rokem +27

      @@benjaminrogers9848 I can see how the point where the player is looking at (and so the name of the NPC thats at that spot) could be relayed to the AI. Either just by player head rotation or it could even be eyetracking in the VR headset for more accuracy.
      But yeah, that is pretty awesome.

    • @aidvokbr5943
      @aidvokbr5943 Před rokem +1

      ​@@MrDezokokotar i mean, chat gpt 4 can understand images right? So maybe he just make take a print pf the npc view and chatgpt understands who is the player talking about

    • @nessnake123
      @nessnake123 Před rokem

      Blows my mind trying to figure out

    • @larion2336
      @larion2336 Před rokem +6

      @@MrDezokokotar I saw a demo of Inworld AI inside Skyrim earlier. They explained that Inworld can use tags in the chatbot so that it knows what its looking at and triggers the relevant info of the character. So these scenes are still a little crafted in that sense, mostly by populating the characters with world info the same way you'd do writing a story for NovelAI, but the AI does the rest.

  • @thomasjamesbailey1209
    @thomasjamesbailey1209 Před rokem +18

    This is brilliant, knowing it will only get better is insane to think about.

  • @MrDezokokotar
    @MrDezokokotar Před rokem +31

    I just realized, other AI features aside, AI voice acting alone has huge utility in some types of games.
    A real voice actor will still sound better for some time but AI will have a "good enough" voice acting that can read an infinite amount of lines.
    Similarly, human writing will be preferable, but there will be additional writing by AI that will adjust the dialogue so that NPCs essentially never repeat themselves exactly, even if theyre giving the same explanation of a quest. But that will then have to be read by AI voice.
    I guess what im saying that that game VAs should be more scared for their jobs than game writers :D

    • @mars_j5479
      @mars_j5479 Před rokem +6

      Nah bro. Mediocre game VAs will be out of the job. Good VAs can still act (voice, tone, emotion, .etc) as the base of an NPC or they could sell their voice packs as subscription for developers.

    • @AmazingArends
      @AmazingArends Před rokem +1

      If the NPC dialogue in this demo is really all speech synthesis, not pre-recorded canned statements by a voice actor, that's insane! The speech synthesis is way better than what we currently have on the Mac PC or iPhone, such as the Siri voice or Samantha!

    • @wawawuu1514
      @wawawuu1514 Před rokem

      The developers of The Vanishing of Ethan Carter used text-to-voice while developing the game as placeholder voices, before finalizing the dialogue.

  • @Alocha18
    @Alocha18 Před rokem +16

    This is insane, game changer in gaming industry

  • @xFATMAN192x
    @xFATMAN192x Před rokem +6

    THIS is the Future of RPGs. Not graphical fidelity, larger worlds or longer gameplay hours, we’ve pretty much hit the ceiling on those.

  • @SanderLammers35
    @SanderLammers35 Před rokem +20

    This is gonna take the immersion to the next level. Exciting stuff.

    • @Darren123
      @Darren123 Před rokem

      Whilst I agree it's impressive I think the immersion could be quickly ruined if the NPCs are unable to take actions based on your dialogue instead of just verbal responses. For instance, you say to the innkeeper here "there's a rat in my bedroom go get rid of it" and he actually goes to the bedroom. I imagine stuff like this would be so much harder to fully implement though

    • @Husky92223
      @Husky92223 Před rokem

      As long as the voice reproduction won't be so robotic hehe

  • @DymoPolska
    @DymoPolska Před rokem +73

    I wonder if having some diverse pre-made dialogue answer beginnings or answer intros could be used to start the answer and mask the gpt "response calculating" time. It's natural in human conversation to have some pauses or "well... you see". Perhaps even some pre answer generator based on first couple of words of player character, followed by gpt passively listening to the rest, and generating full answer while the pre answer buys some time for that. Great job!

    • @sirweebs2914
      @sirweebs2914 Před rokem +12

      thats a good idea and should be possible

    • @fredrikekholm3718
      @fredrikekholm3718 Před rokem +5

      Yeah that's definitely doable and a good idea for now. These pauses will get shorter and shorter the more technology evolves, but for now it could be a nice way to cover them up.

    • @superzolosolo
      @superzolosolo Před rokem +2

      The truth is that it doesnt have to pause at all, I mean when you send a prompt to chatGPT it responds almost immediately. Unless the problem is with the text to audio, it might need the whole sentence before it can start generating audio, so if thats the case then your solution probably wont work that well

    • @caffeineaddict213
      @caffeineaddict213 Před rokem +8

      I usually prelude my sentences with 8 seconds of silence, creepily staring at my conversation partner.

    • @understandingwithjake
      @understandingwithjake Před rokem

      Great idea

  • @VioletPrism
    @VioletPrism Před rokem +10

    Brilliant combination of recent releases! I would love to know more about your process but for now I will just try my best in unity. Thanks you are an inspiration!

  • @Pixeleyes
    @Pixeleyes Před rokem +2

    I'm starting to understand the writer's strike now, this technology is going to wipe out entire industries overnight without legal protections. I am shocked at how quickly this tech is developing, and how slowly we are adapting to it.

  • @TravisHi_YT
    @TravisHi_YT Před rokem +1

    So you've destroyed the role of a DM and have allowed for single player table top adventures. Congrats, this is revolutionary for so many applications!

  • @Lazy_Player_
    @Lazy_Player_ Před rokem +17

    Imagine a group of bandits interjecting your conversation because they overheard you talking to your companions over your spoils from a dungeon. The bandits began to threaten you and your companions and you will decide to start a fight or persuade the ai bandits out of fighting.

    • @Darren123
      @Darren123 Před rokem +2

      Stuff like this would be awesome but I think the example you're talking about would need something deeper than just a language model as it's dealing with actions instead of just dialogue. I think that's the holy grail of a.i in video games. This video's demonstration of spontaneous dialogue is an impressive start but getting the a.i to create actions in the game world based on things you say would presumably be a much more complicated endeavour

    • @ittixen
      @ittixen Před rokem +6

      It's pretty trivial. In-game actions are just scripts, after all. Not much difference between "The bandit approaches the player and draws his sword" and "bandit.walkTo(player.position); bandit.drawWeapon();". This kind of gameplay is right around the corner. All the pieces are there, it's just a matter of putting them together.

    • @luchinazo
      @luchinazo Před rokem +1

      @@Darren123 it's present on every game then, just run another script with another context leave some task to the hard programing and some for the AI

    • @Mega-Brick
      @Mega-Brick Před rokem +2

      We're still a long way off from it, but imagine a game where your Charisma/Speech skill isn't just a number on a sliding scale, but a reflection of the words _you_ choose and the level of confidence you deliver them in. That'd be incredible.

    • @Mega-Brick
      @Mega-Brick Před rokem +2

      @@ittixen I think the biggest limiter right now is just the cost of maintaining the servers to process it all. It's probable that games with this sort of tech will start as paid-service games (like MMORPGs) to fund the servers, at least until local computers become powerful enough to handle it locally.

  • @youaintready1006
    @youaintready1006 Před rokem +4

    This was one of the first things I thought about when I realized what ChatGPT could do, but I don't have the dev skills to pull it off. Super cool that you did. This is insane.

  • @JonnyLawrence
    @JonnyLawrence Před rokem +1

    it's like you're playing a game and suddenly find yourself talking to Morpheus

  • @ifeanyi212
    @ifeanyi212 Před rokem +3

    Man I’m so glad to be alive in a time where ai is at this level of complexity and able to be applied in scenarios like this. Fingers crossed within the next decade full flow character conversions will be a main component of all RPGs, crazy.

  • @4reg4
    @4reg4 Před rokem +3

    he sounds less like a bartender living inside that world and more like a fourth wall breaking tutorial tip popup

    • @catocall7323
      @catocall7323 Před rokem +1

      Yeah, I found it rather unimpressive

  • @Kraaven2026
    @Kraaven2026 Před rokem +49

    bruh, this was insane, imagine have a local environment text file for each area, like the tavern, that NPC's could pull as information.
    Example: An NPC that is high leveled or is somewhat dangerous enters a tavern. assuming that they are also described as well known, the moment they enter, their "public information" is dumped in a tavern text file. Hence, when you talk to an NPC, they use 2 prompts, your question and the local information/info they are supposed to detect, and then make an answer accordingly. This should allow dynamic speech depending on the actions of other NPC's, hence not acting as static entities. This also allows the creation of small surprise events, where if the local file mentions the presence of many highly dangerous individuals, when prompted to act, the tavern keeper may alert someone else, OR, when said individuals enter, a undercover hero whose AI read the global text of the cavern, they may act accordingly, unless there is also an enemy they know they must hide their identity from, hence they wont act.
    I would like to see what would happen if such a Global text file for each environment may affect the speech. it could include variables like population, number of drinks, maybe even number of mages. special comments like the presence of the guildmaster, or a few criminals, which should affect behavior of some NPC's
    Overall, your demonstration was mighty impressive, heck, if you were to add a closed captions like box in the bottom to read dialogue, the game would actually be quite playable. Do NPC interactions depend on whether you are facing them or not? is there a conversation toggle that is set to true when you talk to someone? i am quite curious as to how you are planning to proceed with the project. Thanks for sharing the experiment with us, and i hope you have a great day!

    • @larion2336
      @larion2336 Před rokem +2

      If you like this, look up also Inworld AI Skyrim.

    • @KuroHebi
      @KuroHebi Před rokem +1

      Your idea is ingenious, makes perfect logical sense.

    • @dudeguy8553
      @dudeguy8553 Před rokem +2

      The NPC should also take account of your actions when you talk to them, for example if your arm or hand is pointed at somebody, or if you're facing them or not. Perhaps it can confuse you with other characters if it only inherits a procedural description of your appearance from this aforementioned local enviroment

  • @calcariachimera
    @calcariachimera Před rokem +2

    Wow, gaming with real AI would change the experience every time, this is amazing!

  • @Kowalth
    @Kowalth Před rokem +1

    Finally, no more "Need something?" or "Never should have come here!"

  • @Machiavelli2pc
    @Machiavelli2pc Před rokem +61

    WOW! This literally just opened my eyes to the future prospects of having a personal world in which anybody can slip into and still have meaningful and engaging/entertaining interactions/conversations in a world of anyones choice and imagination! From rpgs, to NSWF worlds/stuff ;), this seems AWESOME! Keep up the good work! :)

    • @fresh218
      @fresh218 Před rokem +3

      The future is now haha

  • @theackerman6159
    @theackerman6159 Před rokem +6

    Truly a wonderful concept, something I have wondered if we would have in the future, I’m happy to see a functional prototype

  • @Sickness717
    @Sickness717 Před rokem +6

    so what you're saying is I need to actually have rizz in order to romance the hot rogue?

  • @araragisan6571
    @araragisan6571 Před 3 měsíci +2

    this is the future of the game
    master when the NPC is not just a scripted dummy with a couple of phrases, but already, so to speak, a living person within this world
    , he has his own thoughts, his own desires, emotions, etc
    . so you can come to the tavern like this, pour yourself into one glass of software beer and into your real one and have a heart-to-heart chat that's not afraid to say for real with the bartender-ai

  • @DynastyUK
    @DynastyUK Před rokem +26

    This is going to be so hard to program what information the characters don't know. They need to make more rules about what it doesn't know than does. I can imagine a detective style game like La noir would be amazing but you're in charge of making up the questions.

    • @indi4091
      @indi4091 Před rokem +2

      It wouldn't know everything about the game, only what is given to begin with.
      What's interesting is that these AI characters can be left running when the player is not there, and they may or may not have gathered more information from their environment since the last time you spoke.
      You or others talking to it will add to its knowledge. You could really break the game on your second play through by telling it everything you know about the world which you shouldn't know yet, which could really mess with any plans the Devs have for constraining progress of the story.
      The whole thing might have to be generated dynamically. Which is a huge task, auto generated content is probably not going to be as good as a normal RPG

    • @russianbot1779
      @russianbot1779 Před rokem +2

      Just set info locks, for instance, if a player knows the end boss is a large dragon, you could lock the AI and say stuff like "I doubt it" "that's crazy" "there hasn't been dragons for 1000s of years."
      That being said the AI couldn't be too smart or it would brake the game too, like the player could call the NPC an NPC. Obviously the AI should ignore it or respond cleverly without breaking character.

    • @thermonuclearwarhead
      @thermonuclearwarhead Před rokem +2

      Yeah, biggest weakness is you could ask this dude about his thoughts on hen breeding and he’d give you an 8 page essay on it.

    • @Evilhunter-di9sg
      @Evilhunter-di9sg Před rokem

      @@thermonuclearwarhead That's only limited to the GPT model since it was designed to be a general model. Some models are designed for role playing (not gonna mention the name) it could tell you that it doesn't know even though it does.

    • @Schattengewaechs99
      @Schattengewaechs99 Před rokem

      Future games will contain an AI trained on an universal lore and history book.

  • @jogoegel1279
    @jogoegel1279 Před rokem +8

    This has a LOT of potential! hopefully it can be perfected in my lifetime, i wanna try playing a game like this

  • @VortexTheFirst
    @VortexTheFirst Před rokem +1

    A huge Open World VR Game with interactive NPC's, I'd pay so much money to play that

  • @dvdragond2
    @dvdragond2 Před rokem

    I can't wait for an almost instant response rather than awkwardly waiting for the NPC to talk or act

  • @neoshenlong
    @neoshenlong Před rokem +5

    Damn this makes me think a game similar to the idea of Westworld is possible. An actual human scripts the situations and encounters, but AI lives through them, making them unique and having an element of randomness and generative narrative while also having a clear narrative structure and frame.

    • @v4v777
      @v4v777 Před rokem

      Yes.. it would be awesome.. but each NPC apart from the lore of the game that they should know, they have to be given also a certain personality, and a range of reactions, so they dont behave and talk all robotic... but give the illusion of emotions on their reactions and talking...

    • @neoshenlong
      @neoshenlong Před rokem +1

      @@v4v777 I think this isn't that hard. That's where a human needs to write code and think about the stuff that a player might do. When they talk to you, consider some things: Who asks? What are they asking about? When are they asking it? Where are they asking it?
      If a player asks a bartender to give them a beer, but they don't know the player and it's 10 pm and they are inside of their house, the reaction might be rude, scared, agressive, etc. If its the same situation but they know the player and they are pretty close, it might be differnt, and so on.

    • @Vasilefs_Terranorum
      @Vasilefs_Terranorum Před rokem +1

      So long as no one starts to think the NPCs are actually sentient.

  • @nilsolsen8727
    @nilsolsen8727 Před rokem +3

    This will make D and D style soo much more accessible. I hope they do nail the personality and believability. Hopefully they remember what you say to them unless you reload save files etc.

  • @thisguy4505
    @thisguy4505 Před rokem

    "solo'ing some easy dungeons" is pretty immersion-breaking dialog, but it's an interesting experiment!

  • @denisdenisius4313
    @denisdenisius4313 Před rokem +1

    GPT 4 has raised the bar for dialogue in the game so much that now any RPG game that does not have this technology will not attract the attention of players.

  • @Ken-nv2hl
    @Ken-nv2hl Před rokem +11

    Imagine one day AI can create their own triggers, and events within a game based on user interaction

    • @VarietyGamerChannel
      @VarietyGamerChannel Před rokem +1

      Just have oblivion's radiant AI system, but all handled by chat GPT 4 or 5.

    • @m.tahjulreyhan6976
      @m.tahjulreyhan6976 Před rokem

      Dam bruh a quest that is not progragrammed by the developer but it create its own quest By interaction is wild

    • @TrendingScope777
      @TrendingScope777 Před rokem +1

      im really tired and read triggers with tr reaplced with n

  • @kameraadthomas
    @kameraadthomas Před rokem +5

    Holy shit this is very cool. Surely a gimmick for now but in a couple of years I hope to see this in any RPG game really.

  • @godgodly9044
    @godgodly9044 Před rokem +1

    >Go into bar
    >Ask for battletoads
    >They try and kill me
    >Respawn
    >Ask for battletoads again

  • @calmhorizons
    @calmhorizons Před rokem +2

    Generated from Chat-GPT 4 - a long-winded diatribe from a local guard.
    Welcome to the generic, long-winded, copy-right infringing future...
    ---
    I was an adventurer like you, but then I took an arrow to the knee...
    My name is Tormund Shield-Bearer, and I hail from the rugged lands of Skyrim, born in the small village of Rorikstead. Growing up, I dreamt of exploring every corner of Tamriel, fighting fearsome beasts, and discovering legendary treasures. My childhood was filled with excitement, as I trained daily with the village blacksmith and listened to the stories of brave heroes.
    As soon as I was old enough, I left Rorikstead to pursue my dreams, seeking fame and fortune as an adventurer. I joined a band of like-minded thrill-seekers, and together, we traveled the length and breadth of Skyrim, seeking out dungeons and ancient ruins. Along the way, I honed my skills in swordsmanship, archery, and the magical arts.
    Our travels took us to the depths of Bleak Falls Barrow, where we uncovered the legendary Dragonstone, and to the treacherous Dwemer ruins of Mzulft. We braved the harsh conditions of the Sea of Ghosts and stood toe-to-toe with mighty giants on the plains of Whiterun. My companions and I became known throughout the land for our bravery and skill.
    But fate, it seems, had other plans. One fateful day, as we journeyed through the forests near Riverwood, we were ambushed by a group of bandits. It was a fierce battle, and although we ultimately emerged victorious, my life was forever changed. A well-aimed arrow struck me directly in the knee, shattering bone and tendon.
    I was forced to leave my companions and return to Whiterun, where I underwent a long and painful recovery. My adventuring days were over, but I refused to let my spirit be broken. Once I was able, I took up a position as a city guard, using my skills and experience to protect the citizens of Whiterun from threats both within and without.
    Now, I walk the streets of this grand city, a shadow of my former self, yet still proud of the life I have led. I can't help but feel a twinge of envy when I see young adventurers like yourself, setting out on a journey that I know all too well. But do not mistake my injury for weakness - I am still a warrior at heart, and I will defend Whiterun with my life, if necessary.
    So, go forth, brave adventurer, and make your mark upon the world. But remember, fate can be a cruel mistress, and the path you walk may not always be the one you planned. And when your travels bring you back to Whiterun, I'll be here, guarding the city gates, a reminder of the past and a testament to the strength of the human spirit.
    ---
    I hope there is a skip button.

  • @saeruji
    @saeruji Před rokem +3

    Wow. That was good. Can't wait to see what happens in some time, when there will be a fast and precise model that could be used for every NPC.

  • @cjk2590
    @cjk2590 Před rokem +6

    Yooo this is so cool it really can bring the rpg genre to a whole new level well done 👏

  • @rodrigod4
    @rodrigod4 Před rokem +1

    love how the AI realizes you suck and shouldnt be bothering high lvl NPCs

  • @iamtheteapot7405
    @iamtheteapot7405 Před rokem +1

    Wow the possibilities are mind blowing! NPCs making genuinely unique dialogue and perhaps even entire quests or even stories written new each playthrough.

    • @gearoidoconnell5729
      @gearoidoconnell5729 Před rokem

      Come back from the cave and ask can team up. Tell me my level is too high for them lol.

  • @ariwijaya538
    @ariwijaya538 Před rokem +3

    Couldn't imagine how great this will be in 100 years and all the joy our grandkids will experience in their games

    • @stardaggerrihannsu2363
      @stardaggerrihannsu2363 Před rokem

      Esp having sex with characters they design!

    • @Fabsi87
      @Fabsi87 Před rokem +1

      100? Technology like this will be old tech nobody remembers like landline phones or cassette recorders.
      In 100 years you upload games directly in your brain.

    • @Mr.Reality
      @Mr.Reality Před rokem

      @@Fabsi87 could be but im not so sure about that.

    • @jean178pere
      @jean178pere Před rokem

      @@Fabsi87 thats never going to happen. your brain is not virtual, its analog. You cant upload things to your brain

    • @lordm1889
      @lordm1889 Před rokem

      make it 5 years lol

  • @webprobitaille
    @webprobitaille Před rokem +12

    This presentation is super interesting! As a Unity Developper and VR specialist, I want to reproduce something similar. Can you share some information about how you integrated all the technology inside your project?

    • @HairyJuan
      @HairyJuan Před rokem +5

      You should just ask chatgpt itself

    • @Rick-rl9qq
      @Rick-rl9qq Před rokem

      not an expert or anything, but he probably used auto gpt along with trained models and connected all models in the game. then,, the models speak to each other and produce what you see. just what I think though, take it with a hand full of salt

    • @masterchiff6784
      @masterchiff6784 Před rokem +1

      You use the API from OpenAI and pass it some data along a crafted prompt.
      You tell the AI what it is, like a bartender in a medival tavern and then you can pass data to it in some format, JSON or whatever that you export out of your game, like game state, for example Player 1 - Is alive. Player 1 - is looking in this direction etc, etc, etc... Then tell AI to respond and give it options that it can do as well, tell it that it can move its head towards any object and give it a list of objects (that came out of your game).
      However as it stands right now, this is impractical because of the delay. But if the delay gets shorter it will make for some nice games. Probably future games will implement their own customized models for the specific genre/game inside the game itself and eliminate the delay.
      It's just around the corner, exciting times.

  • @OfMiceAndMegabytes
    @OfMiceAndMegabytes Před rokem +1

    Great possibilities for this in future games for tutorials without signs popping up on screen. Hopefully the bigger studios see the potential.

  • @YouTrolol
    @YouTrolol Před rokem +2

    "soloing some easy dungeons"😂
    I guess it needs some fine tuning of gamification vs immersion.

  • @MogulSuccess
    @MogulSuccess Před rokem +3

    It would be cool to use AI to build the VR worlds - prompts as magic spells or something to cut development time down

    • @jarblewarble
      @jarblewarble Před rokem

      I've seen some AI tools that can generate 3D animated characters, like MAV3D.

  • @mueezadam8438
    @mueezadam8438 Před 2 měsíci

    I love these. When you made the rogue disappear I laughed 😂

  • @francois9747
    @francois9747 Před rokem +1

    A.I will be the bridge between the science-fiction we see in the TV series "Black Mirror" and reality itself.

  • @bluecrusader
    @bluecrusader Před rokem

    AWESOME Video! So immersive and nice little experiment!

  • @reillymercer5949
    @reillymercer5949 Před rokem +1

    I'm just disappointed the AI didn't call him a noob and say he's going to get killed and teabagged.

  • @imaboud
    @imaboud Před rokem +1

    Imagine a complete AAA rpg open world rockstar game with this AI

  • @johnwilliams2259
    @johnwilliams2259 Před rokem +1

    Skyrim Modding Community gets a hold of this video just wai-

  • @BernhardRutzen
    @BernhardRutzen Před rokem

    This is perfect for learning new languages with ChatGPT, this is the future.

  • @RustyCantRead
    @RustyCantRead Před rokem

    I cant wait to get stuck in a loop of asking a potion-maker to sell me their strongest potions with dramatic music in the background

  • @zeetstweets
    @zeetstweets Před rokem

    I'm giving this 10 years and we'll see this type of stuff on the market just 10 times better

  • @netyimeni169
    @netyimeni169 Před rokem

    If a huge corporation makes such game, it will easily become the best game on the market.

  • @JBrander
    @JBrander Před rokem +1

    I enter the tavern and the first I'm gonna ask the barkeep: "You got any Jet?"

  • @TheTopGameReviewer
    @TheTopGameReviewer Před rokem +1

    Imagine getting drunk in real life going round the tavern talking to all the npcs like your actually there, what an immersive experience that would be !

  • @kinnarawanderer
    @kinnarawanderer Před rokem +1

    It is clunky and goofy and I LOVE EVERYTHING ABOUT IT

  • @Patrick-ryan-collins
    @Patrick-ryan-collins Před rokem +1

    I'm willing to wait 10 more years for Elder Scrolls 6 if it has this technology down-pat

  • @JoseTorres-ry9qe
    @JoseTorres-ry9qe Před rokem +1

    Plot twist: The rogue was there to assassinate _YOU_

  • @OgieSifter
    @OgieSifter Před rokem

    This is honestly how I've been running personal solo adventures with just text

  • @leoboz1113
    @leoboz1113 Před rokem

    That pretty much means, once it's developed properly there will be never ending video games. Holy cow.

  • @PapasGatito
    @PapasGatito Před rokem +1

    Can't wait for this technology to be refined and come out so I can have a caring father figure lol

  • @antiHUMANDesigns
    @antiHUMANDesigns Před rokem

    This is for sure how future "Elder Scrolls" games will be. Probably not the one they're currently working on, but the next.

  • @JASHIKO_
    @JASHIKO_ Před rokem +1

    This is one of the things I'm most excited about for ChatGPT and similar. Especially if it is trained on the games entire Lore. Imagine D&D lore pumped into a system like this!

  • @sorecentipede
    @sorecentipede Před rokem

    I think that this kind of technology is far more impressive than photorealism

  • @thedanyesful
    @thedanyesful Před rokem

    I feel like the absolute seriousness of, 'soloing some easy dungeons', is memeworthy.

  • @SuppositionalBox
    @SuppositionalBox Před rokem +2

    Ill be frank with you, friend. This content right here is why I subbed and liked. Working on this stuff is probably going to carry your channel far, thanks so much for starting this stuff!

  • @areadhead
    @areadhead Před rokem

    I've been chatting to chatgpt for the first time and I couldn't believe how amazing it felt. I didn't realise how much the language interface changes how real the conversation feels. I know nothing about what you're doing but I am fascinated how the npc has the right info and how it knows which characters you are talking about

  • @_inetuser
    @_inetuser Před rokem

    it was on all our minds to do something like this as this is the future, youre the first one to do this AFAIK, historic

  • @TheTacticalDood
    @TheTacticalDood Před rokem

    Finally, a useful application of ChatGPT.

  • @alexiezachariades4872

    AI Bartender: You got no skills, you got no experience, no one wants to be your friend.

  • @Askanon
    @Askanon Před rokem

    We have literally opened Pandora's Box here. There's no going back.

  • @Prototeen
    @Prototeen Před rokem

    Jesus, imagine walking around Mass Effect's Citadel. Getting one on one with every race, learning about certain hardships and befriending anyone on a massive space station could be a game in itself with this tech!
    8 seconds definitely is keeping this from going prime time, but the fact that we can do this AT ALL IN 2023 is mind blowing!

  • @gamesthatiplay9083
    @gamesthatiplay9083 Před rokem

    It's like a computer reading off a laundry list.

  • @BanditoBurrito
    @BanditoBurrito Před rokem

    This technology could make every single RPG you play completely unique depending on how well it’s implemented. You could actually have a companion who remembers every adventure you two have gone on.

  • @adidam8865
    @adidam8865 Před rokem

    I don't think I want GTA VI without this tech tbh, this will change gaming forever, every open world feels so lifeless, if you can tell npc what to du, like hands up, get on the ground, follow me or whatever, that's the game we always wanted, we're so close, the first open world game with this tech will change the industry forever

  • @Samuell8
    @Samuell8 Před rokem

    reacting to the women vanishing and being able to make something up in relation to her character.. my mind is blown

  • @Killerwale-hk4wy
    @Killerwale-hk4wy Před rokem +1

    I'm pretty sure that near the end of this decade, there will be some really nice games with this in it's engine. It has so much potential, but really needs some polishing. It has potential to become something great or terrible, and it's fun to be here to witness the start of it.

  • @LandsLife
    @LandsLife Před rokem

    "And one day you might be as tough as some adventurers in this Tavern", gave me a whole new perspective.

  • @rgerber
    @rgerber Před rokem

    not long until a entirely procedural RPG world is created with literally endless quests

  • @aerotus888
    @aerotus888 Před rokem +1

    I don't think a bar tender would be that well spoken

  • @5jones
    @5jones Před rokem

    Todd from Elder Scroll and Fallout said they are trying this sort of thing. I love it!

  • @wrongfranco
    @wrongfranco Před rokem +2

    Turns out AI is the key to metaverse. What a surprise to Zuckerberg.

    • @ddr8993
      @ddr8993 Před rokem +1

      I hope that's sarcasm

  • @VeryFamousActor
    @VeryFamousActor Před rokem

    I can already picture the nightmares that'll unfold when the bots start talking to eachother. Say someone leaves their game on and two NPC's start having a 6 hour conversation about Israel

  • @RedDevilsAlways
    @RedDevilsAlways Před rokem +1

    Oh boy the future of gaming is looking interesting to say the least

  • @Daydricoldsmith
    @Daydricoldsmith Před rokem

    I can just see people using this while drinking and talking to them as if they were a therapist.

  • @totallyfackedmate
    @totallyfackedmate Před rokem +1

    some people wont ever experience the real world anymore when this ai stuff becomes serious xD