AI NPCs Will Change the Game
Vložit
- čas přidán 16. 04. 2023
- Linus and Luke discuss the development of semi-autonomous AI agents that can act as assistants or video game characters.
Watch the full WAN Show: • I Give Up - WAN Show A...
► GET MERCH: lttstore.com
► LTX 2023 TICKETS AVAILABLE NOW: lmg.gg/ltx23
► GET EXCLUSIVE CONTENT ON FLOATPLANE: lmg.gg/lttfloatplane
► SPONSORS, AFFILIATES, AND PARTNERS: lmg.gg/partners
► OUR WAN PODCAST GEAR: lmg.gg/wanset
FOLLOW US ON SOCIAL
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
TikTok (LMG Clips): www.tiktok.com/@_lmgclips_
Twitch: / linustech - Věda a technologie
Imagine making a friend or starting a relationship with someone online and finding out they were AI the whole time
I put my hamster in a sock and slammed it against the furniture.
I'd still hit
Always has been
@@lukashernandez7188 lmao she dumps him
@@TippyHippy this made me laugh uncontrollably. it's such a horrible thing to do but i'm laughing
the day I can use my mic to talk to NPCs and ask them anything and they reply, is the day we achieve a true RPG experience.
I'm just imagining my future VR baker life where I just yell over to Helga and ask if she wants some bread after I'm done taking it out of the oven.
@@MrC0MPUT3R The Sims VR version? haha
@@MrC0MPUT3R some people just wanna see the stove burn, huh
@@StoneGear wow that's crazy dude. THanks for sharing
And it has been done, someone just made a mod for Skyrim that does just that. Look it up, GPT skyrim mod.
Gaming is one of the areas I am most excited for with the AI rush. RPG games gonna be crazy in a few years
@@oh...hi. what about them?
What happens when you kill a npc that claims to be alive? things start to get weird when you add advanced ai to games.
@@ihavetubes the NPC dies? Everything is weird if you think about it to much
Few years ago Back when I played Skyrim a lot I imagined a future where the NPC could be powered by really smart AI and the world could evolve with independent AI that would be "free" to have their authonomy (within their parameters). How cool would it be to play in a world that can really change and evolve in unexpected ways
Oh my god I can only imagine. That would like just suck me straight into RPG games
On r/unrealengine, there was two separate independent tech demos for gpt powered npcs.
The first one was a standard rpg npcs, the protagonist was able to ask extra questions about his quest.
The second was a project called “social engineering” there was a guard blocking a door, the protagonist had too convince the ai to let him through. This was posted 30 days ago
Link?
Cool
I remember seeing those! I've actually been talking to one of the devs, and it seems like they are trying to go in the direction that this gaming discussion is talking about. Persistently developing world with conversational AI and ML-based pathfinding for party members that play with you. It's multiplayer, but by yourself. I've done some of the pathfinding work. AI PvP is insane to watch.
@@jakeq3530 That is not AGI. We are nowhere close to AGI. Being able to talk with AI as with human is not AGI. We will likely have AI that will be indistinguishable from a real human within 2 years however that is still not AGI. AGI needs to be able to run, seek correct resources, self train itself continuously and self reflect on the data gathered until it can arrive at a correct solution to a complex problem without having prior contact with it. All without further prompting beyond the initial. It needs to be able to solve problems that were never solved by a human before. That is still extremely far away.
@@Telhias agree, also don’t you think that you could setup multiple different ai all set on different task that relate to each other in a link for self learning without human interaction or human feedback for example, one collects info and passes it on to one that utilises it to create whatever, passes it on to an ai that tests and creates feedback … either this or something similar but with the funnelled goal of creating a constant continuous learning cycle that can learn and improve without any help and or additional info.
P.s I have no knowledge on how so actually works lmao
so D&D is finally going to be possible? the only thing holding that back has been coding all the different tangents players can go through, but now with AI agents being a possibility would open an insane number of doors.
AIDungeon exists
@@p_serdiuk And it has a lot that can be improved with use of GPT-4
@@Hobby_Technology I mean, just plug the GPT-4 into it if they didn't already lmao
@@p_serdiuk There is way more to completely upending a game's architecture like that than just "plugging it in"
The most loneliest game of D&D ever
Imagine GTA police responding uniquely and dynamically to every scenario, using tactics specific to whatever building you're in, and making active callouts to your exact position like "He's in that bathroom, no, hes behind that pillar, fuck, get grenades up here."
I know that would be so fun to mess with! I once had ChatGPT run a D&D session for me, and wanted to test it out. So I went to the tavern and drank a bunch, acted absurdly silly, waved my arms around, made a lot of noise, and danced clumsily on the table. I told ChatGPT that I rolled a 2 on my acrobatics check, and then it described me falling over and hitting my head on the floor.
But what was most entertaining for me is how ChatGPT described the bartender's reaction to me after each prompt. It described how he and everyone in the tavern when silent and watched me. The barkeeper asked me to leave quietly, but instead I chose to belt out a "well known sea shanty" and then the whole tavern started singing with me one by one throughout the song. That's when the dancing on the table started, and when I fell, the bartender got concerned and helped me up. That's when I told ChatGPT that I tried to fake being hurt, but I rolled a 3 on my deception check. The bartender, paused and then got angry at me again. So I tipped in a gold piece for his trouble and started to walk out. ChatGPT then described how that stopped his anger immediately, but he stood there very confused not knowing how to react.
How hard would hitman games get?
You shoot up a building and the police doesn't intervene, only prevents bystanders from stopping you, because police AIs decided that this behavior is most beneficial
oh and hopefully finally no more police just spawning in. now they actually have to drive to you!
@@ex0stasis72Dam do you play with people?
Why is everyone so lonely?
Thinking back to the Skyrim gameplay, you would hit an NPC and then immediately everyone in the entire district wants to kill you. It was a really "dumb" game response. But if it were AI-controlled, there would only be a few NPC's who directly witness your crime and respond violently. Everyone else in the village is oblivious at that point, but information would soon spread and other NPC's would respond to that indirect information based on how much they trust the legitimacy of that news. It would be a much more realistic response.
There could be the bystander effect, or someone could break your fight up. Guards could use discretion in how they punish crime, based on their own personalities and values.
@@riverw4721 I mean they kinda already have this in rdr2. I think these systems could emulate that easily.
@@riverw4721 Guards could accept bribes depending on their mood and weighted by current financial situation, if they are struggling that will be more likely to take bribe.
Fear the chicken!
@@SainiRohan Rdr2 is the closest thing to AI actors without any actual AI.
its insane how much of a daily life each NPC has and the degree to which you can bother them/become suspicious/help them/etc
THIS is what I have been waiting for since AI started becoming popular. Imagine a GTA game where EVERY npc had a unique daily life. Imagine they all looked unique and had unique voices. They had a job they drive to in the day and home they go to every night.
Free Guy
free guy
sounds like a marketing hype bullet point gullible gamers believed
we kinda had that on Shenmue, and Majora's Mask, pretty limited but same concept.
And then I stomp on their head while they beg to see their children
VRMMOs created by an AI are a huge troupe in Korean novels/manhwa. Where you have a super powerful AI that is able to simulate an entire living world and it's Populus, have quests that are made on the fly based on player decisions. I can't wait until we can get something like that.
I wonder who popularized the trope, China or Korea? Ngl, the VRMMOs I've read are usually Chinese, so I'm leaning towards China.
@@syntrx8185 korea has historically had a massive computer gaming scene and has had a lot of very old vrmmo manhwas.
@@syntrx8185 99.9999% it's korea
South Korea was rich enough to create sci-fi concepts for the gaming scene for far longer than China. China’s modern sci-fi scene only came into being in the 1990s and focused mainly on societal affects of cloning and worker robots.
Most of the time the "AI" in stories like that is just a way for the characters to converse with the system they live in and not actually an AI character with a purpose outside conversation.
The AI town/NPC/society sounds very similar to what happens in Ender's Game and the "game" Ender broke and eventually the AI that becomes his friend built/created.
These AI npc's sound really cool feature for when you can play an actual realistic Sword Art Online type of game
(edit: it would be amazing to just play a game thats realistic and that will able to kill if you die.. Or well I guess that could be considered a bonus)
I'm not familiar with the difference between the books and the movie, but in the movie the game didn't 'break'... it was influenced by an external intelligence. That is not the same thing as AI doing something unexpected.
@@Tucarius In the book the game was made to adapt to the player, and Ender kept breaking it, so the game evolved far beyond what it was ever meant to do (eventually leading to the creation of its own sentient and sapient entity that we get more familiar with in the next books). As I read it, the external intelligence was connected to Ender as he obsessed over the game (he had dreams of the Formics and of the game), rather than to the game itself, and they recreated the game environment on one of their planets as a sign for him to find. Could be wrong, though, it's been a few years since I read it.
Enders game wasnt about A.I.
Ender was tricked into playing a "simulation" - But it turned out it was a real war... And he couldn't come to terms with Genocide.
@@Pemalite Tell me you have not read the books but only seen the movie adaptation, without telling me you have not read the books but only seen the movie adaptation.
The MMO game they described sounded a lot like the anime Log Horizon where the NPC gained sentience and the player themselves were able to change the world around them either by themselves or by recruiting the NPCs to help. I mean one group of players even took an entire city hostage and essentially enslaved them just so they wouldn’t have to work themselves.
It's so cool to see Luke and Linus invent DnD in real time
ai is basically a dungeon master
sounded a lot like the Nemesis system from Shadow of Mordor
@@ookami5329I’ve been using it as a DM. It’s not very good at combat lol. I’ve messed with my prompts quite a bit. It’s pretty nuts but the stories fall apart too. But when it’s working holy cow is it amazing. The new Claude 2 is very good at creative writing. It’s floored me quite a few times when it came to interactions with other NPCs.
I’m thinking I’ll need to have it come up with a specific story arc ahead of time then follow it as best as it can and push me back towards the main goal. Without that it just seemed to lose sight and wander from the main goal it had come up with to begin. If it had a story with a few sub missions already planned in a coherent way it might keep up since it really depends on what is actually written in the conversation. I just have to skip over it and not spoil it for myself and hope it works.
I’ll tell you one thing. Have Chat GPT generate the character sheets because Claude 2 just makes incomplete ones with varying formats. Kinda shits the bed. Lol
This episode just keeps me getting more and more hyped for gaming in the coming years! FUCK YEAH I WANT A WORLD THAT RESPONDS TO ALL MY ACTIONS.
Probably the only positive from this AI shit
@@peighnesshonourchign9164 what about all the scientific and medical advancements it's helping humanity achieve? lol
Finally! Actual gaslighting in a game!
It already exists, it's called real life
Now are you willing to pay 9.99 monthly for it?
I look at EVE Online (just as an example of a game with insane player self-organization and a very developed and diverse economy) and I imagine a game like that but with actual AI factions that players can influence to do stuff. The shenanigans would be exponentially funnier.
Space sims in general would be sick with this.
Eve Online does have NPC factions, but they are usually mining or they are enemies that you destroy. I see what you mean. The NPCs could have the same ships as players, but I do not know how that will affect the gameplay.
Eve Online is one of those games that's better to want to play than actually play.
I say this as someone who has a 12m SP character 🤣
@@tekeagle2136
They could make for more dyanmic gameplay with the devs being a bit more hands off
First thing it would learn is gate camping... 😆
@@Zahgurym
With bubbles and jetcans to exploit insta-decloak
There was a massive battle that happened in Eve Online a couple years ago that no player was involved in. 2 NPC factions tried mining in the same place and, since they were enemies, attacked each other. The NPC mining fleets are designed to reinforce when you attack them, so both fleets kept massively reinforcing, resulting in a massive battle. Then a third faction warped in and annihilated everyone.
Huge battle that no-one knew happened, until CCP Games saw it in the game logs.
The early years of Ultima Online actually had similar dynamics to what you’re talking about in terms of a persistent world affected by player action - including an economy that was affected by player actions. And Ultima VII back in 1992 had proper daily NPC schedules for all NPCs. Having AI dialogue implemented in a game like that would have been amazing
there is a video from Ars Technica on this exact topic with the creator. Basically anything that was non hostile kept getting wiped out and any of the solutions couldn't keep up.
Violent games will lose their novelty when the AI NPCs are begging for mercy and crying "Please I have children"
It creates a possibility for absolutely gut-punching anti-war games.
when i was like 15 or so i saw a robbaz video where he was shooting sims. he shot an older woman in the head and seeing the others break down crying / run away upset me deeply.
violent video games are better when they're cartoonish and the characters are canonically insane. like team fortress 2
For some people that'll enhance it massively lmao
'today we're doing your 8hr psych eval' -hands you a controller
I don't think so, that'll only make it better :)
Be careful not to kill anyone in the game. Who knows, maybe the characters will follow you to the real world
AI: You killed my father and I am now using this robotic body to take revenge on you
Hello. My name is Inigo Montoya....
Luke, I am your father...
Or worse, if everyone playing the game gets trapped inside of it.. Sword Art online style. That's what I was thinking about when he listed all of the things ai npc's could bring to a game.
😂 this is a mind fvck
Guys can we make these artificial intelligences we need to make sure that the robots do not kill all humans.
Robot: instructions un clear all I heard was kill all humans is this correct yes or no?
Imagine this combined with virtual reality and unreal engine's metahumans. I would move to that world in a heartbeat
Imagine u getting an girlfriend
@@trentonking5508 🤣
Smh why does everyone hate the world Creator Created 😅 they want some make believe bs
Vain Imaginations man
So you'd rather level up in VR than in real life? That's sad
If with BCI's and neural implants we can make these worlds feel as real as real life? Heck yeah I'd be spending a ton of time there
I have been waiting for this for years.
I am attached to some npc's in games with just a small amount of dialogues. Imagine with ai generated dialogue. People are going to have best friends in video games etc
thats sad dont forget
They already implemented this into the Skyrim modding community and it’s reaaaaly good IMO for what we’re at with ai. Type up ai npc Skyrim.
Been waiting for this for years. AI generated conversations and quests will make a game basically infinitely playable allowing your character to literally live in the world for as long as you want without having to run out of stuff to do. Imagine not just generated sidequests but even entire main storylines. I just hope they have this in time for Cyberpunk 2
me too
You better believe developers don’t want their games infinitely playable without getting more money out of you.
@@user-gz5ez1vo4g i can already imagine games like that being sold with a subscription model
@@user-gz5ez1vo4g They want to make different and varied games
You live in a fantasy world. You will be paying hand over fist for this lol
Finally Ubisoft NPCs will be in every game now
"Greetings [Player Character]. I appear to be stuck in the wall and missing part of my model. I need you help fixing me!"
@@bart0nboy What this video is talking about is a new way for developers to avoid stuff like that though
I prefer Oblivion NPCs myself
@@user-lv6rn9cf8m I feel like for a while there will be some buggy games as devs who are under crunch pressure ask GPT and BingChat for coding help without checking them properly.
I know you're trying to be funny, but for a joke to be funny to me, there has to be at least a grain of truth to it. And it seems obvious that you don't realize how polar opposite Ubisoft NPCs are compared to machine learning, generative AI powered NPCs would be. The one similarity is that they both have bare bones human-designed content branching, none in the case of generative AI, but the possibility for content/story branching is unlimited with generative AI, whereas traditional video game "AI" is just done with trees manually set up by humans.
Dynamic AI in games is something that I've had on my mind for a long time. I'm glad to hear a big name talk about this
Can't wait for Luke's AI Podcast to get made
The series: shadeslinger is a perfect example of how it could be with these sort of AI, in there they have a system called the ripple system where events in the game change the world and the events and so on. Kinda like how Luke talked about a “quake” from player and npc actions.
Imagine a Hitman game where the game learns how you play it and changes NPC behaviour based on that
Dang, no more chucking wrenches at everyone
That AI game preloading characters and then letting it develop on its own and with other AI... Getting a very strong ST holodeck vibe
So using a system like this would make an open world space game like the X series of games (X4: Foundations is the latest) so much more dynamic. They have the concept of how player actions can impact the world (destroy a station and it’s gone) but then the economics of it also is significant. Build an ore processing plant and supply increases and prices decrease. Having this type of AI behind the game would supercharge your interactions with the different races and pirates. So many games will be able to plug this into existing code almost. Will be cool!
Literally my favorite game series, but the NPC's are easily one of the worst features. This would be an amazing upgrade😆
Ahh yes, a fellow man of culture
An interesting idea from Linus mentioning persistent worlds at 12:00 is an MMO with NPCs driven by these agent models. Things would continually happen, whether you're logged in or not. I imagine the companies developing the MMO would have the money and/or the compute required to generate hundreds of LLM outputs simultaneously. Would be very interesting.
you know what's even better? You might be able to type in your dialogs instead of choosing from a set of premade options. You can say whatever you want, and the AI will response in a lore-friendly way
There's a book that was written in 2004 about something just like this.
Give it a read if you fancy: Conor Kostick: The Avatar Chronicles
Or... Who knows? Maybe GREAT models start running on Raspberry Pi chips, _and-_
...And then we have game developers staring at NVIDIA.
The thing is, if the ML-driven NPCs are good enough, you don't even NEED it to be an MMO anymore. You can create a game that FEELS like an MMO but which is running exclusively on the player's computer. That means no expensive 24/7 servers, and no network infrastructure required (although it might be good to enable small-scale multiplayer and co-op so you can play with your human friends if you want).
This reminds me of popular mobile games where you play them just as they come out and then leave them, only to find them completely different and disorienting when you return in a couple of years. So I'm not sure if that would be the best idea, but we'll see.
I did a 30 day plan with gpt for keeping low blood sugar. I told it to use only 8 main ingredients. with 14 days of meals 3 meals a day. it added all the portion sizes and gave me a complete shopping list. I asked for the price total and it compared it to nation price index for each item and gave me a rough cost as well.
As a type 1 Diabetic this this sort of information is very valuable. Thank you
@@olliemunchies5012 Just make sure you manually check everything, GTP famously will generate responses that are confidently wrong
This got me incredibly excited for the future of gaming, this is going to be wild
I agree that having one AI tasked to make the entire world and keep the narrative would miss a lot of the fine details, but I think the goal to solve that is to get more of a heirarchy built where it spawns off more specific ones that have the general goal and a secondary goal like to generate a town and then details about the town. Same for generating a region, etc. You could easily get it to have fine levels of details if you built the AI doing that to break the tasks down until you get to a certain point. It likely could be more detailed one day than we could ever hope to by hand.
Linus always mindblown
If AGI gets me something like SAO, I'm down baby
Lol just realized I'm basically asking for the matrix
You mean .Hack?
When u speak before u think
You want to be killed if you die in an anime game
The coolest thing is not only can the NPC's have new content to do and tell you about but they can all have unique voices with AI speech synthesis that sound genuinely human and emotional to talk to you with which is mind blowing honestly. Game studios don't even have to record dialogue anymore for them so now there's no excuse for characters to only speak in text.
You can feel the excitement as Linus is speaking, a truly amazing time to be alive
now that i see what AI's potential is for games, i think i now understand the intention of B3313 and how it tried to convey that the game was changing in the background
I could totally see these AI agents modifying texture files to fit the world you have influenced
procedural textures and voxel terrain, can it get any better?
I knew this would eventually be a topic. I'm glad they are talking about it.
I could see Animal crossing use something like this. A huge part of that game is in conversing with other Characters and having these dynamic localised schedule for each one. It would help a lot since repeated dialog is a huge issue in those games. Having randomly generated Villagers with random personality's and also being able to have a conversation with them would be Interesting.
These programs are both fascinating and terrifying all at the same time.
A mount and blade style kingdom simulator with AI would be sick!! Honesty, maybe a gpt integration mod will make bannerlord actually good. Can't wait to see what gets made.
The AI NPC dream would work best in Universe scale games like No Man's Sky where interaction between Players is reduced. Otherwise it's Rust but with NPCs also wiping you out all the time because that's their learned behaviours from the Players.
learned behaviors from players will always end in a race war
I don't if Linus had already watched SAO in it's entirety or even watched the show, but when he mentions the word "Persistent environment" and describes it. It sounded to me as if he was describing SAO Alicization.
That ENTIRE ai in games section, describing the way AI will be able to impact the world
THIS is what Star Citizen has always had in mind, and with AI agents, we're actually REALLY close to getting it
Great segment. I went into this thinking we'd have better scripts for the NPCs and came out of it ideating on how to leverage my own PC to automate and improve efficiency in my own personal and professional life. This 4090 might do more work than just play games...
I was excited about Everquest Next , given that they promised a world where players actions would change the behaviour of certain creatures or groups of creatures in the affected area, and even though that fell apart, with this new approach of ai interaction a new step in gaming will be experienced -a new, overdue step . Where , before in times of TeamSpeak when not all had or wanted a mic for raiding, now for more of a natural conversation with ingame npcs you will need to use one.
That last part of with the AINPC’s reminds me of the last season of sao
I can't wait for an open sandbox time travel game, where you can move to any point in time and the AI figures out how your actions have a butterfly effect on the future, which you can then travel to.
soooooo we'd have AI that can predict the future? lol
@jeffboy4231 yeah, inside a video game. It's not the whole planet. Just Hill Valley or Hyrule.
Thanks to generative agents and AI I can now make my wildest dream worlds come true, I can't wait for the future of this technology, as it blends itself into becoming it's own little NPC engine for game development
Props to both of them literally making the talk 25 minutes, and also to you Mr Timestamp man😂😂😂
The specific technical definition for an agent is an entity that can take actions to achieve a goal. Being able to reach out to other services is a side effect of being an agent - the same way a person can go and invoke Dall-e to achieve a goal. ChatGPT isn't an agent because you have to invoke it and then use the response it provides. Bing Chat is kind of sort of an agent but it's still kind of limited in that it has to be specifically plugged into specific services. I haven't checked AutoGPT but presumably it's similar to Bing Chat in that it's plugged into specific services but just has some more flexibility in the way those connections work (in particular the third party plug ins)
I can't wait to play a game that uses these tools. I would love some sort of Elder Scrolls-style game, with a main gameplay built by developers, with the side content handled by AI. Or even an AI mod for Minecraft or Terraria.
what if the AI is as good or even better at writing scripts, can generate cutscenes, events and obstacles, would you still want premade main quest? Imagine you have infinite ways to solve your main quest and infinite amount of outcomes
@@alexdoan273there’s a game way back over 10 years I think that has procedurally created infinite quests, it’s pretty cool. But having infinite possibilities for everything would require constant heavy load on the machines and atm no machine is capable of running a game like that mainly because it’s constantly updating game resources and assets
Nice for more dynamic gameplay
There is a mod (already) for Warband 2 that adds AI integration for all in-game conversations with NPCs.
Since Warband is a very open sandbox game, it works very, very interestingly
This could be interesting, but if the AI only runs on the cloud this will make this tech unavailable to offline games.
I very much like the aspect of the future rpgs utilizing AI technology with persistent envirorment effects. Immagine as a first playthrough you roll with an evil character and forms a cult. Upon the death of the first character the cult remains and goes underground only to several playthroughs later the cult plans to return and resurrect the first character as the BBEG this time around and your new character going against(or in favor) of this! This kind of technology can offer the definitive ultimate experience in terms of narrative and immersion! Great times!
Star Citizen working on it and end up with planets and landing zones full of junk from players and crashed ships XD.
Good timing, I was talking about how AI NPC characters in video games would change the level of interaction and how players interact with NPC characters a couple weeks ago. Games could give NPC characters a personality to follow. The NPC dialog could vary every time you play the game. NPC characters could be much smarter or too smart for game limitations. It would be interesting.
i'm sure ai can be applied to games in multiple ways; programmers could use ai tools to help them develop code. artists could use ai tools to help them quickly develop massive amounts of in game textures, models and maps, more than they could do without it. and then yes there's the possibility of actual ai agents in the game, as npcs or otherwise. ai comes with a cost in hardware, and while pc graphics cards can do some of this, i expect games with really elaborate ai activity going on behind the scenes, will be the online ones, with the ai mostly running on the developer's servers. not that i know a thing about any of this, but that's what i think it's going to shape up as
the average murder hobos alignment would be so out of wack compared to the average wholesome agents they might grow prejudices towards people they suspected to be player characters
Absolutely. You'd then have the fun content in which you were able somehow to prove you weren't a jerk to the npc's. That actually sounds like it'd be interesting
Forget the name but there's a mahwha about that. Another World has "players" come every so often and bcs of evil god they bcm murder hobo personalities when they kill a human. So the inhabitants just started to murder players on sight bcs of past experiences.
New player characters can be "birthed" into the world so easily that the ones who want to cause chaos will be these new characters, so the AI starts to learn that any new player character they come across is to be treated with suspicion.
Assuming that there is some drawback to causing chaos in the first place, and the only way of "recovering" your status is to just roll a new character
Starfield but with Machine Learning NPCs.... *drool*
Awesome topic, a dream for most of us!
20:11 Fridge doesnt order but the ai can use image tools on the fridge to look inside and create a grocery list and contact you with the list on your cell and you give it the go ahead or set it to auto reorder certain items.
It's still crazy to me that you can take a picture of your fridge and pantry and the AI can look at it and know exactly what every item is
I think for games the ideal thing might be if the characters have a bunch of written dialogue to establish their personality (and maybe for key events), but then an AI is used to sort of riff on that so you can interact with all of the important characters like they're real people actually experiencing the same world as you.
why? Just let the AI generates the characters, models and backstories. It may be even better than humans at the task. All you need to do is to train the AI on the lore and the main goal
@@alexdoan273 because at the moment while the AI is good, it can't quite match a talented human writer. A mix of the two seems like a good idea
@@orimoreau3138 I'm not talking about "right now" AI. By the time that kind of game comes out, it won't be using "right now" AI. And at the speed AI is advancing, I'm willing to bet it can do all those tasks better than humans by then
A possible danger to that scenario (AI agent's NPCs) where they are fully fleshed as described, with "real world" consequences, is that players may really get hooked to that virtual world in a very deep manner, at a point where the virtual world exerts the same pressure as real life itself, making a person having twice the burdens. I know it might not be an outbreak but it could deeply affect some.
This is a very thought provoking, terrifying, concept. And I think you're probably right in that this could become a serious issue in the (probably near-ish) future.
Damn, I mean... what happens when everything is automated? People will create new problems anyways... so interesting!
Any world like that would have to include how the player characters would just disappear for extended periods of time without warning. The AI's would have to be used to that, and there'd probably have to be something in place that protects the house with all their stuff in it while they were away.
@@goldenfloof5469 just make the time stop when player is not in game, I don't see the problem
totes awks, working on a co-op rpg in a persistent world populated with NPCs that have daily lives and do quests etc, pretty much as described from 11:30 onwards, including player actions leading to impacted landscape, and dynamic storylines where the big baddie could be the cook who had his son killed... (granted that last part wasn't specifically as planned but that was one of the potential options for dynamic stories). None of it uses gpt though
the extra rng elements i mimic by having a virtue system, this influences decisions NPCs make as to how they interact with each other or react to the player. Factions could go to war over the difference in values, or form alliances based on them too. Throw in a chaotic element and some narrative guidance from high concept quest arcs and you end up with endless content :3 (and hopefully a good game)
Dynamic. As in there's still a small chance for me! Thats what it means. An early peek
Have a look at x4 foundations. It doesn't have ai agents, but does have a full blow economy where wares are used to build ships and if they don't arrive ships can't be built and prices increase
Ai versions of services like Hello Fresh and Blue Apron would be amazing. For people who don't have time to come up with meal plans and go shopping services like that are pretty much the only way not to be eating fast food and instant ramen most days. The problem with those services though is limited selection, and it's not guaranteed to have something you like. AI to have those services cater to you and your specific dietary needs/preferences would be amazing
As far as perma-death in games goes, IIRC there was a Mech Warrior type of game on the original Xbox that If your character dies it deleted your save file and made you start all over again.
Prey Mooncrash does something a little like this where your earlier runs have a drastic impact on later runs.
I want a game like this so bad, and at the same time im so terrified of it. I am scared that people will start wanting to live their lives in that sort of game rather than reality...
May provide a reason to improve reality.
I like the idea of the AutoGPT work, but fundamentally I feel it's still subject to a number of flaws:
1. It requires signing up with a service. OpenAI is hosting all the background stuff, and you have to sign up with them to use the API that AutoGPT is based off of. Immediate red flags. They could close next month after selling the rights to MS or Google. I want to self host.
2. OpenAI doesn't seem that open? I can't find a way to download any of the important parts so I can host my own on my server. Sure, I lack a couple hundred GPUs, thousands of CPU cores, and terabytes of RAM, but I'll take a slower response under the promise that everything is working exclusively on my hardware.
3. I am admittedly a cheap bastard and I don't want to pay a recurring fee to use something like this. Sorry that I'm old fashioned, but I like owning most of my things, not renting them. An apartment, fine, I won't be buying a house ever again in my lifetime and even buying a condo is a ridiculous cost now. A computer, or a car, or an air conditioner, or a phone; no, f#$% off, I bought these outright. If I have my own computer hardware, I want to run programs on it as well. And if this truly is an "open" project, I should be able to self host the entire thing, not just the interface to use what you've hosted on your own servers.
4. Always on is already a problem many people push back on. For an MMO, okay, sure, remote servers. If I'm playing the next Elderscrolls with this AutoGPT fueled environment with townies going about their business and interacting with each other and me in a realistic sense, I want to be able to do it offline. Figure it out.
this is something that i've thought of before, it is super interesting to think of because anytime in a game you wish you could break out of the things you know you can do with the NPC's, but to suitably achieve all the unpredictable variables you'd need basically an endless budget for voice acting, modeling, coding, etc etc, but for now with AI you can just simulate having a conversation with an NPC, further on we'll be able to see NPC's coded to have their own routines, instead of having a set of animations of said routine, similar to red dead redemption 2
its like the difference of animation based advanced movement (say, cod black ops 3) where each movement is a finite, start to finish predetermined action, you have THE double jump, THE wallrun, THE slide, with fixed parameters, whereas in Titanfall 2 those options are engine based, the inputs are the set of parameters that interact with the environment if it allows it or not, a slide could be carried over forever if you have the speed and correct terrain, a grapple swing is not a determined arc, its all angle and momentum so its up to you, a wallrun is only softcapped for gameplay reasons, etc, it allows YOU to think what to do instead of giving you predetermined options
back to actual games, i like the prospect of that being the case for games in general, having an AI pick the parameters of what to do or say, instead of choosing the correct input/voice line/action from a predetermined gallery, how many times have we heard the same voice line or sound for something, this would make it virtually endless and unique every time
Rainworld already has characters who react to each other, the player and the environment like that.
These NPCs will still be inferior to Oblivion NPCs.
oblivion NPCs built diff
I remember a quote of some dev, I think it was from skyrim, "the npc were too smart for their own good" I remember him citing an instance were bears started raiding all towns because that was the best way to get food since there were so many resources, and NPC just going haywire finding other ways to survive all other monsters, in short gamers don't want nor need realistic games, or smart NPC they want interesting ones
Counter argument: Dwarf Fortress
@Brazzlestein yeah and how famous it is, the people who play it are extremely hardcore gamers and streamers, and even then, you don't play as a character you just oversee the world
Well, you can make chat gtp explain something to you like you're 5.
FYI there is a Mod for Bannerlord 2 that changes the dialog to send to chat GPT and give you back more interesting responses from NPC's.
Yall describing major aspects of the mount and blade series. Which is by far one of the best medieval games flat out
I have been saying something similar to this for a while now. Look at nvidia. Face generation, eye contact, voice synthesis, generating landscape backdrops with just blobs of color. DLSS, just AI advancement in general. Its almost like we are heading in to a point where we could potentially start experimenting with games where a good amount of the content and visuals is AI generated which will allow for more detail but also for game devs to spend more time expanding the gameplay and less time with the visuals. Also the performance gains.
That ai simulation thing is definitely gonna be used to write tv shows
Already has been.
Dude imagine when you can ai generate a tv show watch it then rewatch but at a certain point be like "no right here I want Kramer to punch Elaine in her face... go!"
@@JordanTaylor-rm8be I want to see an episode where George doesn't lie once.
@@JordanTaylor-rm8be that's just a game at that point
Like GTA or assassin's Creed type beat
@@n0raaFTW nah its a bit dif
"Agent" in machine learning is a technical term. It means a model that has been trained by reinforcement learning to accomplish some task "q", and is guided by a given policy "p." Agents trained with one policy may perform very differently than those trained in another policy, even if other performance metrics are similar.
Full disclosure, my machine learning experience is in data mining and I recently started VAE's and GANs. I only have a couple hours of lectures in the relevant reinforcement learning coursework, so I could have misstated something.
I see a lot of the early benefits from AI in games to benefit more TTRPG games ported to a video game or even have it handle your npcs and environment in a virtual tabletop game
This feels like an idea that sounds cooler than it would be to live out. People game for different reasons - and for a significant number they game for escapism. Having a game that is too much like real life wouldn't feel like taking a break from real life - it would feel like work.
I must start to using chatGPT more in my normal life.
so far I only made some of my complete workflows into a plugin.
wich rendered a few programms useless to me.
U should work on proofreading, first.
@@peighnesshonourchign9164 maybe you should too
@@maturememory the first guy was making mistakes, the second guy used U to save time intentionally.
@@godlyvex5543 English isn't even OP's first language
Hearing Linus describe the (currently limited) Dwarf Fortress secret system.
Yep. Looking forward to that as AAA.
I imagine this for aport games like Fifa with ai commentators actually responding to gameplay. The bots themselves responding to the player in the ways the teams would reflect irl etc. It is such an exciting concept!
That rpg would be crazy but just imagine if it was also in vr. It's a fantasy world with photo realistic graphics with a lvl of depth u cant really make rn. It would be crazy but scary cuz some ppl would eventually develop a really unhealthy relationship with it
I honestly think VR would ruin it.
There is something about experiencing a world through limited means of a display, mouse, and keyboard, that makes it even more magical. Lile, you know that you only see a glimpse of it. This lets the brain focus more on imagination and immersion than on spotting flaws.
Try Lit-RPG books. A lot of them explore this concept.
@@p_serdiuk I think you are incorrect. The issue for you is the way things are being interacted with. And the solution isn't a level of separation from it, it is making those VR interactions *better*. I do not know how, but that's how you solve that issue properly.
@@p_serdiuk this guy hasn't played VR or played only tech demos.
Try highly modded Skyrim VR and tell me a dynamic, actually intelligent AI's wouldn't make this a world to sink into
@@orimoreau3138 Why would you _want_ to sink into a fantasy world? Escapism should have its boundaries.
does this mean that a malicious group could train an entire games agent's to destroy the world?
Obviously.
I think the SAO comment was about Alicization, Where The main prog is on some reasearch lab and he get put in a world of AIs and the world is moving much faster than IRL so if you leave and come back stuff had happened.
I'm talking about this since SIM1 funny that this is now such a topic as it wasn't expected, but it will be fun(?), if they get so advanced, they wouldn't give you an essential Item or something like that.
Damn, an egosoft X universe game where the whole universe is populated by ai agents would be amazing and terrifying at the same time
The AI ordering food etc for you completely changes how advertising works in the world. You could offer actual sales to a company that sponsors you then the AI could automatically prefer certain brands when ordering products. How much more is an actual sale worth than a potential sale produced by a view when advertising.
Fable for Xbox had npc react based off of your goo or evil meter and I believe your present also changed
A podcast I listen to (The CORE show on Frogpants network) has said the same thing. One of the hosts (Beau) stated he'd rather see AI be used in games to improve the AI interactions and gameplay (RPG and Strategy games) than see AI used in self-driving autos. I say, why not both but I see his point. More effort needs to be done and may in fact be in operation by developers.
Problem is NPCs are built to be defeated and provide a specific challenge.
An enemy that you can’t learn to overcome isn’t fun. It’s just tedious.
Skill issue
@@galasitygaming Brain issue.
I mean I think it will be another tool in developers toolbox and so for certain games I feel like having a modicum of a I would really be helpful for example fighting games have horrible AI for their computer controls characters. If they could actually learn and adapt a little bit it would go a long way to teaching new players how to fight an actual human being because while a computer-controlled enemy will if they get hit by something once a thousand times that's not the way it works with people. Four games like first person shooters or you know single-player adventure games you don't necessarily want your NPCs to be able to constantly outsmart and out thank your player so it has to be used with restraint and in the right circumstances. And to be clear the things that I'm talking about in fighting games could be done without using any sort of advanced AI they just choose not to but I think things like that could be useful you know emulating a human in a competitive game.
@@charliericker274 Yeah you’re right, problem is those types of games wouldn’t be able to run it and it wouldn’t make any economic sense to host massive cloud infrastructure just for small games like that.
@@YourBlackLocal yeah that's true. I do think there's potential in the future though for this sort of technology to work its way into some video games.
Fyi. In Sword art Online it worked kinda like that.
From my understanding they had a pool of traits with some traits being rare and others being common and giving them out to some characters. Then they let the people live their life, accelerated the time by 500 years or so and had alot of unique characters with their own personality. Especially with something like chatGPT this should be in the realm of possibility now.
11:30 , there is a smallish game called 8089 the next action rpg that is pretty much a fully procedurally generated MMO rpg, its been a project for a while (goes like 1089, 2089, 3089 etc i think) and i cant imagine like that sort of game (which suffers with some issues inherently with its being fully procedural) combined with that sort of AI software.
So I'm a game developer and I've been messing with using these LLMs for gameplay. The current struggle is that an LLMs can only communicate in text. This means they can't "do" anything.
However, I've been experimenting with receiving actionable input from ChatGPT by "teaching" it that it can do different things in response to my input by following a format.
For instance, I have tested a situation where I tell GPT that it will be receiving input from a player. When it receives input, it can either "say" something, and/or play an animation.
I give it a list of valid animations. And I provide it with a format. So if it wants to say something, it only needs to go "say: Thing you want to say" and if it wants to play an animation, it needs to say "anim: stand_takeitem" or whatever. I also make sure to tell it that it can only use the animations from a list I've provided, and that list gives descriptions of what each animation is so it knows when it would make sense to use them.
In a game, I can use these formatted responses from ChatGPT to drive speech and animations. Here is an example output from GPT 4.0:
"Know anywhere I can get a bite to eat?
say: Absolutely! There's a diner just down the road. They serve great food and have a cozy atmosphere.
I'm also looking for someone. I have a photo of them.
anim: stand_itemtake
say: Let me take a look at the photo. Maybe I've seen them around."
You can see here that ChatGPT is correctly using the formatting I've taught them. They also correctly chose a proper animation from a list of 10 animations I told it it could use. And it can truly acknowledge receiving an item when the player places an item into the NPC's hand, and the AI receives an update that it has received an item, what it is, what its description is, etc.
I'm also experimenting with ChatGPT knowing what items it has possession of, and knowing what they are and when to use them based on the fact that each item has an internal description (that the AI is made aware of) and it can decide at its own discretion when to use it by following a similar format. We can also influence HOW it makes decisions by telling it who it is and what its personality is.
So it's not pure AI running amok, we use its decision making while relying more on the game itself to keep a memory of events, but we constantly "refresh" the AI's memory based on the current game state in order to have it make decisions. This is stuff I'm doing RIGHT NOW in the SDK and it works.
This is the breakthrough we've all been waiting for in the gaming industry
2:24 YES, THAT. That is what makes me go crazy. Everyone talk about "IA" where there is no "IA" yet.