Experiment: Can AI *RUN* a Full D&D Session?
Vložit
- čas přidán 5. 03. 2023
- I played a full session of D&D where Chat GPT was the dungeon master. And I have to say, it was a crazy experience.
If you want to see this continued, let me know in the comments!
You can find the Chat GPT prompt used for this video here:
deckofdmthings.wordpress.com/...
Forged Gaming Legacy of Adventure Dice Set (Affiliate Link):
forgedgaming.com/products/leg...
Credits:
B-Roll Footage (background):
Videos by Matthias Groeneveld: www.pexels.com/video/a-foggy-...
www.pexels.com/video/sun-shin...
www.pexels.com/video/foggy-fo...
Video by Lorenz Peer:
www.pexels.com/video/drone-fo...
Music:
Folk Round music
Music from #Uppbeat (free for Creators!):
uppbeat.io/t/kevin-macleod/fo...
License code: F4DCSFJDOFC1KFKR
Music from #Uppbeat (free for Creators!):
uppbeat.io/t/kevin-macleod/ce...
License code: Q0RLTFVL9WSRMPRO - Hry
I have started a project to make the first REAL AI Dungeon Master. You can check out the announcement video here: czcams.com/video/kNhb1wg3gP4/video.html
The video is private.
I'd like to check it out, but it's private at the moment
@@davidwatches How? There are people out there who have internet access but no access to a DM. Playing online is a 50-50 shot of having a terrible experience. If this can give solo players a _good_ experience, how does it harm the hobby?
Does it have potential to harm artists? Sure, but don't conflate that to the hobby.
I get the fear of everyone being out of a job all of a sudden - it's a valid fear; but attacking a tech in its entirety because it can be used for harm has a name - luddite.
If you really feel this way, turn off and throw away every electronic device you have. They ALREADY USE AI; this kind of use of it is the only thing new.
I absolutely agree. being a mother in a very rural area there is no chance for me to play in person. This is fun and better than playing online with people I dont know. Thank you for giving me this prompt and enabling me to just play and have fun!
If AI puts me out of a job I'll have more time to play games...
Gotta love how he first takes you into the back room when you want info, and when he finds out it's about the brotherhood he proceeds to take you into the cellar to talk further 😂
That's when you know it's serious
It's different levels of secrecy
The more serious the convo gets, the deeper you traverse into a maze of back rooms 😂😂😂
The problem is these AI have a limited amount of context after a certain amount of text they start forgetting the start of the text
I suppose you could create a key point review prompt, to keep it on track every now and then.
If you really want to be fancy I think you could use the API to make a program that inserts a summary as you go, using 2 conversations one to summarize the prompt and response, then the dungeon conversation. The API giving new prompts to the dungeon with giving the original rules of your prompt and the actions you take in response... Humm...
This is a solved problem... on LLMs you can run locally. You can give them files they must always keep in mind, with the rest of the data they create being "overwritten eventually"
Only the commercial models. If you run them on your own machine you can allow them to remember everything
So just like a real DM forgetting plot threads/contradicting themselves
So I've been playing with chatGPT as a DM and there are some AMAZING things, like spontaneous compliments when discussing with it for thematic focuses or selection of colledges/schools/domains etc when creating a character. The way it integrates your description of your actions or even the way you speak into how it describes the world or other characters reaction to you. But what it seems to fail at is continuity, Sir Henry, a knight is suddenly Sir Galahad, and he isn;t near death inside a chapel, you're in the keep fighting orcs... Or are they goblins, the robed figures you finished fighting and are looting suddenly turn into goblins that you are still fighting. Your party changes names, genders and or classes, and ocasionally so does your character, oh and keep a notepad handy for tracking your inventory. as I said through, for flavour, for fleshign out ideas and creating these gorgeous descriptions and bouncing ideas around, for the fluff of the roleplay, ChatGPT is mind blowing, it just needs some help (API?) or further developement when it comes to the consistency and thread of characters and locations it seems.
That's because it's faking everything. It has no clue about any of that, a it is doing is saying the sort of thing it thinks a GM would say, as it does with everything else.
@@nnelg8139 but it can track hitpoints in a battle through several rounds, and can add context to replies based off previous parts of the conversation, so it CAN remember waht ahs been previously discussed and does have a persistent thread in a conversation or exchange. It's not like the old chatbots being purely algorythmic responses, chat GPT is much more evolved, but as I said, still not quite there in other ways now it seems.
@@myriadworlds8434 no, it doesn't actually know anything about hitpoints or such. It remembers the words that were said but does not have any understanding of what they mean, only a very complex algorithm for determining what to say next.
It's exactly like a 1st-grader who memorized the times table without understanding what multiplication is. He can fool because he knows the answer to "what is 4 times 12" is "48" but if you ask "what is 4 times 13" he will just guess randomly.
@@nnelg8139 yes, still it does not undermine it's effectiveness
@@nnelg8139that's what about 90% of people are doing at any given time as well
I've been experimenting with GPT for about a month now, and I've been able to experience a campaign based around expansion of railroads and armored train combat. It's insane.
Oh dang! Do you have that conversation stored someplace? I for one am interested to see how that armored train combat works.
I wonder if he will reply
@@lololo4764doesn’t look like it right?
@@borjadetorres7747 time will tell...
@@lololo4764 (old sailor grunt)
40 years later, we're back to text based MUDs
@24:35 this retconn is the most accurate depiction of real human DMs I've ever seen - this alone is evidence it is ready for DMing LOL
The limitation here is going to be context size when you go outside single shot sessions. For it to be great at maintaining lots of context, it needs a vector database of all the various details to help summarize and relate all the content and provide a longer term memory for it.
It's also producing this story as it goes, predicting the next text to give you, which is going to result in it sometimes going all over the place especially as it gets to the limit of that context window. This is how it may start multiple threads related to the same kind of organization/etc. without having a cohesive concept of what to do.
I'm sure many DMs may end up doing the same sort of thing because they are used to working with creative players who aren't easily slotted into pre-defined paths, but this kind of methodology is not going to be as coherent if you can't at least consult notes between sessions, and this is all that limited context problem mentioned above.
All this to say, I think it's a great tool to use for individual components, to help people write better, more fleshed out campaigns, to help them organize the content, and to help them run individual sessions, but humans would still make the whole thing much better. For now anyway.
I started to try out Chatgpt as a "make your own adventure story" generator as both AIDungeon and NovelAIs stories kept looping in on themselves.
One thing I like about chatgpt in general is even when i don't have the entire setting or story in my head, I can build a world step by step before I start. And the best thing about this is that the AI remembers details that I might have forgotten along the way.
It's a bit scary but i can relive my childhood with theese kinds of generated stories. Like those adventure books where you had to flip around to specific pages constantly
unfortunately for me while playing with chatgpt it forgot the existence of a party member and i just noticed it after having already gone deep into the story
I tried to use ChatGPT as a knowledge database for a campaign, and found that the more information I gave it, the more it starts forgetting. In other words, its short-term memory is good, but it has no long-term memory. It is super sneaky about it too, saying something like "Oh yes, thank you for the clarification. Blah blah blah that I said was incorrect, it is blah blah blah that you just said. I will remember that from now on." Except that it won't. It will forget it after you give it several dozen or so more facts to remember.
It's strength lies in coming up with information on the spot. Ask it to create the skeleton of a town for you: names and descriptions of buildings. Or ask it to take an existing creature from the Monster Manual and beef it up. Or just make something up, like a CR9 Skeletal Two-headed Unicorn, and BAM, you get a new entry for your homebrew Monster Manual.
But if you ask for a description of a monster, and then you have an encounter, and then you ask for the description of the monster again, you could get a different description. It used to have green eyes, but now they are yellow. Or it was a werewolf, but now it's a vampire.
Nice video!
I've never played D&D but was genuinely able to get into this story and found it quite entertaining
I don’t normally like listening to dnd content unless it is animated or something similar but for some reason I am loving this series, it could be that I want to do this myself or that this is so out of the ordinary that I want to watch!
So glad you enjoy it! I plan on doing one of these a month roughly, so stay tuned
@@deck_of_DM_Things Love it! I will definitely be subscribing to come back every month
@@Lily.Hiragashi Next part is up now!
@@deck_of_DM_Things woohoooo!!
I’d love to hear what happens next! Thank you for making your prompt available. I’ve started a campaign with chat gpt. Have only played a handful of D&D sessions but have a rough grasp of things. This is an easy way to play around with D&D as a newbie without a group
I'm using my 11yr old as a guinea pig. So far he's loving it 😂
So glad you've enjoyed it so far! Great use of it as a new player. The next part is up now!
Thank you for this! I am a game designer rn for an OSR game and wanted to let others play a Zork-like text based adventure with my module. I really appreciate making the prompt available as this will help me make something like this.
This is weirdly relaxing to listen as a podcast. Hope you do more things like this!
This was great. Love the patching of reality questions. Keep going and thank you!
I'm enjoying it and i've watched this far!
It's a fun video to have in the background while playing minecraft :)
I gotta get the next episode soon!! It was pretty entertaining!
Thank you! Next part is available now.
I am loving watching you play. It's also confirming the problems I ran into. Message History Context length isn't great within chatGPT. I made a plugin to help but it only gives the model a full set of d20/Fate/Fudge mechanics Diceroller. Working on one that will let you save your game progress and include assistance for the LLM to stay focused on the plot.
amazing prompt, thank you! ive been DM for over 15 years, i can finally feel how it is to be a player for a while.
This is so cool! Initially I have been hesitant to embrace AI in the role of dungeon master and other creative writing realms because I am a fantasy writer, and I worry what this may foreshadow for the future of myself and others in this domain.
With that being said, however, I think back to myself as a young kid where it was difficult and basically impossible to find enough likeminded friends to play even a small campaign with. If GPT can create such fruitful and fun experiences like this for other individuals who also have a similar struggle I can only imagine the positive impact that could have on their lives and personal creativity. Thank you for conducting these interesting d&d campaigns with GPT for myself and others to witness. I wish you the best of luck as your journey continues and may the gods bless your path!
Loving this… hopefully the story will continue!!
This is amazing! It would be really cool to do the opposite as well, ask chatGPT to be the player(s), I personally like to be the GM
Great idea and will certainly be a future video! Part 2 of this video is up now, too.
That would be fun
I've done that, it works as well! It's a great way for me to get some use out of all the unused adventures that I have.
In my attempt the AI kept trying to wrestle control away from me. I would ask for a perception check and it would tell me not only the dice roll, but the fact that with a 15 the character saw that they could negotiate with the guards... Maybe I'm not doing it right.
@@powerpc127have you tried telling it that it can’t do that before then? Somewhere in your first prompt you say something like “you can’t decide dice rolls, only use numbers that I give you.”
This is so cool! Nowadays it's really hard to start a campaign with my friends without ignoring any responsibilities we had irl first. But, one thing about this is, how well will the chatgpt handle gameplay, mechanics, stat for monster, anything related to combat and how it plays out. Also, the ai rarely ask for any skill or ability check unless we told the so in the prompt and it seems like sometimes any actions we're doing is successful, leaving us without any sort of challange. But for something not specifically build for this purpose i say Chatgpt is remarkable at describing places or situation, and interpreting player action. I will wait for the day we will have a specialized ai dm that can automate a game of DnD or any ttrpg completely
All the building blocks for an AI DM are currently available. There are also ways around the challanges you mentioned with clever prompting. You could also just rely on chatgpt for area descriptions and conversations. Additionally, you can feed it a PHB in vector format for any rule arguments. you can ask it to explain how eny mechanic works and it should be able to tell you.
This was outstanding. Thanks for creating
Great video! I tried the prompt today, but things really fell apart during Combat. It had trouble keeping up with the initiative order, and moving the combat along to the next person in order. It started just rolling to attack for NPCs but didn't continue with damage, or the next person in initiative.
But your video was a great example of the narrative capabilities. It would be interesting maybe to approach this more like a Choose your own adventure type of thing.
I love how very shortly after you said it would remember and remain consistent it mixes up if you were looking for dociments or an artifact.
This was really great. Hope to see more of this in the mainstream and become really polished. I think solo D&D is a market a lot of people want to explore. It just hits different than roleplaying video games, where those have such predetermined outcomes.
Made it to your 21min mark where you ay to comment. I love what you're doing here and I wonder where the last bits take us!
I love the concept of yt videos evolution for narration. People used to read people stories, then ai reading people stories, now people reading ai stories xD pretty cool tho! Was surprised how cohesive it is
I would love to see a part 2. I just finished a reasonably passable first arc. The second arc is going much smoother and is far more consistent
That's good to hear. And part 2 is up now.
I'm doing the same ad you but first went to the tavern for some companions for our quests , it's going really well!
Wow, It is soo cool of a concept! As a seasoned table top roleplayer in my earlier days, now I can hardly find anybody willing to play and a Chat GPT company as a DM would be near perfect. Gonna try it with my free 3.5 version. Thanks a bunch!
I found it helpful to ask the ai to occasionally recap the advents so far and then to continue on which seemed to refresh its memory
this was amazing, I am hooked
as someone that never know anything about DnD and only know about it yesterday after watching the movie. I really wanna try playing it myself but don't really have friend and this is really great alternative. thank you for sharing the prompt
also, should I tell ChatGPT to remember my character sheet or not?
I really wanna see more of that adventure 🎉
You can! It's up now.
Fun video. I am watching this 11 months after broadcast. Hoping you made a follow-up video. If not, I doubt my request will tip the scales.
I think the best thing about playing around with the chat ai is the positive feedback and praise it can give you. Like if you ask it for help creating a character it asks you for traits and stuff and gives you compliments.
Ais could really teach us humans how to give positive feedback and just be kind to each other.
I watched that far! This was very interesting to see what it came up with lol
I really liked the initial description of the warehouse room. It's fun to imagine that ChatGPT has consumed enough fantasy role playing games to know that they commonly involve heists but, when it comes to the heist itself, has probably seen a lot more mission impossible style heists than fantasy ones.
I tried out using this prompt and, though I’m not finished yet, the adventure has been very cohesive! GPT even asked for details on my backstory and has managed to incorporate them somewhat into the plot
I'm hype to see a combat because i try it and don't fit right. but so far for the narration it was very good ;)
This could be a valuable tool for dms to use to assist them with their game. Providing descriptions and interesting/unique npcs on the fly is very useful for spontaneous situations.
This is going to be amazing in the future
This was pretty cool! Personally, I’d love to see this in maybe a Call of Cthulhu system or Powered by the Apocalypse. Great job!
Thank you! Both would be awesome.
very fun to watch/listen to.
As someone who was a professional DM earlier in my career, I'm seeing a lot of AI problems emerge here.
The biggest limitation is AI is notoriously 'helpful'. 21 minutes in, and there hasn't been a whif of action, despite many instances that traditionally it would have come into play (sure, there's guards, but no actual action). Also, characters warmed rapidly up to the character more than is realistic; for example the half-orc going from cautious person watching over his shoulder to bringing in a stranger onto a heist against assassins within a minute without a single persuasion check. ChatGPT also follows your lead in a lot you do... a player pulling normal player shinannigans with say... an immovable rod... would likely have some results that a regular DM would be more equipped to handle.
that's more of a prompting problem, i suggest getting rid or summarizing the game instructions adding tags and a scenario introduction to minimize inconsistencies and tokens as well as better steer the story in the right direction, if you use
tags: "your desired tags" Ex(fantasy, action, medieval etc)
you can already see some improvement, another thing you can do is better structure you prompts (listing works well for me)
ex:
Story requirements:
-consistency
-vivid and imaginative
- descriptive
ban:
-summarizing
-disregarding player agency
;
by the way never forget to include a line to remove positive bias player actions can fail, and its outcomes must be fair and relevant.
@@alucardecnard2562 I'm not sure it is. I've found AI's can easily be broken out of their prompt patterns if goaded a little.
We could do a collab if you like, one where you craft a prompt and I try to break it as a player. That way, regardless of who's right, we both win. ;)
I am finding this very interesting. I am currently working on a Monster Maker for my website, that uses AI to help DMs create whatever monster they like. I can see creating a similar web page for a single person adventure. The problem of course, will be running into the exact issue you did...asking too many questions within the allotted time. At some time in the future, that won't be an issue, but for now, it is.
Yes please continue for god sakes lol😂 this is so awesome
(: Part 2 is up
This was really cool, the ai actually had me engaged in the story
Its probably been asked already but would love to see what happens if you added another player or 2 to see how the chatgpt handles a full party!! But love these videos keep then coming
Dang it I want to continue on this. Huge story nice lore
I can't wait to play my own campaign with chatgpt. It's a fun story you've got so far
may Lady Luck bless you too [~11:44] to me it is an interesting take to watch you play and i do find myself somewhere inbetween creepy and curious concerning how fast things evolve.
I like it that you actually did make a charakter sheet and put ye old dice to some good use.
Being a GM myself who does like to run adventures I am not sure if this will be a blessing or something different for the hobby of old RPGs.
Lets hope for the best and game on fellow adventurers.
May the gods bless you!
i've got "that" far :D This looks soo cool!! i guess i might give it a try myself, maybe even having chatGPT to teach me how to properly play dnd :3
Okay I haven't watched the video yet so perhaps this is addressed but I read the prompt and it seems like a really awesome introduction to d&d for people completely unfamiliar with it!
you can also use any setting that exists up till 2022. I've been playing a campaign based on the world of cyberpunk 2077 and i've been having a blast. already been playing for like 17 hours now it's amazing. you can also have multiple characters and players so long as all of you uses the same email and enter to gpt your character stats one by one.
it's best if all of you are on pc/laptop
I watched that far
This is so cool!
This video is old, but I recently did this and I was tasked to find a bandit leader named Blackthorne as well. Interesting how both prompts had us looking for a bandit, rogue, shady-type character of the same name. I assume the LLM was trained on several antagonists with that name.
LLMs like GPT are actually not a flowing conversation, but one long completion over & over. So it sends the entire conversation from the start plus what you just entered. Now here's the limitation, GPT only has so much memory/resources, so they hard limit the number of tokens (word count score). When interfaces like ChatGPT start running out of tokens, they will attempt to summarize the conversation, delete what they summarized, and start again. Details are going to be lost and the summary may have the wrong timeline or put something backwards. As you continue on, eventually the summaries will be summarized, eventually resulting in "corruption" of the story.
For a DM, you would want a chat interface that keeps the ruleset instructions 100% intact and only summarizes the story with specific instructions to maintain key story points.
@deck_of_DM_Things , could you give the link for the character creation sheets you used?
Sounds amazing I think I will try this so I can try to play dnd
As someone who's not too keen on touching roll20 for a while, and whose friends all have conflicting schedules, this is actually interesting. I've wanted to try 5e and this sounds right up my alley. Also, since it's mobile accessible, I can just do it wherever I want.
That is so awesome!!
YOU are so awesome!
I didn't realize this was a video about seeing how well chat GPT can handle the least prepared player at the table. That is an entirely different test than what this video implied at the beginning.
This is great, AI seems like a great fit for template-based fantasy/sci fi games.
It might help to set an output limit of one paragraph in it's initial instructions, and if it wants to output another it should ask if you want to interject before it continues. What might be happening when it runs with your agency like that is failure to use/'understand' non-verbal cues; if you go back and read those bits and mentally inject a pause in the appropriate places and some kind of positive cue from you, it suddenly makes a LOT more sense.
Very interesting project! I wonder if it would be possible to run something like the Avrae bot that works with Discord along side ChatGPT? It would be cool if you could incorporate die roles and uplaod characters. Perhaps it could work by creating a ChatGPT bot for Discord where Avare generates the die roles and ChatGPT/Discord bot uplaods the results into ChatGPT's message prompt? Another product could be for D&D content creators either writing command prompts like choose your own adventures or including them in modules. Exciting times!
Oh my god. If only I could take this to my past when I first played Zork.
You can have chat gpt create your character sheet for you. You can have anything from a completely random to a tailored and specfic class race and set of skills etc... I asked it to crerate a level 12 bard and I told it told multiclass if it wanted. I also told it the type of gamestyle I like to play so I could get the spells, feats and weapons I wanted to play with. It created a 100% complete character with attributes, spells, feats, skills, equipment and backstory. It even multiclassed into hexblade 3 levels. It was a great character to be honest. I double and triple checked everyhting. Zero mistakes, literally 100% complete. I also played a quick 1 shot with chatgpt to test the character out and I was very pleased with the gameplay. ChatGPT can simulate dice rolls and generate appropriate enemies for your CR.
16:27 "large nondescript building with a heavy iron door and no windows"
19:07 "boarded-up windows and a rusted metal door"
21:29 "a small window that he has already pried open"
I would like to see something use an AI chat bot designed for being a GM for RPG players.
Would be an interesting system to run with.
probably not large campaigns, but definitely for one shots and smaller sessions.
Some groups may not have a DM, don't feel comfortable having a stranger run a game for them, or maybe one week your GM is out sick, and you boot up the AI to run a one shot so you can all still play.
or even someone new, wanting to get a little experience playing under their belt before joining a group.
The video game market could benefit from it too, imagine a digital tabletop where it offers a feature that an AI will design and run a campaign that interacts in real time rather than you having predefined responses and set paths.
Would not replace a GM but open some doors for people.
I cant wait to play the classic modules i DMed so often
This is so cool. You’re going to have people doing full on D&D campaigns at work when they are fucking off.
Yay chat gpt
I tried to use ai dungeun for this with somewhat better results but, ai can be difficult with its memory restraints it seems to need a key note feature that you can use to put in relevant information to reference later
I did a simalr thing with a great out come. Promt was you are DM for DnD ravnica 5E rules. Please control and auto generate all charecters and enemies and rolls. Something this with a bit more specific info will get the job done! Amazing times!
Okay, that was kind of cool. I re-wrote your prompt so that it mechanically worked with Star Wars Edge of the Empire instead of D&D and took it out for a spin. It was a really short adventure - just a couple of combats (which it didnt ask for any rolls, weird) and some NPC interactions - but for the early days of AI? amazing!
There are sites with special interface that makes it easier to give context to the AI. inworld, for example.
Are you telling me that we now can have...roleplaying games on the computer? What a time to be alive...
Holy shit, tried this prompt and rolled dice for outcomes, it was honestly the closest experience to D&D that I've had in a long time. And the starting responses really do help you customize the story you want. I think I was more enthralled with this than I was with AI Dungeon. I'm curious where my adventures take me as "nameless Witcher."
This is kind of cool. Interesting if this is possible to play with more than one player.
This was fantastic
Chat gpt 4 once it’s fully released with the new features will
Be really good at this I think
This was really cool
With it's new feature to customize how chatgpt interacts with the user it plays so much better.
Awesome Idea
What fun is all this. On,y good thing I can think of is of youre soloing without a group
What is absolutely amazing guys is mixing this with Midjourney. So i did this as well but before I discovered Deck of DM Things doing it as well. I trained ChatGPT to also create a visual prompt tailored for Midjourney (In the STYLE of my favourite fantasy artists...the results are just so amazing...its a world being created as I go through it. Ive done dungeon crawls...political RP and even copied games like Wartales/Battle Brothers by being a merc for hire lol.
I would love to see a version of this based in the Tabletop roleplaying system of EITHER Ironsworn Original, or Ironsworn Starforged. I think I would like the Later a bit more as it is a newer system and I kind of want to experience the Scifi Vibes of it. Starwars Legacy - The Old Republic would also be fun to play through... I don't have a lot of friends that are really interested in playing that...
Be interesting to see how it goes with some less well known games. SLA Industries or Lancer for instance
The person who figures out how to merge all of these AI tools: AI chatbOt, AI Art/video, voice to text, text to voice, and AI background music into a single multimodal application specifically for game mastering is going to be rolling in the dough and that will likely spell the end of paid gms. It’s on the horizon-look how well this performed and you weren’t even using GPT4
I feel another cool idea would be the ai being a player character in your story
This gets me super excited! Me and my partner being two socially awkward people would appreciate an AI taking care of DMing for us. That would be great!
It seemed very generous with the arcana check of 12
This is very entertaining
I would love to see you do the same video but for Gamma World.
This is really awesome! I cant believe this technology is in our hands. Is it possible to DM and have AI as the players?
I just had an impromtu text adventure aboard the USS Enterprise 1701 with Kirk and crew writen and executed fully by chatGPT. I think I just found the greatest use for that technology mankind could ever hope to concieve.
It seems to have a serious case of the "yes and"s. The mention of ray of frost for a lock would have elicited a "no" from a human DM.