AI Sound Effects Are Here and they ROCK!
Vložit
- čas přidán 10. 05. 2024
- ElevenLabs is capable of generating a wide variety of sound effects for practically any use case. It's great for film & media, video games, commercials, and more.
▼ Link(s) From Today’s Video:
elevenlabs sound effects: elevenlabs.io/ai-sound-effect...
RTX 4080 Super Giveaway! • I'm Giving Away an RTX...
► MattVidPro Discord: / discord
► Follow Me on Twitter: / mattvidpro
-------------------------------------------------
▼ Extra Links of Interest:
✩ AI LINKS MASTER LIST: www.futurepedia.io/
✩ General AI Playlist: • General MattVidPro AI ...
✩ AI I use to edit videos: www.descript.com/?lmref=nA4fDg
✩ Instagram: mattvidpro
✩ Tiktok: tiktok.com/@mattvidpro
✩ Second Channel: / @matt_pie
-------------------------------------------------
Thanks for watching Matt Video Productions! I make all sorts of videos here on CZcams! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!
All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.
-------------------------------------------------
► Business Contact: MattVidProSecond@gmail.com - Věda a technologie
I'm a game designer/game dev. Started in 2004 on The Witcher. Went indie in 2015. Bought a microphone to record audio, bought a mocap suit to record animations, etc. :-). Now you can get pretty much everything by just typing something into a text box :-)
if only...
As a dev how do you feel about technology such as this? Really curious to hear from someone who has been in the field for a long time.
P.S: Thanks for The Witcher games a reality (that goes for all the devs and people involed).
@@michaelsimonsen2017 I do woodworking as a hobby :-). So worst case scenario, I'll be making furniture.
@@michaelsimonsen2017 i dont have tje same depth as the (only 12 years in) but im frankly excited. I also dont work in games. I work mainly on the touchscreen devices you see everywhere to put it simply. from medical to automotive to aviation. My 2c is that it will be useful to senior devs, i wonder how a jr dev does get a foot in the door depending on the flavor of the engineering. In my line of work, its still a little too complex to be 'automated'
That being said, i was also a general contractor before this so...back to swinging a hammer or fixing plumbing which isnt exactly a bad job.
Some will be more impacted than others. There will also be differences within the industry. For example in 3D modeling you're likely to see A LOT of impact for set-dressing and environmental dressing. However you're likely to see little impact for character modelers, especially models for animated characters.
In character animation, ie: the motion of a character, for commercials you might see some impact as the quality requirements are lower. However film animation? Probably very little impact because animations are literally tweaked to the frame.
For lighting and rendering? Some impact but again, that stuff is tweaked so much that AI is likely to just help speed the process up.
For VFX? Maybe some impact, especially for lower quality productions but I don't expect much of an impact on the high end. VFX are also often tweaked a lot to achieve certain layouts, looks and movements.@@michaelsimonsen2017
This is incredible, all the pieces for video game production are almost complete. Using this with Suno + Sora + potentially GPT-5 / GPT-6 you'll have the power of a small company.
Hollywood😅 awaiting patiently 😁
🤣🤣🤣@@PdWOLFG4NG 🤞
Did you see yesterday and today news of Devin? That's the biggest piece of your puzzle
that sadly seems more like scam@@markmuller7962
@markmuller7962 I did, just after posting this 😂 will be amazing to see what Devin or a similar agent could do if it's given access to all these tools
Mario Wahoo and ASMR had me ROFL
this combined with sora will make the movie producers worried
It's more of a threat to actors, voice and foley artists than producers.
Going to make it aaaaaalot easier/more accessible for people wanting to visualize their imaginations. It’s going to be awesome
I'm a movie producer I am not worried I am sure this will speed up production but Sora is not yet up to standards for film production and unreleased
why would they be worried about the job of their employees getting easier?
@@LetsGetSmarted their employees jobs will be getting eliminated eventually, followed by their own jobs. Also they are the producers subordinates not their employees.
ASMR is definitely the highlight of this video 14:35, I'm in tears laughing at the people who expected normal ASMR. However the warp drive sounds pretty good in stereo 11:50.
What do you guys think!? I was blown away!
Every day, getting closer and closer to AGI
This technology is incredible!
Speaking, however, of what I thought, I must say that it makes sense that the model is not able to generate contiguous sounds such as "train followed by the scream of a man" or "unicorn followed by the sound of glitter". After all, in any online/offline sound effects library we don't find composed sounds. They just have no purpose. If you think about it, this is a good thing, because the sounds must be taken individually and composed in post production to give the best experience. So having one sound followed by another within the same audio track would mean having to adapt the video to the sound and not vice versa, making the sound essentially useless or more difficult to deal with. To conclude, if you noticed, the model you used managed to generate single sounds very well and with high quality, but the composed ones sent him into paranoia.
I think it would have been interesting to see if it could generate sounds like "storm", "drowning under water", "drone sound", "hit", "whooshes", "foleys" or any other named sound used in cinematography. What do you think about it?
That's fantastic! However, you need to be a bit more specific. For instance, when you say punching or punch, what exactly are you punching? I believe specifying the object or material you're punching will make the sound much more closer to what you're expecting to hear.
Well I think it's amazing
you should check out my edit AI, has great sound fx like this and u can use now...
10:33 I laughed so hard at the mario one :D
that‘s a lot of stairs 🤕
A lot of those would SEEM a lot more realistic when paired with video showing the event. Hearing the can crunching by itself is sort of "Okay, I can kind of imagine it". But show a man crunching a can with the sound effect and we'd be, "Yep! That's real!" Same with the man falling down the stairs. Without seeing the man falling, the sound is a bit cartoonish. But with the visual? Absolutely.
It's a bit like the talking piano, if you know what I mean.
Elevenlabs the King of AI voice. Still waiting for more emotion control and speed control👀
You could try their relatively new Speech-to-Speech model; upload an audio file of yourself speaking with the emotional expression and pace and cadence that you want the narrator to emulate, and the AI will simply replace your voice with that of the narrator of your choice.
Can it improve small flaws in accent/pronunciation? Thanks!@@willmfrank
Not sure; I haven't had either a reason or opportunity to try it myself; I know only what I've read on the ElevenLabs website. I am working on a video that requires narration, though, so I might give it a go this weekend@@notBeggingMattandLissy2PlayRE4
Can we hold a moment of silence for the men falling down the stairs, I'm pretty sure none of them will ever stand up again 😢🪦
😰 That may have hurt a lot . . .
Loving this video! As I'm watching this, I'm hoping Matt is currently recording one about devin lol
this is really cool, i can see this being utilized in indie games or maybe even some short movies
Matt if you go to 16:50, you’ll hear “help me please”
Wow
@@HelamanGileomg
That unsettled me...
11:37 too.
I use a lot of sound effects on my channel reading classic comic books, and most sound effects come from CZcams, so this tech may come in really handy when I need one of those really hard to find sounds!
Matt! another home run review Thank a lot 🔥🔥🤟🔥🔥
11:01 Feel like I can almost hear the samples on some. Goldeneye Theme, CSI Miami Theme. Probably others.
Mario 3 start (crowd in the dark, not as close but maybe a Mario link for why it generated that).
Lol was that vomit ASMR 😂
Temporal AI like video/audio don't like past-tense prompts. Humming works better than hums. Talking works better than talks.
Neither hums nor talks are past tense words…
@@DumPixels I'm pointing out two things.
@@zippythinginvention Ah, ok my bad
This is an insane features, I cant wait to try them on my projects!
the man falling down the stairs was kind of scary in a way. i could feel the impacts xD
Just saying, 11 seconds adds a great deal of humor.
This episode had me rolling! LOL!
This would be sick for sound effects in a horror game
Not only in stereo, sounds like it's binaural too. About the man falling...that's looong staircase. I'm an audio editor so I know what to hear in a sound effect. Can someone try...'neighbors having a kinky session while your roomate is snoring in the background
Listening to this. Last time I toyed with audio was more than 20 years ago. Impressive quality. Mindblown.
As usual for these things it works well about 20% of the time. And they ding you 10 characters for each of 5 generations out of which 1 may be useable. Cool though! Maria wahoo is amazing!
we needed something like this
Dudee.... I cannot wait to make my next horror trilogy :D
I wonder if you can cover the new self-teacing humanoid robots. I see it's huge topic but it'd be cool to talk about it
Freesound is shaking in their boots right now 😂
Someone didn't watch the video
Video on consistent characters? Honestly can't wait 🤩
I think soon we'll be able to do consistent everything, for example just today I read about a new LLM called Command-R, which apparently is more accurate than anything else in answering "needles-in-a-haystack" type of prompt, which is promising. I'm hopeful GPT-5 will also be more than an incremental change and put pressure on the whole industry so we'll eventually see it trickle down to open-source models too.
I guess with AI sound effects, we're past the days when someone could record their fart, slap a copyright on it, and sell it for 50 bucks a pop.
Without a doubt one of your most fun videos. Never laughed so hard. Thank you so much!
8:09 Eleven Labs starts breaking out into a rendition of Low Rider
This is pretty cool. If I want to suggest something for your AI audio video series how do I go about that?
sound quality is pretty nice. signed up.
What my brain decides to produce right before I fall asleep 16:35
Mario wahoo reaction matt epic live for this lol priceless and the stereo futuritic sound effect love
I’m already holding my phone Matt as I’m watching this video on it
Your expressions while listening are hilarious!
15:59 oh no it's ocean gate all over again
This could be good for sound design for music production
I like computer .
Let’s hope computer like us back
@@wedontexist369thats what im sayin
Ye
It's giving me some impressive sounds related to speculative biology.
Like, non existent animals.
Made a python project that like; no mans sky's a bunch of text based creatures and uses a shitload of generated noises i made with it.
It definitely, definitely is already aboce AudioLDM 2.
"mario wahoo" is the magic formula to get zombies sfx :)
they sound amazing in surround sound
Bro what do you think about Devin? Will you make a video about it?
Those bizarre car ones feel like they belong in a Game Theory video. The AI's alive and trapped, what's it trying to say?
think the biggest issue with sfx data used in these models is that 90% is very noisy and low quality data … unless these companies can get access to the sfx libraries from hollywood and the likes and build the models
from those libraries alone, the quality will not improve as rapidly as with music or image/video.
like i had a 1530 GB (1.8 million audio files) pack of sfx and had to delete 800 GB because it was unusable
I lost it on the Mario wahoo 😂 😂 😂
The mario ones made me laugh out loud 😂
Love the Mario, ASMR and car eating you sounds!😅 Bonus: your facial expressions while listening to these abominations.😂
This will see the light of day unlike Sora which I'm afraid be massively delayed maybe someday
6:41 Oh yeah, the creepiness has _nothing at all_ to do with the implications of a man falling hard down a set of stair for 10 seconds straight.
Pov: hoping you try the "falling down the stairs while eating an apple" sound effect
I really hope that the developer don't patch out the Mario Wahoo and ASMR generation. Let those be a nightmare fuel hidden prompt lol
11:08 What the FUUUUCK, lock that thing in the basement and set it on fire, holy hell! XD
Some high quality ASMR...
"This is such nightmare fuel! How can we dial it back a notch? I know : 'Man shrieking in terror'" 😉
I have purchased ~100GB of AFX and the problem is that there are SO many files, it's impossible to find what I'm looking for. I would gladly use this instead, but maybe in another version or two.
Tbh if I am making a game I would rather use meme soundeffects.unless they become better
They need to integrate this directly into their projects UI so you can insert them quickly
It would be cool if we could pick the exact number of seconds & milliseconds that we want our sound effect to be.
Have You seen about Devin! By cognition labs it actually blows my mind.
You could have said "Man Hums" on the later sound effect, because it would be easy to layer the sounds anyway.
I wonder how well it would do sounds for aliens or monsters in a horror game.
12:09 woah
oh... mh ... i thought this would take a video as input an then lay out a sfx layer timed to the animation/video. describing every single soundeffect is a bit ridicoulus isnt it because its will take the same time to generate and evaluate each soundeffect to record and edit it myself, exept the recording is way more fun.
Good stuff, not on the suno AI level, , feels more like a suno AI v1 type of thing. SO maybe in 2 generations it'll be totally usable.
Now I regret watching this at night 😳
It would be interesting if ElevenLabs learns how to do overlapping sound effects. I guess it’s probably complicated to have multiple different things happening in one sound effect.
It's also a balancing act of whether training for that introduces it where you don't want it which may be more of an issue. Like the "falling down the stairs" audio, it's all a bit uncanny without any screaming or grunting but I may have a specific idea for what I want with that and if I have those human sound effects mixed in, it would either make the sample unusable or I would have to use techniques to extract the bits I wanted. Ideally, you could ask for something happening while something else happens but unless they can really eliminate concept bleeding, I think this way is better.
I think some parts of your prompts aren't needed, like the "coming out of a faucet" isn't really needed when you could just have "water being poured into a cup." So that may be messing up the generation, especially when it seems like you had more success the simpler your prompts were.
Plus, usually sound effects are made separately and then combined later because it's more flexible. For instance, the sound of a train engine would be separate from the horn, and the sound of a man falling down stairs would be separate from the sound of a hundred marbles dropping.
Ahhh I missed the give away 😅 only running rtx 1080
"Wahoo" in the style of Mario
What other sounds effects generators we have now?
Not great but still cool, my job is safe for now :)
Typing ceramic cup will get better results its about how u say things
Ffing amazing
Mario wahoo 😂😂😂
That was a lot of stairs
Nice way to get license free sound fx.
The foley industry is gonna shake!
12:27 Cloverfield vibes
Provided you get a useable effect…. LOL What’s the copyright and usage status?
You get the IP rights insomuch as Elevenlabs can provide them. The US copyright office's policy is that a prompt isn't sufficient for a copyright but that's probably not much of a concern for sound effects anyway. But yes, you have commercial usage rights.
@@user-on6uf6om7s Thank you for the info.
Yo! 👋
When the man starts talking
🎯 Key Takeaways for quick navigation:
🎵 11 Labs presents AI-generated sound effects, showcasing impressive text-to-speech technology.
🎧 Sound effects range from soda can crunching to water dripping, with variations and nuances in each generation.
🌟 Impressive audio quality and stereo effects enhance realism and usability for various applications.
💥 Explosion sounds demonstrate significant improvement in AI sound generation capabilities.
🤖 While capable, AI struggles with more complex prompts like overlapping sound effects or abstract scenarios.
👾 Models excel in typical sound effects, such as punch sounds, suitable for video games and media production.
🚀 Early access limitations acknowledged; AI still evolving, not yet mastering intricate or elaborate prompts.
🎮 Overall, 11 Labs' AI sound effect generator shows promise for practical use in gaming and media production.
Made with HARPA AI
You can overlap, episodes and post and just make single sounds video Game makers will or should embrace this. I can’t wait until LTX is more of a thing then we can start making actual movies.
Hi
😮
👍
Are you going to cover Devin?
Just saw it!!! will def talk about it!
Nice
Your prompts kinda blow
AI haters will say "Just learn to do foley"
It's ok.
They should add thumbs up thumbs down to help train the model
I need, FULL stable diffusion, WORLD DESTROYING, sound generation open source model, EVERYONE WOULD LOVE TO JUST PUT ALL THEIR MP3s into a model, and just be able to transfuse, combine, remix, mash up, that is what will take on the world, that is what will kill the industry, have it running behind it's own tail about who owns who, music will be eternal and free, the contract of the music slaving industry will topple
Ask it to make wookie sounds
This
It's cool but i don't think the quality is that good. They sound like a recording with a poor mic in a room with hard reflections