People who is their native language will not understand and she can't be sure she didn't insult an intired nation... But it's better this way because when it going to be efficent it's going to be to late for our governement to adapt and be sure their is no fraud.
Fellow native speaker. It's the intention delivered by the intonation in the sentence that's off. The translation is correct, the pronunciation a little too ambitious, like a news presenter practising. Point is the emphasis on "auch" ("too" or "also" in english). Sounds like she's correcting someone, or maybe siding with a non-speaker. So I'd translate it more like "me neither". Impressive tech, especially as such short phrases are even more complicated to emphasise naturally. But only two more papers down the line ... (referring to Dr. Zsolnai-Fehér)
Exactly my thoughts. Many threads are focussed on complaints regarding translations but what according to me distinguish this tool are not only the voice (as you said) but also (and more impressively to me) the deep fake style adjustments to facial features. I feel as if most are missing the woods for the trees. As for the translation itself, it's a little crease that can be ironed out in time. I can speak for the Hindi translation. Even there, the grammar and the pronunciation are immaculate and it does fairly well for rendering a very generic, neutral accent. What it struggles with is English not having gendered words and conjugations and more importantly, the tool translates too literally and consequently, completely messes up the translation and the intended meaning of the second sentence because it doesn't interpret the American colloquialism surrounding the word "totally". In that sense, it might even struggle with the current usage of "literally" as an exaggeration and by extension language constructs like sarcasm. For anyone interested in the finer details of the Hindi mistranslation, I'll simply copy-paste my other comment... *** While the grammar and the pronunciation are perfect, ironically, the translation itself is off. The lack of gendered words and conjugations is already the subject of this thread but much more strikingly, it's the second sentence where the conveyed meaning COMPLETELY CHANGES. I'm willing to wager that she said, 'a language that I totally can't speak' which would imply that she can't the language of Hindi at all. But the engine translated it very literally giving the impression that she can't speak the language completely but implying that she can partially. Colloquialisms and language constructs such as sarcasm naturally and understandably are very challenging for these to deal with. The main takeaway here should be the almost immaculate job it does with her voice and facial features, especially the lips and the teeth, to match the pronunciations. That IMO is the mind-blowing part of this video. The translation can always be iteratively improved but this is the USP, at least to me. I would also be very interested to know how much training data this tool required to produce these results. That might be another differentiator it has going for it. ***
Haha. Lol! 😅 But on a serious note, I really hope you all don't let Ai overtake you! It may be helpful, but our brains are better. IF you actually train it!
I don’t speak Hindi but I understand many south Asian languages , and she technically referred to herself as a man but apart from that it was all correct
@@jumpy2783 most south asian languages have the same gender system. even if that commenter doesn't speak hindi but instead speaks punjabi, gujurati, marathi, or etc (basically any north indian language) they would still immediately be able to tell.
@@jonasdavies1806not you being queerphobic and disrespecting some Asian cultures with third gender and more. You should educate yourself and be open minded to others.
Nows a great time to have a unique language thats an amalgamation of multiple other languages: the laws of a mixed language would be really difficult to program for a computes. Big up Jamaica.
Damn that's trippy. I'm German and must admit that I would not have noticed anything odd about it, if you hadn't mentioned you're using this voice tool. It hit the emphasis and the tone of your voice almost perfectly. I bet if you gave this one more year to develop it would be flawless... Truly huge if true. But if it masters language specific slang on day may God protect all the good voice actors out there 🙏.
@@saba_350 so, YOU have a clue? and can judge others opinions? wow. Do you know what she said in the original or tried to say? Take my advice: please don't talk about something you don't have a clue either!
@@McRusensame with the Hindi, the words sound right and are spoken in the right order but it lacks the experience of a native speaker and sounds like a foreigner speaking it. But still extremely cool imo.
@@wheresanthony6228 The usual issue with big language AI models. It is correct grammar, but no one would say it like that. Sounds like an american WW2 spy getting caught in a french bar.
Yeahhhhh….. do you even know hindi it wasn’t accurate it a bit bad honestly cuz no one in india speaks complete hindi as all cuz they don’t even know fricking complete hindi and i bet it won’t be future for now as a translator cuz more languages might have similar and different problems like these as you mentioned she addressed her self as a men so yeah
@@charles5a well the UT in Star Trek was a storytelling necessity, but we've had humans translating in realtime for years. Either way I look forward to it.
@@BrentHollett indeed. Realtime written translations during web meetings is already impressive enough & quite useful. We're not far from a switch to voice translate by state in webmeetings, and not too far from a time when you can walk around with a device translating realtime while walking on the streets, and pushing that translation to your earphone.
I'm most impressed with the mouth movement. Even if you still need to input the translated words, that would be amazing for movies. I mean, there's subtitles for a lot of movies already, so I wonder if you can take existing movies and do it.
Nothing is “private” nowadays, the second you get online and log in you willingly took your privacy away. Stop acting shocked about privacy if you’re actively causing it to vanish.
Yeah. I am old, I was already an Adult before Bill Gates was out of high school. Computers have gone from an interesting idea, to a scary threat in just PART of my life.
@@jiophone2412 “Jetzt spreche ICH vielleicht Deutsch. Ich spreche AUCH kein Deutsch.” (I; ALSO) is stressed arbitrarily. The pronunciation is unusually clean, but that's also the case with her original speech in some way. The lips seem to be in sync, but there's some unnatural lip splay-reminding of despair. It's likely caused by a suboptimal concurrence of the original & the artificial mime.
That’s pretty awesome. We could reach people all over the world that would be so sweet technology amazes me every day since we’re in such a great moment in time to be alive. I’m just grateful to witness it all if we could talk to other people in different countries that would be so cool break the language barrier exciting
You speaking Hindi had me 😮😮! Although should've been bol rahi hu ( feminine ) instead of bol raha hu ( masculine ), amazing feature nevertheless! Love your content!! :)
Omg. As a German I have to say, the AI made your voice sound so realistic and normal but extremely German on the other hand. As a nerd I’m just completely overwhelmed.
Yeah but it was a little off because the accentuation was on the wrong words for what she actually meant. Ich spreche AUCH kein deutsch sounds like someone else didn't speak German too 😅
Yea it was shockingly impressive! The articulation and pronounciation was incredible! Only the Grammar gave it away. It was kinda a word for word translation.
bro sorry but it did NOT sound 100% correct. the intonation was off. language is not only pronounciation but also the intonation. it's way way less important in german than in some asian languages, but still that's where you spot someone who learned german later in life, or a native speaker.
Las traducciones son literales, va a tomar más tiempo de entrenar los algoritmos para adaptarse al argot obvio. Lo que me sorprende es el timbre de la voz, el ritmo y lo bien que está hecha la boca en deep fake
@CarolinaFlorezCoaching Actually, I saw this Tech First on Jarrod Kimber Channel and I was like why he is paying someone to dub such Formal sounding videos.
@@CarolinaFlorezCoaching the french sounded a bit like canadian french, or at least with a pronunciation that we don't use here in france. i follow a lot of content in english and i use the engish subtitles as a support for my understanding. but sometimes the wor detection is off an it gives pretty funny results... X)
Now you're being replaced by another AI version of you from Aiverse that was actually can contribute things to the society and not good for nothing and actually can speak any language fluently without spending 5 years trying to learn one language
I've been improving my Spanish lately, and have been learning Italian for the last 3 weeks. Guess I'm just wasting time! 😂 Kidding, obviously. Being able to communicate in person is still very important, and I genuinely want to understand others in person, etc. Of course, those tools aren't far behind, and that's amazing too!
im only a student as of now learning german and, i cant lie thats quite convincing. my ears picked some discrepancies but thats actually not bad for new technology
I don't see what she's getting at... what did she mean by "but they don't know the voice you're uploading is yours"? I thought it's just auto-translating the audio to different languages, and you can edit the translation, but it's choosing a voice (some default...?) automatically -- because she also said they're not going to clone your voice for the translations
There is an Outer Limit episode I watched just last week that it reminds me of. It ended with all the world leaders understanding eachother without actually speaking the other language. Outer Limits is an old sci-fi series but I only recently started watching. But SOOOO many episodes can be.... almost creepy in its relatable concepts
The thing is, there is value in learning a new language because it actually changes the way you view the world. It's still better to learn the language.
My first language is French, but I'm fluent in english as well: most of my day job is in english. One thing that doesn't yet seem quite there yet from the small french clip is that emotions are not being conveyed as well, in my opinion. I think that will be a huge challenge for an AI translator: we often see people changing their behavior quite a lot between languages they are fluent in, mostly because of culture being different. To me, the usual english closing line sounds super hopeful/enthusiastic, kinda like if talking to a friend about something awesome. The French one sounded way more formal, a bit like something you'd find in a TV documentary. That being said, I'm sure the tech will eventually improve, and it's already awesome!
That’s an interesting insight!! I will say I don’t think that’ll be true for very long. I don’t think it will actually be that huge of a challenge ultimately either because of how AI training data is and will increasingly become collected
As a German, I can confirm. It sounds like a native German speaker, but the accentuations are weird. When I first thought she was speaking real German, I blamed it on her being no native speaker, but she had NO accent at all.
I'm pretty sure actually knowing the language is still way powerful though 😂 it's the difference between owning the tool VS. having the tool be your actual brain
The instantaneous translation devices from sci-fi will be real one day. We will have headphones and glasses that will replace the audio and mouth movements in real time and we will be able to talk to anyone.
I work as a translator and interpreter. Tbh, I am fine with AI taking my job away. I think the benefits outweigh the consequences. Being able to communicate across cultures and countries is a net positive for humankind. In the meantime, I will also learn farming. lol
@@ReligioCritic it's already good but not everyone uses it properly. See modi ji song covers. Some are too good they sound like real while others are less trained model feels like 🤖. Btw loved your video of bhudhist caste system
"Meanwhile, the poor Babel fish, by effectively removing all barriers to communication between different races and cultures, has caused more and bloodier wars than anything else in the history of creation."
@@ChemEDanit was a surprisingly good translation, although the melody of the sentence was off. It stressed the wrong word and it somewhat changed the implication of the sentence. But that level of language translation is so complicated and I highly doubt AI will be able to do that in the near future. You'd probably have to be a native german speaker to get these fine differences.
@@ChemEDan It was super convincing! The intonation was a little weird, because it sounded like she asked questions, but just slightly. Otherwise it was flawless! Greetings from Germany 😊
Imagine this in zoom for instance, I’d be talking to a Russian who can’t speak a word of English, but he will see me speaking perfect Russian, while I’m seeing him speak in perfect English. We’re probably gonna see this technology develop into real-time translation in the next few years. Exciting!
And the A.I decides what the correct translation is - or it maybe decides to translate something completely different and both persons are each just having a conversation with the A.I., which then can decide whether it wants the people to be peaceful or having war. Regulatories cannot beat that.
What the fuuuuu... I have a hindi poetry channel and was literally stunned for a second the moment you started speaking Hindi. Too good mate, too good!
Not really. The stressing in the first sentence was kind of awkward. I would stress „jetzt“ (now) or „vielleicht“ (maybe) instead of „ich“ (I). And the second sentence is that as a whole, it sounds like you are affirming another person who just told you they don’t speak German that you don’t as well. Instead of that German is a language you can’t speak among others. For my ears pulling „Deutsch“ to the front and negating the verb instead for „Deutsch, spreche ich auch nicht“ would sound better.
@@salepienI'm doubtful that it will ever get these nuances right but then again the pronunciation is pretty good. It sounds a little soft compared to how most of us speak (an artefact of her accent I guess) but really impressive nonetheless
My native language is spanish and I've been learning english since 2015 by myself. I made a lot of progress and I enjoy a lot your channel. The part when you were speaking sound absolutely natural! That's a little bit scary and impressive!
the way ypu pronunce "extraordinario" sounds weird but also sounds like those actors that pretend to know how to speak spanish in an specific scene but it sounds bad
She refers to herself as a guy in Hindi. It was quite unexpected and frankly hilarious 😂😂😂
Yeah but the grammar and pronunciation was perfect
@@krateproductions4872it's much better than any other alternative like google translate that make it look like you're reciting 15th century poems...
@@xa-4246fr
@@xa-4246true
Ikr 😂
30 years ago, this was literal science fiction. Who cares if it's only 80% correct.
Babelfish!
Even 5 years ago! This is really remarkable.
I don't think 30 years ago, they think it was possible!!
I dunno, the great risk of miscommunication is worrying
People who is their native language will not understand and she can't be sure she didn't insult an intired nation... But it's better this way because when it going to be efficent it's going to be to late for our governement to adapt and be sure their is no fraud.
I'm fluent in german and it kind of made a mistake on which words to put emphasis on, but like the fact that it could even do this is just crazy!
Exactly, truly the creepiest part lies in the fact that it was pretty much said in her own voice O_O
Yeah, definitely sounds weird and off... Though I can't really put my finger on it, tbh... (native speaker)
Fellow native speaker. It's the intention delivered by the intonation in the sentence that's off.
The translation is correct, the pronunciation a little too ambitious, like a news presenter practising.
Point is the emphasis on "auch" ("too" or "also" in english). Sounds like she's correcting someone, or maybe siding with a non-speaker.
So I'd translate it more like "me neither".
Impressive tech, especially as such short phrases are even more complicated to emphasise naturally. But only two more papers down the line ... (referring to Dr. Zsolnai-Fehér)
Nah I am a fluent German speaker myself and it was damn near perfect. That is scary.
Doraemon's gadgets are getting real...
fr
Yup translation tool wala 😂
Can't wait for the anywhere door and time machine.
💀
It's not The language. It's the sound. It actually sounds like you. That is some crazy technology.
Exactly my thoughts. Many threads are focussed on complaints regarding translations but what according to me distinguish this tool are not only the voice (as you said) but also (and more impressively to me) the deep fake style adjustments to facial features. I feel as if most are missing the woods for the trees.
As for the translation itself, it's a little crease that can be ironed out in time. I can speak for the Hindi translation. Even there, the grammar and the pronunciation are immaculate and it does fairly well for rendering a very generic, neutral accent.
What it struggles with is English not having gendered words and conjugations and more importantly, the tool translates too literally and consequently, completely messes up the translation and the intended meaning of the second sentence because it doesn't interpret the American colloquialism surrounding the word "totally". In that sense, it might even struggle with the current usage of "literally" as an exaggeration and by extension language constructs like sarcasm.
For anyone interested in the finer details of the Hindi mistranslation, I'll simply copy-paste my other comment...
***
While the grammar and the pronunciation are perfect, ironically, the translation itself is off. The lack of gendered words and conjugations is already the subject of this thread but much more strikingly, it's the second sentence where the conveyed meaning COMPLETELY CHANGES.
I'm willing to wager that she said, 'a language that I totally can't speak' which would imply that she can't the language of Hindi at all. But the engine translated it very literally giving the impression that she can't speak the language completely but implying that she can partially.
Colloquialisms and language constructs such as sarcasm naturally and understandably are very challenging for these to deal with.
The main takeaway here should be the almost immaculate job it does with her voice and facial features, especially the lips and the teeth, to match the pronunciations. That IMO is the mind-blowing part of this video. The translation can always be iteratively improved but this is the USP, at least to me.
I would also be very interested to know how much training data this tool required to produce these results. That might be another differentiator it has going for it.
***
Not only the voice feather of you. It changed the month and eyes actions to match the voice. It's crazy.
People still say AI wont get better
@@kaorutikuikr!!
@@prayanklalan5138 I'm not reading all of that 💀
Cleo became Clinton in Hindi.
Lol tru 😂
Clinton
Cleonardo
That's Typically a Lady's voice
😂
Broo the hindi got me 😂😂😂😂😂😂😂😂😂😂😂
I was surprised when I saw hindi and even more surprised when I saw she was referring to herself as a guy
As a french speaker the French translation sounds soo AI and robotic. ( La voix de lama fâché 😭😭)
AGAHAHAH OUI TELLEMENT
IKR it was such a stiff voice
As a non french speaker, i can back this up
on a pas écouté le même extrait alors... si l'audio était juste un peu plus accéléré j'aurais vraiment cru qu'elle peut parler français 😅
@@youtubeurtout-à-fait
Plot twist: Cleo has been AI generated and fooled everyone for a long time
Plot twist: somebody gonna go full Code Lyoko for this fine ass woman.
Plot twist: Heisenberg is Transcendent
So it was MKBHD all along!
That's why I came here to mention her that is we use this tool so it can create a lot of confusion like the You accent in Hindi and English
Walter white😂
I was stunned for a second when she spoke Hindi so fluently.
Exactly .. it was totally unexpected 🙄
He* 😂😂
Mai hindi bol raha hun........
Dan Dan dannnnnnnnnnnn!!!!!
Fraud😅
Y'all get happy for the smallest things
He*
My online spanish class project just got wild 😂
"Tower of Babel joins the chat"
Imagine how many fake polyglots they're going to be
And how many salty people will claim actual polygons as fake
Oh no
@@dunkyourdonuts2282as someone who tastes salty I do indeed hate polygons… their shape, yikes
@@haz226ikr polygons are so ugly.. 😔
There’re
1/2 delightful, 1/2 horrifying. Now I know why aliens in Star Trek speak perfect English.
The treasonous one in Star Trek Beyond used a translation-decoding collar, so… an alternative, yes
They explained that frequently in the series... The badges they wear are communicators and translators.
100% horrifying
😂😂😂...
well when she used it sher refered to herself as a guy in hindi so I'm not worried
I was amazed at work because my coworker’s screen is English, but on the big screen it’s in Spanish.
This is just on a whole different level
This is the best quick to the point HeyGen video. You rock!
I don't think this is Heygen, her lip sync in this is just too perfect.
I was stunned for a second when she spoke A.i so fluently.
Haha. Lol! 😅 But on a serious note, I really hope you all don't let Ai overtake you! It may be helpful, but our brains are better. IF you actually train it!
@@mvillegasv8 amen 🙌🏻
That Hindi got me stunned for a second.
I don’t speak Hindi but I understand many south Asian languages , and she technically referred to herself as a man but apart from that it was all correct
@@HighExplosiveOP Either you actually knew, or you just saw the top comment
@@jumpy2783yup they definitely saw it lol
@@jumpy2783 most south asian languages have the same gender system. even if that commenter doesn't speak hindi but instead speaks punjabi, gujurati, marathi, or etc (basically any north indian language) they would still immediately be able to tell.
but it becomes bol raha hoon instated bol rahi hoon.
NOW i know how universal translator in Science Fiction work and why their mouth look like they're speaking english !
Tardis😂
Peter Quill in space
People are gonna suddenly have a WHOLE BUNCH of films they're willing to watch.
Cleo speaking Hindi is the best thing I've seen today
Stop it. Koi India ka naam lele yaa usse kuch related aur tum chutiye uska comment section bhar dete ho.
Gora validation se Chen nhi bharta kya?
Her words are literally being cloned translated. Did you not understand what she said. She's not speaking your language 😲
@@dmr123kkla I didn't say she actually spoke Hindi and it's not my language
You must not have a lot going on
But as a dude
Holy crap, that English is flawless!
It's okay
Lmaooo
@PiousMoltar dude, first, well that's toxic. Second, it's a joke
there were some mistakes but hindi one is very accurate
they didn't get the joke bro 🤣
After hearing her hindi i can definitely say that AI still have a long way to go before they take over the whole humanity 😅😅
Aight ngl i literally got SHOCKED when she suddenly spoke Hindi lol 😭😂
Polyglot pranks the internet
This one had me chuckling 💀
LOL
Kekekeke 😂
Is she?!?
The Spanish translation had an awkward translation for "wild" but it was still crazy good.
this is not good, its terrifying. Cue deepfakes of everything, and the end of epistemological ground truth.
@bobf5360 good as in proficient.
The accessibility is good. The abusability isn't.
The German one was also off a bit.. the pronounciation was good but the choice of word was weird.
Also her spanish was specific from Mexico, so if they use it to fake some I know is not Mexican i'll know its fake, but still very good.
It's like "J" after a "H", "Salvahje".
Like the AI try to go with a Caribbean accent and then change to neutro.
As an english-Spanish speaking person that was insane!!
Ah the TARDIS translator
That Hindi was damn near perfect!! No weird slang or overly flowery language that some direct textbook translation tools use. Awesome!
Only Gender is changed😂
@@infotechoverloaded721the biggest Only 😂
Except switching her gender
You never know how many genders are here in the west.
@@jonasdavies1806not you being queerphobic and disrespecting some Asian cultures with third gender and more. You should educate yourself and be open minded to others.
The Hindi speaking was insane and fluent and felt natural. The gender was incorrect, but AI will figure that diff out in no time, amazing! 🤩
Hindi got the gender wrong. But still amazing
Ai won't figure that difference out, it's a problem in the language themselves.
@@prateekkarn9277 with a bigger data set it can figure it out. Chat gtp is a language based AI. It just needs more data and time.
@prateekkarn9277 ai will definitely figure it out.
@@prateekkarn9277It can figure out by understanding the difference in male and female voice.
Nows a great time to have a unique language thats an amalgamation of multiple other languages: the laws of a mixed language would be really difficult to program for a computes. Big up Jamaica.
You struggled learning a new language and forgetting a language you just learned? Your so smart! Lok f -n with you.
Damn that's trippy. I'm German and must admit that I would not have noticed anything odd about it, if you hadn't mentioned you're using this voice tool. It hit the emphasis and the tone of your voice almost perfectly. I bet if you gave this one more year to develop it would be flawless... Truly huge if true. But if it masters language specific slang on day may God protect all the good voice actors out there 🙏.
yes, indeed the German sounded very convincing.
@@henningbartels6245it made no sense what she said it sounded good but it made not sense please don’t talk about something you have no clue about
in german it made no sense what she was saying. it sounded good but it did not make sense what she was sasyim.
@@saba_350 so, YOU have a clue? and can judge others opinions? wow.
Do you know what she said in the original or tried to say?
Take my advice: please don't talk about something you don't have a clue either!
Cadence and emphasis were wrong and native speakers wouldn’t word the last sentence that way.
As an indian, that’s the best i’ve seen an american get at hindi 😂😂
Edit: yes the gender tense was hilarious (she referred to herself as a guy lol)
Itna toh chltaa h bhai
@@user-dy3qn3vd1t yeah we know
@@user-dy3qn3vd1tWe know….
@@Sethjigr8ji sahi me idhar ke launde Hindi ki zyada khichdi bana dete hei, other than gender that was really good 😂
She’s not actually speaking the languages. It’s an AI voice over using a translator lmao
Oh my goshhhh
Your Spanish was fantastic, the mouth movement looks so natural and it's only going to get better
The AI did not translate the Spanish very well, though. It's clunky and the mouth movements seem a little weird.
Watching dubbed movies after this ganna be so much better
Im german. That sounds incredibly authentic. (Ok update: I agree on the sentences being scuffed but just the talking itself sound pretty remarkable)
It really sounds like a foreigner, though. The pronunciation is okay, but cadence and emphasis are pretty far off from a native speaker.
@@McRusensame with the Hindi, the words sound right and are spoken in the right order but it lacks the experience of a native speaker and sounds like a foreigner speaking it. But still extremely cool imo.
I think the sentences that were chosen feel a bit off especially in that order. But the speaking itself sounds pretty legit in my books
@@prajwalkrishnabhat5539But her last sentence was completely mistranslated into Hindi. That AI truly socks at translating.
@@wheresanthony6228 The usual issue with big language AI models. It is correct grammar, but no one would say it like that. Sounds like an american WW2 spy getting caught in a french bar.
That's so cool!😊 The hindi one sounded really accurate except for the tiny fact that you addressed yourself as a male in hindi😅
Yeahhhhh….. do you even know hindi it wasn’t accurate it a bit bad honestly cuz no one in india speaks complete hindi as all cuz they don’t even know fricking complete hindi and i bet it won’t be future for now as a translator cuz more languages might have similar and different problems like these as you mentioned she addressed her self as a men so yeah
@@ultimategaming4018ok
@@ultimategaming4018its a new product.
It will improve with time and effort
@@ultimategaming4018She spoke perfect Hindi except addressing herself as a male. And where did you get the idea that nobody can speak perfect Hindi?
@@ultimategaming4018forget about her hindi.
WTH is wrong with your english?
I am unable to understand your comment properly.
Upload this to neurolink, we'll be able to communicate with each other with ease, let alone an alien species in the future.
Julia Roberts: You copied my likeness and I've got some mouths to feed. Where are my genetic royalties?
Were getting closer to a universal real time translator every day.
Another StarTrek prediction?
@@charles5a well the UT in Star Trek was a storytelling necessity, but we've had humans translating in realtime for years.
Either way I look forward to it.
@@BrentHollett indeed.
Realtime written translations during web meetings is already impressive enough & quite useful. We're not far from a switch to voice translate by state in webmeetings, and not too far from a time when you can walk around with a device translating realtime while walking on the streets, and pushing that translation to your earphone.
That Hindi was so realistic except that the AI referred to herself as a male lmao
I'm most impressed with the mouth movement. Even if you still need to input the translated words, that would be amazing for movies. I mean, there's subtitles for a lot of movies already, so I wonder if you can take existing movies and do it.
This is by FAR the coolest use of A.I. that I have seen so far! Color me impressed!
From a teaching and learning perspective this is insanely cool and exciting, from a privacy perspective this is terrifying
Yup
Nothing is “private” nowadays, the second you get online and log in you willingly took your privacy away. Stop acting shocked about privacy if you’re actively causing it to vanish.
Yeah. I am old, I was already an Adult before Bill Gates was out of high school. Computers have gone from an interesting idea, to a scary threat in just PART of my life.
That lip movement match is phenomenal OMG
This is the true technology
For German, the lips seem kind of off imho, even though the sound itself fits.
@@christbaumer Is that so? The match for Hindi was spot on even tho the speech used by the AI is referring to her as a man and not a woman
@@jiophone2412 “Jetzt spreche ICH vielleicht Deutsch. Ich spreche AUCH kein Deutsch.” (I; ALSO) is stressed arbitrarily. The pronunciation is unusually clean, but that's also the case with her original speech in some way. The lips seem to be in sync, but there's some unnatural lip splay-reminding of despair. It's likely caused by a suboptimal concurrence of the original & the artificial mime.
It's still kinda experimental tho. The French sounds like google translate, the rest I don't know about, but it sounds kinda unpolished,idk
“If we get this right” 😂yeah that’s never gonna happen
That’s pretty awesome. We could reach people all over the world that would be so sweet technology amazes me every day since we’re in such a great moment in time to be alive. I’m just grateful to witness it all if we could talk to other people in different countries that would be so cool break the language barrier exciting
You speaking Hindi had me 😮😮! Although should've been bol rahi hu ( feminine ) instead of bol raha hu ( masculine ), amazing feature nevertheless! Love your content!! :)
My Punjabi wife said the same thing. Amazingly good pronunciation and grammar, except that one thing haha.
@@ItchyCinderBlock Haha! Almost every Indian in the comment section is pointing out that one little mistake!
@@ItchyCinderBlockit's horrifying to think AI can speak better Hindi then your wife in a few years
Omg. As a German I have to say, the AI made your voice sound so realistic and normal but extremely German on the other hand. As a nerd I’m just completely overwhelmed.
Yeah but it was a little off because the accentuation was on the wrong words for what she actually meant.
Ich spreche AUCH kein deutsch sounds like someone else didn't speak German too 😅
Oh wow youre sooooo nerdy....youre soo cool
War geil oder??? Bis jetzt dachte ich immer die Videos sind fake
Yea it was shockingly impressive! The articulation and pronounciation was incredible! Only the Grammar gave it away. It was kinda a word for word translation.
bro sorry but it did NOT sound 100% correct. the intonation was off. language is not only pronounciation but also the intonation. it's way way less important in german than in some asian languages, but still that's where you spot someone who learned german later in life, or a native speaker.
This is big. I was waiting for this!
looks like the star trek communicator is becoming a reality.
Omg the Spanish was short but STUNNING, unlike French which sounded a bit more Google Translate-y, I’m awed, can’t wait to get my hands on this
Salvaje? No tiene sentido en castellano...
@@DaniSilvSestaba pensando lo mismo. Seguro que dijo "Wild" en el original
Las traducciones son literales, va a tomar más tiempo de entrenar los algoritmos para adaptarse al argot obvio. Lo que me sorprende es el timbre de la voz, el ritmo y lo bien que está hecha la boca en deep fake
@@DaniSilvSen Puerto Rico lo tendría 😂. pero al parecer es una traducción literal.
You are right about things not getting translated properly. Your hindi was in the male perspective. But other than that it was flawless.
Also, the Spanish sounded a little stuffy/ not quite as casual as her content is.
@CarolinaFlorezCoaching Actually, I saw this Tech First on Jarrod Kimber Channel and I was like why he is paying someone to dub such Formal sounding videos.
@@ramadevimahilap.g.mahavidy4582 that’s funny! 😂
She said it was ai generated you dumbies
@@CarolinaFlorezCoaching the french sounded a bit like canadian french, or at least with a pronunciation that we don't use here in france. i follow a lot of content in english and i use the engish subtitles as a support for my understanding. but sometimes the wor detection is off an it gives pretty funny results... X)
basically the Universal translator from StarTrek!
damn, the fact that mouth movements are also matched is another level of wow!!!!! ✨✨✨✨
Now you're being replaced by another AI version of you from Aiverse that was actually can contribute things to the society and not good for nothing
and actually can speak any language fluently without spending 5 years trying to learn one language
You summoned the whole Indian audience with a single line!! 😂
NOT EVERYONE IN INDIA SPEAK HINDI
Hindi Audience
@@LeoDas688 these people think Hindi is the only one spoken in India.😂
@@Rajkumz or every Indian know hindi
I guess it’s better than having a fish slither into your inner ear…
I've been improving my Spanish lately, and have been learning Italian for the last 3 weeks. Guess I'm just wasting time! 😂 Kidding, obviously. Being able to communicate in person is still very important, and I genuinely want to understand others in person, etc. Of course, those tools aren't far behind, and that's amazing too!
As a German: that actually sounded quite convincing already ❤
True
But the "auch" did sound kinda outta place not enugh to make me think its ai but yeah
sie klingt ein bisschen wie gnu mit der betonung
@@z4po325finde ich net
im only a student as of now learning german and, i cant lie thats quite convincing. my ears picked some discrepancies but thats actually not bad for new technology
AI becoming terrifying day by day.. 😂😂
The French was actually pretty good. It even got the accent right.
Spanish too, it's crazy!
Only thing maybe is the speed of the speech, but otherwise it was pretty impressive
No the french was weird
The french was pretty bad, it sounded like a regular robot.
Yep, the French part sounds weird.
As someone who speaks french, it sounds like a robotic Céline Dion
Some day another Star Trek device will exist. The Universal Translator.
I'm Indian and I can confirm the Hindi was even better than what I speak 😅
Bhai me toh Puri tarah se chauq gaya tha 😮😅
But gender 😅
Bruh... Mujhe to English bhi nahi ati nahi hindi thik se ati hai
The last sentence she said in Hindi was also grammatically incorrect.
@@Banditxam4 lekin tereko hindi words type karne aatha hai woh bhi english alphabets mein 🧐
This is actually quite terrifying.
Simply because of the malfeasance it could be used for.
I don't see what she's getting at... what did she mean by "but they don't know the voice you're uploading is yours"? I thought it's just auto-translating the audio to different languages, and you can edit the translation, but it's choosing a voice (some default...?) automatically -- because she also said they're not going to clone your voice for the translations
Hmmmm. Yes, as Cleo said. "If they get it right." She's usually optimistic, so it was good of her to cast some shade on this tech.
Already has been. Eric Adams robocalls
Someone on CZcams makes short videos using Arnold Schwarzenegger's voice. Including singing.
Another another does dad jokes with the voices of presidents.
Mon Dieu! Please end your short videos in (AI manipulated) French from now on. Somehow it's even MORE charming and persuasive!
There is an Outer Limit episode I watched just last week that it reminds me of.
It ended with all the world leaders understanding eachother without actually speaking the other language.
Outer Limits is an old sci-fi series but I only recently started watching. But SOOOO many episodes can be.... almost creepy in its relatable concepts
That's actually terrifying and appealing at the same time
The last French part when she said “Teek-noL-Ooe-Gee” is what made me like this video
The French was decent. It did sound a tad "robotic", though.
The french one was the weird one and lips did not go with it
As a French guy I can say it was still pretty impressive although it sounded more like Québec French. Pretty cool though!
Imagine control they will have when we all communicate using that thing
Youre going to love when people have you say other stuff for you
imagine spending the 30 years becoming a polyglot and in 5 years any of us will be able to speak any language with the touch of a button.
you will not literally speaking another language per se though
The thing is, there is value in learning a new language because it actually changes the way you view the world. It's still better to learn the language.
its not the same
My first language is French, but I'm fluent in english as well: most of my day job is in english.
One thing that doesn't yet seem quite there yet from the small french clip is that emotions are not being conveyed as well, in my opinion.
I think that will be a huge challenge for an AI translator: we often see people changing their behavior quite a lot between languages they are fluent in, mostly because of culture being different.
To me, the usual english closing line sounds super hopeful/enthusiastic, kinda like if talking to a friend about something awesome.
The French one sounded way more formal, a bit like something you'd find in a TV documentary.
That being said, I'm sure the tech will eventually improve, and it's already awesome!
That’s an interesting insight!! I will say I don’t think that’ll be true for very long. I don’t think it will actually be that huge of a challenge ultimately either because of how AI training data is and will increasingly become collected
As a German, I can confirm. It sounds like a native German speaker, but the accentuations are weird. When I first thought she was speaking real German, I blamed it on her being no native speaker, but she had NO accent at all.
So true. There is so much more information contained in *_how_* someone speaks, and it differs from language to language.
i thought she was gonna say "you dont really know how deep the ocean is " fr
Douglas Adams' "Babel Fish" is but a moment away from reality
"If we get this right..." she says.
She has tremendous faith that this is not Pandora's Box.
Oh wait, that box was busted open years ago. 😂
As a guy who speaks 6 languages by learning them the old traditional way, this feels like a megacheat 😂😂😂😂
I'm pretty sure actually knowing the language is still way powerful though 😂
it's the difference between owning the tool VS. having the tool be your actual brain
I'm learning 6 languages, two of which i speak fluently. I hope to get there one day too.
Her Hindi so accurately hilarious and funny but elegant at the same time 😭🤌🏻✨
The instantaneous translation devices from sci-fi will be real one day. We will have headphones and glasses that will replace the audio and mouth movements in real time and we will be able to talk to anyone.
I work as a translator and interpreter. Tbh, I am fine with AI taking my job away. I think the benefits outweigh the consequences. Being able to communicate across cultures and countries is a net positive for humankind.
In the meantime, I will also learn farming. lol
The hindi is so perfect that it has better quality than Hollywood dubbed movies , really !
Emotions are missing.
not at all. she is identifying as male in Hindi lol
@@FireandIce-eh7mxBro, that's a minor error, imagine how good AI will get in the next 3-4 years?
@@ReligioCritic it's already good but not everyone uses it properly. See modi ji song covers. Some are too good they sound like real while others are less trained model feels like 🤖. Btw loved your video of bhudhist caste system
@@ReligioCritic me tumhe 1saal se janta hu bhai. Tum jee de rahe ho kya subscription se lag rha h
"Meanwhile, the poor Babel fish, by effectively removing all barriers to communication between different races and cultures, has caused more and bloodier wars than anything else in the history of creation."
It even got her french body language
Wow ! I am an Indian but I can’t speak Hindi so this is the upgrade I have being looking for 😂
Never gonna be able to do dying languages like hawaiian tho 😓
Wow it would be useful tool for south indian for sure. No more hindi vs tamil debate 😅
@@sharmisthatralalalaNo it would be better for North to understand Southern Indian languages come out of superiority complex 😑
Stop it. Koi India ka naam lele yaa usse kuch related aur tum chutiye uska comment section bhar dete ho.
Gora validation se Chen nhi bharta kya?
I'm learning German and it was so exciting when I realised I could understand what you said just by listening
That's cool! How convincing was it?
@@ChemEDanit was a surprisingly good translation, although the melody of the sentence was off. It stressed the wrong word and it somewhat changed the implication of the sentence. But that level of language translation is so complicated and I highly doubt AI will be able to do that in the near future. You'd probably have to be a native german speaker to get these fine differences.
@@ChemEDan It was super convincing! The intonation was a little weird, because it sounded like she asked questions, but just slightly. Otherwise it was flawless! Greetings from Germany 😊
Wow, das ist ein toller Erfolg! Viel Vergnügen weiterhin beim Lernen 😊
The french voice sounds like the airline announcements speaker lady on the flight intercoms
Who's here to study this from the World Scholar's Cup syllabus???
Yeeeeee
Can’t wait until the day it offers the option to do the same language but different accents
OMG YESSS i want to hear my voice in a Scottish accent!!
Imagine this in zoom for instance, I’d be talking to a Russian who can’t speak a word of English, but he will see me speaking perfect Russian, while I’m seeing him speak in perfect English. We’re probably gonna see this technology develop into real-time translation in the next few years. Exciting!
That's some blackmirror stuff
But, then, why the need to learn a language?
So sad.
@@TedEhioghae To connect the whole world together with zero barriers? Sign me up
@@drip3889 It's sad.
And the A.I decides what the correct translation is - or it maybe decides to translate something completely different and both persons are each just having a conversation with the A.I., which then can decide whether it wants the people to be peaceful or having war. Regulatories cannot beat that.
What the fuuuuu... I have a hindi poetry channel and was literally stunned for a second the moment you started speaking Hindi.
Too good mate, too good!
That's .... That's Star Trek's Universal Translator.... Holy wow O.O Not all of it, certainly, but a gigantic step closer
As a native German i can say the German was on Point.
Not really. The stressing in the first sentence was kind of awkward. I would stress „jetzt“ (now) or „vielleicht“ (maybe) instead of „ich“ (I).
And the second sentence is that as a whole, it sounds like you are affirming another person who just told you they don’t speak German that you don’t as well. Instead of that German is a language you can’t speak among others.
For my ears pulling „Deutsch“ to the front and negating the verb instead for „Deutsch, spreche ich auch nicht“ would sound better.
@@salepienI'm doubtful that it will ever get these nuances right but then again the pronunciation is pretty good. It sounds a little soft compared to how most of us speak (an artefact of her accent I guess) but really impressive nonetheless
Also die Aussprache war schon super
@@salepienja der Satzbau war etwas ungewöhnlich aber nicht falsch
@@athmaidyes the gramatik was a little of but it defenetly wasnt softer or harsher then normal German
Not only does the Hindi sound convincing, the mouth movements are perfect!
I’ve thought about how easy it would be for AI to con others.. now we are making avenues
My native language is spanish and I've been learning english since 2015 by myself. I made a lot of progress and I enjoy a lot your channel. The part when you were speaking sound absolutely natural! That's a little bit scary and impressive!
The dubbing industry 💀
holy shit, you're right
RIP
I never liked them anyway. Look at computer science taking everyones job.
I mean for art i think dubbing is still way better, this seems more for things like documentaries, educational videos, etc.
You actually became a man for a second while speaking hindi... Love ❤️ from 🇮🇳... Watch all you videos.
😂😂
the way ypu pronunce "extraordinario" sounds weird but also sounds like those actors that pretend to know how to speak spanish in an specific scene but it sounds bad
I cant wait for AR and this to get light weight enough to the point we could have this in real time in face to face convos.
It could be really useful for language learners too, being able to switch what you normally watch into the language you're trying to learn