How to Make a Language Translator - Intro to Deep Learning #11
Vložit
- čas přidán 11. 09. 2024
- Let's build our own language translator using Tensorflow! We'll go over several translation methods and talk about how Google Translate is able to achieve state of the art performance.
Code for this video:
github.com/llS...
Ryan's Winning Code:
github.com/rtl...
Sarah's Runner-up Code:
github.com/sco...
More Learning Resources:
/ machine-learning-is-fu...
www.tensorflow...
devblogs.nvidi...
• A Practical Guide to N...
neural-monkey.r...
blog.systransof...
www.wildml.com/...
blog.altoros.c...
www.quora.com/...
blog.heuritech...
smerity.com/ar...
Please Subscribe! And like. And comment. That's what keeps me going.
Join us in the Wizards Slack channel:
wizards.herokua...
And please support me on Patreon:
www.patreon.co...
Credits to Biggi Hilmars for the intro tune
Follow me:
Twitter: / sirajraval
Facebook: / sirajology Instagram: / sirajraval
Signup for my newsletter for exciting updates in the field of AI:
goo.gl/FZzJ5w
Hit the Join button above to sign up to become a member of my channel for access to exclusive content! Join my AI community: chatgptschool.io/ Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available):
www.wagergpt.co
*I like the design of the **Bestt.Digital** translator , and charging case. It is little bit heavy. The application is easy to use, but there are things to be improved. For example, I knew the earbud are connected to the phone, but I didn’t know I need to reconfirm it again, so I would be able to use “Speaker mode” . I took sometime to find it though.*
I really appreciate that you're a professional who's willing to share his expertise, even though I'm not interested in this subject. Unfortunately when senior Chemical engineers retire, they leave the plant they worked at and their 30+yrs knowledge goes with them. They fix problems that appear in the plant with properly logging the events, but only in their minds. So when they retire all the professional knowledge is lost.
What you are doing here is really special, thank you.
dam, that's exactly what i was thinking...
Memory ain't enough, Pay attention.....
I like it very much. Thanks Siraj for this wonderful video.
By the way, Marian Rejewski was the first polish mathematician who broke Enigma machine in 1932, before WorldWar 2 and before Alan Turing.
Thank you, Siraj. This probably isn't because of me but I requested this topic in the last videos comments and to my surprise this is the next topic. I'm very happy to see this video.
Awesome, thanks Anon!
@@SirajRaval would you help me where can I find Indian languages data sets ?
Love your vids! And the rap parts are awesome! Thank you for showing us how easy is ML. For me as an statistician it's a pleasure to see what you create each week!
thanks Rafael!
your explanation speed is way much better ! Thank you !
thanks Jeff
Hey Siraj could you please make a video on NMT (Neural machine translation), which is one of the advanced machine translation methods.
I wonder how this would work with a language that is made up.
I see, so you need to add a script element with path to js file to html to make hello world. That makes a lot of sense, thanks.
awesome! looking forward to your incorporation of the context, a very important factor. for example,
In English, "You aren't a student, are you?" (if you are) "Yes."
In Chinese, "You aren't a student, are you?" (if you are) "No."
not just the whole article, if you are translating a movie, i think people would be interested in knowing how to label everything and teach the machine to learn them.
looking forward to that
character actions in movies can change the translation, you know.
great points thanks Oliver
I was sent by Daniel Shiffmann (actualy by you on his channel) and You are amazing!
Good to know that google translate can be trusted tomorrow, I'm going to translate sentences to Italian because there's a girl in my 6th hour that doesn't speak English and I want to talk to her hope it goes well 🤞🏻
Jenna Lynn hi How are you?? Can we become friends??
Hi Siraj, you create LIT content! I love it. Keep up the good work. I'm learning so much to hopefully impress my interviewers at Google. :)
thanks Abasifreke!
Great work, love your channel! It's all starting to make sense but still wouldn't be able to write a model for a new problem yet. Also love the rapping, really cool ;)
thanks Max!
[2:28] coding begins
[7:35] execution statements and responses
Wilson Mar thanks
greetings from Kuwait! I'm intrested in translation field in general and this video helped alot! thank you very much for sharing this well-executed video. subscribed
thank you for another tensorflow video
Quality of the video is awesome!
thanks Sethu! Good to see you :)
Can you do a video on a hardware solution? With an arduino, raspberry pi or something like that. Your vids are great, thanks for uploading!
you mean running like running neural networks in a mini pc ?
Diego Antonio Rosario Palomino could be anything really I'd be interested in what he could come up with. Hopefully the use of sensors or motors.
Example ! i want to make a rc car controlled by a neural network , if that kind of computing is lite enough i will be running it in a mini pc mounted on the vehicle
First result on a web search: wroscoe.github.io/keras-lane-following-autopilot.html
Example ! agreed
WOW!!! TensorFlow works for sign languages as well !!! How ?!! Please, show us !!!
Thank you for your great VDO. I'm learning from you. :)
I am not in this level of education...but i was plotting on making a deep learning ai system you can carry on with mic for listening and small form monitor you can carry on and it translates in real time words spoken in any language. Again, i know nothing about this stuff but it seems like its well on its way...reguardless....if the system is made maybe it can be incorporated into a dfesign like the idea i got....maybe the lack of knolege comes from the lack of having that type of hardware...i love learning things
Hello Siraj, its World :-p "Great videos, thanks... "The way you teach/share knowledge is way different from anyone. Your excitement makes vids interesting :-p Though Some of the topics needs more details .
Your codes don't usually work as shown, however videos are encouraging.
can you please tell me what is a cross-lingual translator ?
Hi Siraj,
I am new to machine learning. I have seen bunch of your videos which are very good and interesting. I have one question, from where do I start as a beginner. Should I continue directly from deep learning or clear some my basics first. I have experience in python so that will not be a problem.
Hi Siraj, could you please do a video on bounding box detection? I really like your videos, thanks for all the effort you put into making them
puta merda, esse é meu novo canal preferido no youtube. [pt-br ;)]
meu também!
legal!
Siraj you should get a professional mic with a filter! It will put your videos to a whole another level ;)
I am getting below error when running this. Siraj could you please help."Valueerror: Variable proj_w already exists, disallowed. Did you mean to set reuse = True or reuse =AUTO_REUSE in VarScope"
Hey Sir,how can i start deep learning as i am new to this field.
woah! neat. do you ever plan on doing any videos/tutorials where numpy or other ML libraries aren't used? like, just python and numpy?
hey Spark. Hmm yea, for Generative Adversarial networks which are coming up.
Just started with OpenNMT, one simple question: Once trained and deployed, does the neural network grow upon each usage? i.e. if I train OpenNMT then deploy it on a server and make it public, will the machine keep learning unsupervised when people use it?
Does the knowledge base of the machine grow?
When I run:
from tensorflow.models.rnn.translate import data_utils
I get an ImportError saying "No module named tensorflow.models"
Any help, please?
Thanks in advance.
import data_utils
replace
it
did you solved it because i am facing the same problem.. how to solve it?
I know this is an old post but anyone know the winner of this one? Please
great as always
Thanks Fred!
Can we buy this device on Amazon
Hi siraj how do you create a language software for yr country,so it can be downloaded in all devices in our era
Translation between policies and pseudo code instructions will create an enormous shift in paradigm in ?.
Uh, okay, at 5:03 , that Chinese sentence isn't correctly tokenized. "知識 就是 力量" would be correct.
Awesome videos!
thanks Charles!
is this machine good enough to satisfy all our deep learning stuffs
how to add attention on top of a non seq2seq lstm? i wanna do a text classification and i think attention might help (mathematically)?
Is this meant to work with a specific version of TensorFlow? I'm on 1.0.1 and it throws errors ("has no attribute 'rnn_cell'") which are apparently related to some undocumented changes between TF versions. I've also been running into other errors but have been able to figure them out -- is this part of the challenge? ;-)
yea rnn_cell was moved to contrib github.com/tensorflow/tensorflow/issues/7664 this is the hardest challenge i've given, i will honor even an attempt keep it up
Siraj
u r Great
bro is it possiple to find which is their native country based on the photos through giving collection of photo he is indian and he is britain
can any one please give me a link to how to set up the environment for tensor flow, jupyter etc/??
please guide me . . How i make portable language translator offline device with the help of arduino or pi ?
thank your awesome video, siraj.
Maintain an efficient working learning state, what keys do you think is ?
ill make a vid on this soon thanks tony
Wrooooooong! 4:19 such things made me to prefer ur videos :) :)
You are the best
thanks Jorge!
from tensorflow.models.rnn.translate import data_utils
I am getting the error that this package does not exist. How to solve this?
I have tensorflow but for data_utils, i am getting the error 'unresolved reference'
can we use machine learning to convert code from one programming language to other.
Check Transcoder by facebook
Hey! How do I resize images for my neural network?
Thankxxx siraj , u r awesome man
thanks Furqan!
What we now need is and English to English translator.
Like a dialect translator? en.wikipedia.org/wiki/List_of_dialects_of_the_English_language
American english to real english translator would be great
where do i have to put that tranlation zip file?
the language i like to speak is BOBLISH TRANSLATED (እኔ እዚህ ድረስ አግኝቻለሁ ፣ የሴት ጓደኛዎን ይሳቡ እና እርስዎም በህይወትዎ ቀሪ ሥቃይ እና ሥቃይ ሊደርስብዎት እና ሥቃይ ደርሶብዎታል)
hey can you make an episode on Latent Sentiment Analysis on score essays
to a numeric value or grade say 90% or 20% in python. There's is little
content on CZcams that fully describe Latent Sentiment Analysis ,most
of they just talk about TF-IDF,so i am looking for more really.
Siraj, pl help me with mathematics behind google translator
love it!
woot!
Can I ask a sample format for the source language or target language?
Thank you very much in advance!
I think it's one-hot encoding with one input for each word known by the network.
My requirement is to do a style translation of English language from informal to formal style. Is it correct to take this approach for my task??
This would work, but this is kind of an outdated architecture for Natural Language Processing. The new state of the art is BERT, which focuses completely on using attention and has no recurrent layers. They would both do the job but BERT would perform better, though it would be a much larger model.
@@NicheAsQuiche Thanks for your reply ❤
the rap man
Hi. did anyone know how's to create a transliteration machine learning that can solved homograph disambiguation using python?
Great video as always
Tnx for sharing!!
Would it be possible to share the weights of your videos? it would be much better to see results that way for the poor who don't use gpu:)
I am newbie here can anybody tell me how to solve error "no module named data_utils "
mr.Siraj Raval nice to meet you
my name is nandar im from indonesia
Hi, I am using this tutorial to create a webpage, where anyone can upload the document (pdf, docx) to translate the file. Can anyone help me on how to get the pdf document in python and extract the texts to translate it?
have you done any Hindi to English translator . if yes then give me the code or this same code works in it...thankyou.....reply as soon as possible brother....
thank you for using python3 this time!
Siraj, can you please show the 10,000 hours project? I like to see how I can shorten the learning process in any subject. thank love u :-) :-)
Nice Portuguese pronounciation! :)
thansk Marcio!
How can I discover a foreign language look like russian? do you tell me?
it's "prend-moi dehors", 'cos attrape is like catching a fish, but prend is take, but catching someone in a sexual way as well, so it's more appropriate to the context. ;)
Cool video Siraj! What's the music in the beginning?
in the vid desc at the bottom, thanks Oliver!
I thought I might be a clever person. I watched this video. I am not a clever person. The end.
thanks
Background music? ;)
in the vid desc at the bottom!
The reason i hate Google Translate that it always translates to English and then to the language you want
Can you make a video over Gene expression microarray data like ACGT... using DL? Thanks in Advance :)
which version of tensorflow did you used
if you use 0.12.1 it should work, but you need to downgrade to python 3.5.X
now that you mention IBM , do they still make any products ? Are they a company that just sits there sucking money out of investors ?
They're still a pretty big player in the field of AI.
Kyle Piira what have they done ? do they have s ml library like tensorflow ? , or a collection of ml obstacles like open ai ?
They offer a decent number of cloud ML apis www.ibm.com/watson/developercloud/services-catalog.html
Kyle Piira each of these services seems like personal projects someone interested in ml would have on their github , not products made by a company . In fact most are things that siraj has made videos about ( sentiment analisis , chatbots language translation ) , so people who follow this series probably have remade all of this and understood it well enough to improve upon it ( coder challange of the week )
hey Diego, yeah Watson is their biggest product right now but google is better than them in every way nowadays lol
hi siraj what laptop do you use
macbook pro 2016
Can you help for english-urdu machine translation model?
Are you researcher or translator? Would like to share insight about ML and AI?
SMT and neural machine translation are great, but they are not useful for minority languages which do not have parallel corpora (Quechua, Wolof, Chamorro...), and that's a pity.
hey man are you there. i need your help if possible?
Good
Coding challenge: github.com/Nemzy/language-translation
excellent work nemanja
Hi Siraj,
I am a computer science student recently started working on a project on machine learning. I need to make a bot to learn the game "chain reaction" that i have coded in pygame. I'm stuck on how should I implement the bot. Some help would be really appreciated!!
Thanks in advance..
read face and play songs according to the mood of that person using machine learning
A little hard to set up due to the size of the touchscreen and lack of specific instructions czcams.com/users/postUgkxNkNu8Sb6OAjgDHKMklYTaO-lJ4YPAIoS but when set up it is easy to use., I look forward to using it in travel when I am in a country where I am clueless in the language.
2:22 PASHTO ;)
You make AI meme-a-licious! :P
thanks Frank!
Using Ghibli on your thumbnail is playing dirty, how could I not click.
haha
I came to this video to figure out how to make a translator that could translate sentences from a document into a created fictional language... Wellpppp.... That didn't work out.... Haha.
2:27 samoan uwu
Hey Siraj, I am looking for answers to some questions. may I have your email id? or should I ask here?
? can you make video for face recognition
coming soon