What are GANs (Generative Adversarial Networks)?
Vložit
- čas přidán 28. 06. 2024
- Learn more about watsonx: ibm.biz/BdvxDJ
Generative Adversarial Networks (GANs) pit two different deep learning models against each other in a game. In this lightboard video, Martin Keen with IBM, explains how this competition between the generator and discriminator can be utilized to both create and detect how you can benefit from the competition.
#GAN #GenerativeAdversarialNetworks #AI #watsonX - Věda a technologie
I like the way he smiles and the calm talking
Wow, this is the first time I really understand the concept of GAN. Well explained. Loved it
He clearly loves his job and its communicative ^^
loved it. simple enough to be understood yet complex enough to get the important details
This was excellent. Came across gans a while back but some of the explanations i got were deeply technically complicated so I couldn't quite understand them properly but this was very precise yet relatively concise for the amount of information it conveyed. Well done. I'll look for more from you!
Just one sentence: The easiest yet more powerful explanation of GAN!
this was so easy to understand and interesting, thank you!
Thank you, IBM, for these videos!!
Just loved his attitude and way of explaining the concepts.. 😊😊😊
Really perfect explanation of GAN, well done!!
Excellent, clear, to the point in introducing GAN.
Superbly explained. Thank you
You made it so easy to understand. Thank you!
How is he writing with his left hand, from right to left and mirrored so that i can understand.🧐 Or is this just his secret talent.
If you want to find out we shared some backstage "secrets" on our Community page, you can check it out here 👉 ibm.co/3pT41d5
Elementary my dear Deyon nice one.
He's writing it normally in front of himself and then they have mirrored the video, so we see what he actually saw when they made the video.
😆
Is a fake 😱🤣
kudos for the clear explanation + writing all those diagrams backwards :]
Very pedagogical setup, loved it!
oh i like his voice so much, he teach very very easy to aproach
Love this explanation!
this is what you call a clear explanation, thanks
Glad it helped!
elegant explanation .....great job
Excellent Explanation!
Very well explained😇, thank you.
It is really helpful, thanks for your video
Very Informative video.Thanks for making it.
Very well explained. Thanks for sharing
Thank you very much... It was so intresting way of teaching this network
Thank you, It is informative
Very nice explanation! Thanks sir
I absolutely love this topic. The advances in human medicine could be incredible with this. A sample "input" from a bio organism...and then a model "of you're target cell types"...and then prediction on outcomes...and then further samples of "feedback agent" and then training you're human cell model. Then we introduce the GAN and think about our models accuracy. The future state possibilities of identifying interactions "trainings" with various drugs etc. This type of interaction could lead to identifying bio organisms not just humans and potential outcomes of interactions with them. Extrapolate that with humans and food allergies, diseases etc. It's mind boggling. When he is talking about CNN's and the use of alternate examples with Discriminators and Generators with Encryption my mind exploded. You could, hypothesize a Hedy Lamar like frequency agility but apply that to encryption and use an encryption agile chain. Good lord, super computationally expensive but man that would be nearly unusable from theft point of view. Would take you forever to crack that..as all the data could change from one form to another over time of transmission.
damn
Good explanations. Thanks.
Amazing explanation
I loved the way he said in the end - "turn a young, impressionable, and unchanged generator to a master of forgery".🦊🦊
Dam.... thanks for sharing it so clearly !!!
Great video, perfect presentation. Was this artificially generated?
Excellent video
good explanation
Simply Loved it
It‘s helpful. Finally know what GANs are, appreciate it.
Thank you..!
How far are we from networks that generate networks, I wonder.
Like a network that tries to produce the most efficient neural network structure to achieve a good enough result in the shortest amount of time (or cloud resources) in a given use case. Or it's more efficient to just use genetic algorithms?
thank you ,it's great ...!
Well explained.
Super- thank you :)
Appreciate the effort put into generating such great content.
BTW I don't quite understand how generator and discriminator concept can be applied to :
predicting the next video frame OR
creating higher resolution image
These were discussed in the video at 07:15
It can be used as a discriminator. As we can feed some part of the video and ask him what the person is going to do next? if the prediction is correct then feed more hard questions otherwise discriminator has to improve its weight.
I loved the lesson.But GANs more :)
Loved it😅
well explained sir! but i don't get the application of GANs in the context of video.
Very nice video and super clear explanation. I would like to ask a question, staying on the architecture of GANs, one could believe that their results would periodically improve. If this is a possibility, are we measuring how much deep fakes improved from one year (for instance) to another? I think would be interesting to know it to understand if one day we will still be able to detect them through digital forensics algorithms.
With better and better Deepfakes generated, also the tech to detect deepfakes gets better and better.
@@Arne_Boeses But will detection technology ever be able to outpace generation technology? Based on this video is sounds like discriminator type systems are destined to lose.
Nice video
I don't think it's very nice to talk about someone else's amazing invention without mentioning their name. (Ian Goodfellow created GANs in 2014)
Well and you're not doing it better. In today's research, there are many "inventors" so saying he invented it himself is not justified. Just look at the original paper and you'll see countless researchers who worked on it to some extent. The concepts are what matters.
For the image upscale problem, would we still feed the generator random noise or will we give it the lower res image?
Thank you very much for this video it was very helpful and comprehensive. ☺
I have two questions regarding the image generation. Maybe you can help me:)
1.Taking your example of generating a picture of a flower; does the generator have any kind of "knowledge" of how a flower roughly looks in the beginning? Or does it randomly give a pattern of pixels to the discriminator and learns by the rejection it gets?
2. How do GANs work in the text-to-image generators? For example, I wanted to have an image of a blue banana and my GAN gets this input as a text prompt, how would Discriminator and Generator tackle this? Would the input be relevant only to the discriminator?
Thank you!
I think I can answer to your questions
1. Yes generators learn to map random input vectors to fake flowers without any prior knowledge of how flowers generally look, however one can use a pretrained encoder from Image encoder and decoder neural network that has been trained to encode and decode flower images. This way the generator would have some prior knowledge on where to look in a given input of random vector to generate flowers thus making the convergence faster
2. In GANs just like how we pass on random input vector, while converting text to images, one can make use of an encoder network to map the input text into embeddings (something that's called word embeddings in the NLP domain). Now these embeddings can be passed to GANs inplace of the random input vector. But in this case the descriminator has to have knowledge to perform multi-class classification, as text-to-images might involve generating multiple objects/entities unlike in GANs alone where we try to generate only one particular entity like flowers, or faces or cats etc
excellent
Great
Great video, very well done, thank you. I can see it can generate amazing imagery etc.. Allow me to ask a dumb question. What is the point of GANS? How does it enhance learning, for example? I just don't get 'the point'.
Have you found your answer yet?
if we are giving the discriminator a domain for learning shapes of flower isnt is supervised learning how it is unsupervised since we are providing a domain to learn
what is the difference between a discriminator and a classifier? or are these synonyms. reason i am asking is: classifiers are sometimes mentioned when it comes to detection of generated content. but, if a discriminator in the endstages of many iterations is basically no better than guessing it does not seem a viable solution for this problem
Can I use GANs to generate a lot of Fake defects images of a product and use to train a 1st model?
you use right hand?
I want to generate images through GAN from MIAS dataset. Which GAN architecture is most suitable?
can someone tell me wht the core idea behind DDQN and GAN is same
Are we just going to ignore the fact that he's writing backwards??? That thing is skill man
Relax, he would have flipped the video left to right so that you don't see the text backwards.
I literally spent the entire video not listening to him and asking myself what wizardry he uses to write mirrored.
he wrote with his right hand then mirrored the video
Nice
if this is unsupervised, how does the discriminator "know better be able to tell where we have a fake sample coming in"?
thank you for your theory, and the flower example! #creatoreconomy
😊Nice
He is either a lefty that can write mirror image sentences from right to left in real time, or the video was post processed?
Flipped
Is this what Nvidia is using for its new frame generation technique in the RTX 40 series? I'm just guessing before checking the internet
Could somebody explain to me the difference between a GAN and Zero-Shot Learning?
I dont know if your still responding to comments, but ill give it a try!. Im currently looking at deepfakes for undergraduate project. With the GANs updating everytime they lose does this refer to the deeplearning?
First to comment .
Hey there, I am writing my bachelor thesis about how safe facial recognition authenticators will be with improving AI image creation. Would you say that GANs can oppose a risk to facial recognition authenticators?
Thank you
is this possible to make a one image into different poses, variations. Can anyone reply to this image
Yes udaya it is possible. We call this method "data augmentation". You can find a lot of techniques on internet related to this.
Gimme Ampere 100 Now! (GAN)
Just for StyleGAN3, please, sir.
no, you give me 100 amperes now and also 1500 volt, madam. I will not ask twice, hand it over, or you will be shocked, by the consequences.
Noice 👍 Doice 👍 Ice 👍
Didn't most everyone else think that is not what zeromsum game meant..inthoight if there is an advantage for one player that would not be a zero sum game..
the discrimator is trained a normal way with real flower pictures? how is the generator trained to make the first flower? like how does it know to output certain data in certain size and colors etc? i understand how it can update if wrong but how is the generator actually generating?
how do you write backwards so well lol
Did DALL-E 2 use GAN?
why don't you have a link to the CNN video that he mentions?
A gan is a speedcube
I hope the host understands that he could write normally, instead of reflected, since he just needs to mirror the video in the end and everything would be correct from the viewers view.
picture is mirrored? my brain is glitching and I don't know why lol
Hey there! We shared some behind the scenes of our videos on the Community page, check it out here 👉 ibm.co/3dLyfaN 😉
@@IBMTechnology haha I knew it is exactly like that!)
Avengers need you ,pls go back....
I don't get that the discriminator should be updated if the generator succeeds. The image was 'fake' ( i would say synthesized ) and the whole point of the game beeing to teach the generator how to synthesize image that are as far as possible close to the 'real data' dataset. There is no failure per say.
It all depends on what you means by fake:
1- Fake means even if its a realistic flower but does not belong to the 'real' dataset it a fake.
2- Fake means its not a flower ,its a car , or garbage so the discriminator is unhappy of the generator's job.
You seem to define fake as per definition 1 ; in this case , you can directly compare image pixels by pixels and calculate euclidian distance for the error to backpropagate on the generator, you don't need a neural network for the discriminator , do you?
So i think the correct definition is 2. Hence the discriminator never has to learn from the generator.
>> I know you work for IBM , so its likely that i missed a point , kindly let met know 🙂
Are Generators used for creating deep fakes?
I've had a few supervisors that I'm sure were fake samples.😐
If IBM don't have money for mirror marker, send me the bank details, I'll pay for it.
How can he write upside down
superb backwards writing
No it’s a cubing company
how is he writing backwards?
He's not writing backwards. It appears as if he is. He is writing normally like you would on a board or a notebook.
Feels like talking something but didn't tell much.
He's not really left handed, you know.
what type of magis is this . he is writing backwards
See ibm.biz/write-backwards for the backstory
@@IBMTechnology omg 🤣🤦♂️
Are you really writing all of this backwards?
Search on "lightboard videos".
Yo he writing backwards
See ibm.biz/write-backwards
isn't it weird how all these glass whiteboard people are left handed. like usually about 10% of people are left handed but these guys I swear are like 90%, weird
Isn't the video mirrored horizontally? Otherwise I can't explain why we can see in the right direction what he's writing
They're right handed..it is horizontally mirrored
Good job bro, JESUS IS COMING BACK VERY SOON; WATCH AND PREPARE
Bro just kept talking and said nothing
Nice