Computer Vision with Hüseyin Özdemir
Computer Vision with Hüseyin Özdemir
  • 77
  • 96 850
Self-Attention
This video describes details of Scaled Dot-Product Attention, specific Self-Attention version used inside transformer architecture
In this video, animations and images except the ones taken from reference papers belong to me
References
Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit,
Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
arxiv.org/abs/1706.03762
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn,
Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer,
Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby
arxiv.org/abs/2010.11929
#machinelearning #computervision
#deeplearning #ai #aitutorial #education
#transformer #visiontransformer #vit
#selfattention #multiheadattention
#imageprocessing #datascience
#computervisionwithhuseyinozdemir
zhlédnutí: 368

Video

Multi-Head Attention
zhlédnutí 131Před 4 měsíci
First, Self-Attention, building block of Multi-Head Attention, is defined. Then, Multi-Head Attention is described in detail Video Contents: 00:00 Self-Attention 07:55 Multi-Head Attention In this video, animations and images except the ones taken from reference papers belong to me References Attention Is All You Need Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aida...
Comparison of CNN and ViT
zhlédnutí 201Před 4 měsíci
Inductive bias is defined, CNN and ViT architectures are compared All animations and images in this video belong to me References Attention Is All You Need Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin arxiv.org/abs/1706.03762 An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy, ...
Vision Transformer
zhlédnutí 608Před 4 měsíci
After the success in NLP, transformer architecture is adapted for image recognition as Vision Transformer (ViT) Video Contents: 00:00 Introduction 02:20 Extracting Embedding Vectors 05:13 Self-Attention 12:58 Multi-Head Attention 15:46 MLP 16:28 Classification Head 17:36 Comparison of CNN and ViT In this video, animations and images except the ones taken from reference papers belong to me Refer...
Diffusion Models Explained with Math From Scratch
zhlédnutí 2,6KPřed 6 měsíci
Diffusion Model is a popular Generative AI method. Stable Diffusion and OpenAI Sora are diffusion models where diffusion takes place in latent space instead of image pixel space. Video Contents: 00:38 Sampling from a Standard Gaussian Distribution 02:30 Forward Process 04:58 Noise Addition in Single Step 06:11 Variance Schedule 07:36 Reverse Process 08:32 Derivation of Variational Lower Bound 1...
Greetings
zhlédnutí 676Před rokem
Hi, my name is Hüseyin Özdemir Welcome to my channel! This channel is about Computer Vision, Deep Learning, Machine Learning and Artificial Intelligence. In each video, ideas are described step by step in full detail. If you find the videos useful, like, subscribe, share and comment.
Supervised Learning
zhlédnutí 84Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 Video Contents: 00:00 Definition of Labeled Dataset 00:53 Supervised Learning Mechanism 03:01 Subcategories of Supervised Learning 03:44 Supervised vs. Unsupervised * Definition of Labeled Dataset * Illustration of Supervised Learning Mechanism * Subcategories of Supervised Learning * Comparison of Supervised and Unsupe...
Unsupervised Learning
zhlédnutí 71Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 Video Contents: 00:00 Illustration of Labeled and Unlabeled Datasets 01:27 Unsupervised Learning 03:05 Applications of Unsupervised Learning 04:12 Supervised vs. Unsupervised * Illustration of Labeled and Unlabeled Datasets * Unsupervised Learning * Applications of Unsupervised Learning * Comparison of Supervised and Un...
Semi-Supervised Learning
zhlédnutí 91Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 Video Contents: 00:00 Comparison of Supervised and Unsupervised Learning 01:08 Semi-Supervised Learning 01:45 Self-Training, a Semi-Supervised Learning example * Comparison of Supervised and Unsupervised Learning * Semi-Supervised Learning * Self-Training, a Semi-Supervised Learning example All images and animations in ...
Self-Training
zhlédnutí 312Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 In this video, Self-Training, a Semi-Supervised Learning method is described in detail All images and animations in this video belong to me #machinelearning #computervision #deeplearning #ai #aitutorial #education #semisupervisedlearning #unlabeleddata #pseudolabel #selftraining #labeleddata #imageprocessing #datascienc...
Self-Supervised Learning
zhlédnutí 152Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 Video Contents: 00:00 Comparison of Supervised and Unsupervised Learning 01:09 Self-Supervised Learning 01:50 Self-Supervised Learning example with Autoencoder 04:16 Pretext and Downstream Tasks 06:32 Different Types of Pretext Tasks * Comparison of Supervised and Unsupervised Learning considering input data * Self-Supe...
Autoencoder
zhlédnutí 63Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 Video Contents: 00:00 What is Autoencoder? 00:51 Parts of Autoencoder 02:37 Information about Dataset 03:43 Network & Training 05:59 Dimensionality Reduction 07:00 Self-Supervised Learning * What is Autoencoder? * Parts of Autoencoder: Encoder, Bottleneck and Decoder * Information about Dataset Used To Train Autoencoder...
Logit and Probability
zhlédnutí 171Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 Video Contents: 00:00 Case for Binary Classification 03:05 Case for Multi-Class Classification 05:41 Case for Multi-Label Classification * Case for Binary Classification * Case for Multi-Class Classification * Case for Multi-Label Classification All images and animations in this video belong to me #machinelearning #comp...
Binary Classification
zhlédnutí 133Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 Video Contents: 00:00 Definition of Binary Classification 00:50 Binary Classification example 01:24 Binary Classification is a Supervised Learning Method 02:11 About Training & Inference Phases 03:44 Output Layer for Binary Classification 04:50 Sigmoid Activation * Definition of Binary Classification * Binary Classifica...
Multi-Class Classification
zhlédnutí 117Před rokem
Subscribe To My Channel www.youtube.com/@huseyin_ozdemir?sub_confirmation=1 Video Contents: 00:00 Definition of Multi-Class Classification 00:51 Multi-Class Classification example 01:26 Multi-Class Classification is a Supervised Learning Method 02:20 About Training & Inference Phases 03:48 Output Layer for Multi-Class Classification 04:40 Softmax Activation * Definition of Multi-Class Classific...
Multi-Label Classification
zhlédnutí 617Před rokem
Multi-Label Classification
Multi-Class vs. Multi-Label Classification
zhlédnutí 653Před rokem
Multi-Class vs. Multi-Label Classification
Loss Function
zhlédnutí 61Před rokem
Loss Function
Cost Function
zhlédnutí 54Před rokem
Cost Function
Binary Cross-Entropy Loss
zhlédnutí 407Před rokem
Binary Cross-Entropy Loss
Categorical Cross-Entropy Loss
zhlédnutí 286Před rokem
Categorical Cross-Entropy Loss
Linear Transformation
zhlédnutí 1,5KPřed rokem
Linear Transformation
Affine Transformation
zhlédnutí 8KPřed rokem
Affine Transformation
Projective Transformation
zhlédnutí 13KPřed rokem
Projective Transformation
Homogeneous Coordinates
zhlédnutí 4KPřed rokem
Homogeneous Coordinates
Rigid Transformation
zhlédnutí 640Před rokem
Rigid Transformation
Similarity Transformation
zhlédnutí 1,5KPřed rokem
Similarity Transformation
Forward and Backward Image Warping
zhlédnutí 4,8KPřed rokem
Forward and Backward Image Warping
Splatting
zhlédnutí 948Před rokem
Splatting
Image Rotation
zhlédnutí 683Před rokem
Image Rotation