CodeEmporium
CodeEmporium
  • 343
  • 7 312 346
Informer embeddings - EXPLAINED!
How do embeddings work in the time series informer architecture?
ABOUT ME
⭕ Subscribe: czcams.com/users/CodeEmporium
📚 Medium Blog: medium.com/@dataemporium
💻 Github: github.com/ajhalthor
👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/
RESOURCES
[1] Main repo: github.com/zhouhaoyi/Informer2020/blob/main/models/attn.py
[2] Code for the colab notebook: github.com/ajhalthor/Informer/tree/main
PLAYLISTS FROM MY CHANNEL
⭕ Deep Learning 101: czcams.com/play/PLTl9hO2Oobd_NwyY_PeSYrYfsvHZnHGPU.html
⭕ Natural Language Processing 101: czcams.com/play/PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE.html
⭕ Reinforcement Learning 101: czcams.com/play/PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha.html&si=AuThDZJwG19cgTA8
⭕ Transformers from Scratch: czcams.com/play/PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4.html
⭕ ChatGPT Playlist: czcams.com/play/PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ.html
MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: imp.i384100.net/MathML
📕 Calculus: imp.i384100.net/Calculus
📕 Statistics for Data Science: imp.i384100.net/AdvancedStatistics
📕 Bayesian Statistics: imp.i384100.net/BayesianStatistics
📕 Linear Algebra: imp.i384100.net/LinearAlgebra
📕 Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
📕 Python for Everybody: imp.i384100.net/python
📕 MLOps Course: imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): imp.i384100.net/NLP
📕 Machine Learning in Production: imp.i384100.net/MLProduction
📕 Data Science Specialization: imp.i384100.net/DataScience
📕 Tensorflow: imp.i384100.net/Tensorflow
zhlédnutí: 682

Video

Informer distillation - EXPLAINED!25:05Informer distillation - EXPLAINED!
Informer distillation - EXPLAINED!
zhlédnutí 677Před 14 dny
Let's talk about the distillation process in the time series architecture (informer) ABOUT ME ⭕ Subscribe: czcams.com/users/CodeEmporium 📚 Medium Blog: medium.com/@dataemporium 💻 Github: github.com/ajhalthor 👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1] Main repo: github.com/zhouhaoyi/Informer2020/blob/main/models/attn.py [2] Code for the colab notebook: github.com/ajhalt...
Informer attention code - FROM SCRATCH!36:06Informer attention code - FROM SCRATCH!
Informer attention code - FROM SCRATCH!
zhlédnutí 1KPřed měsícem
In this video, we code the prob sparse attention and compare it to time series attention ABOUT ME ⭕ Subscribe: czcams.com/users/CodeEmporium 📚 Medium Blog: medium.com/@dataemporium 💻 Github: github.com/ajhalthor 👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1] Main repo: github.com/zhouhaoyi/Informer2020/blob/main/models/attn.py [2] Code for the colab notebook: github.com/aj...
Informer attention Architecture - FROM SCRATCH!19:23Informer attention Architecture - FROM SCRATCH!
Informer attention Architecture - FROM SCRATCH!
zhlédnutí 2KPřed měsícem
Here is the architecture of probsparse attention for time series transformers. ABOUT ME ⭕ Subscribe: czcams.com/users/CodeEmporium 📚 Medium Blog: medium.com/@dataemporium 💻 Github: github.com/ajhalthor 👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1] Main paper that introduced the Informer: arxiv.org/pdf/2012.07436 PLAYLISTS FROM MY CHANNEL ⭕ Deep Learning 101: czcams.com/pl...
Informer: Time series Transformer - EXPLAINED!15:17Informer: Time series Transformer - EXPLAINED!
Informer: Time series Transformer - EXPLAINED!
zhlédnutí 5KPřed měsícem
Let's talk about a time series transformer: Informer. ABOUT ME ⭕ Subscribe: czcams.com/users/CodeEmporium 📚 Medium Blog: medium.com/@dataemporium 💻 Github: github.com/ajhalthor 👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1] Main paper that introduced the Informer: arxiv.org/pdf/2012.07436 PLAYLISTS FROM MY CHANNEL ⭕ Deep Learning 101: czcams.com/play/PLTl9hO2Oobd_NwyY_PeSY...
Hyper parameters - EXPLAINED!16:32Hyper parameters - EXPLAINED!
Hyper parameters - EXPLAINED!
zhlédnutí 1,6KPřed 3 měsíci
Let's talk about hyper parameters and how they are used in neural networks and deep learning! ABOUT ME ⭕ Subscribe: czcams.com/users/CodeEmporium 📚 Medium Blog: medium.com/@dataemporium 💻 Github: github.com/ajhalthor 👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1] Code for Deep Learning 101 playlist: github.com/ajhalthor/deep-learning-101 PLAYLISTS FROM MY CHANNEL ⭕ Deep Le...
How much training data does a neural network need?15:54How much training data does a neural network need?
How much training data does a neural network need?
zhlédnutí 2,6KPřed 3 měsíci
Let's answer the question: "how much training data does a neural network need"? ABOUT ME ⭕ Subscribe: czcams.com/users/CodeEmporium 📚 Medium Blog: medium.com/@dataemporium 💻 Github: github.com/ajhalthor 👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1] Code for Deep Learning 101 playlist: github.com/ajhalthor/deep-learning-101 PLAYLISTS FROM MY CHANNEL ⭕ Deep Learning 101: cz...
NLP with Neural Networks | ngram to LLMs13:21NLP with Neural Networks | ngram to LLMs
NLP with Neural Networks | ngram to LLMs
zhlédnutí 2,5KPřed 4 měsíci
Let's talk about NLP with neural networks and highlight ngrams to Large Language Models (LLMs) ABOUT ME ⭕ Subscribe: czcams.com/users/CodeEmporium 📚 Medium Blog: medium.com/@dataemporium 💻 Github: github.com/ajhalthor 👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1] Code for this video: github.com/ajhalthor/deep-learning-101/blob/main/embeddings.ipynb PLAYLISTS FROM MY CHANN...
Transfer Learning - EXPLAINED!16:22Transfer Learning - EXPLAINED!
Transfer Learning - EXPLAINED!
zhlédnutí 3,8KPřed 4 měsíci
Let's talk about a neural network concept called transfer learning. We use this in BERT, GPT and the large language models today. ABOUT ME ⭕ Subscribe: czcams.com/users/CodeEmporium 📚 Medium Blog: medium.com/@dataemporium 💻 Github: github.com/ajhalthor 👔 LinkedIn: www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1] Code for this video: github.com/huggingface/notebooks/blob/main/examples/qu...
Embeddings - EXPLAINED!12:58Embeddings - EXPLAINED!
Embeddings - EXPLAINED!
zhlédnutí 6KPřed 5 měsíci
Embeddings - EXPLAINED!
Batch Normalization in neural networks - EXPLAINED!17:00Batch Normalization in neural networks - EXPLAINED!
Batch Normalization in neural networks - EXPLAINED!
zhlédnutí 3,1KPřed 5 měsíci
Batch Normalization in neural networks - EXPLAINED!
Loss functions in Neural Networks - EXPLAINED!8:14Loss functions in Neural Networks - EXPLAINED!
Loss functions in Neural Networks - EXPLAINED!
zhlédnutí 7KPřed 5 měsíci
Loss functions in Neural Networks - EXPLAINED!
Optimizers in Neural Networks - EXPLAINED!10:19Optimizers in Neural Networks - EXPLAINED!
Optimizers in Neural Networks - EXPLAINED!
zhlédnutí 2,6KPřed 5 měsíci
Optimizers in Neural Networks - EXPLAINED!
Activation functions in neural networks12:32Activation functions in neural networks
Activation functions in neural networks
zhlédnutí 3,4KPřed 6 měsíci
Activation functions in neural networks
Backpropagation in Neural Networks - EXPLAINED!10:18Backpropagation in Neural Networks - EXPLAINED!
Backpropagation in Neural Networks - EXPLAINED!
zhlédnutí 3,5KPřed 6 měsíci
Backpropagation in Neural Networks - EXPLAINED!
Building your first Neural Network15:16Building your first Neural Network
Building your first Neural Network
zhlédnutí 4,4KPřed 6 měsíci
Building your first Neural Network
Reinforcement Learning through Human Feedback - EXPLAINED! | RLHF10:17Reinforcement Learning through Human Feedback - EXPLAINED! | RLHF
Reinforcement Learning through Human Feedback - EXPLAINED! | RLHF
zhlédnutí 14KPřed 7 měsíci
Reinforcement Learning through Human Feedback - EXPLAINED! | RLHF
Proximal Policy Optimization | ChatGPT uses this13:26Proximal Policy Optimization | ChatGPT uses this
Proximal Policy Optimization | ChatGPT uses this
zhlédnutí 13KPřed 7 měsíci
Proximal Policy Optimization | ChatGPT uses this
Deep Q-Networks Explained!10:51Deep Q-Networks Explained!
Deep Q-Networks Explained!
zhlédnutí 20KPřed 7 měsíci
Deep Q-Networks Explained!
Monte Carlo in Reinforcement Learning11:49Monte Carlo in Reinforcement Learning
Monte Carlo in Reinforcement Learning
zhlédnutí 9KPřed 7 měsíci
Monte Carlo in Reinforcement Learning
Reinforcement Learning: on-policy vs off-policy algorithms14:47Reinforcement Learning: on-policy vs off-policy algorithms
Reinforcement Learning: on-policy vs off-policy algorithms
zhlédnutí 7KPřed 8 měsíci
Reinforcement Learning: on-policy vs off-policy algorithms
Q-learning - Explained!11:54Q-learning - Explained!
Q-learning - Explained!
zhlédnutí 17KPřed 8 měsíci
Q-learning - Explained!
Foundation of Q-learning | Temporal Difference Learning explained!10:11Foundation of Q-learning | Temporal Difference Learning explained!
Foundation of Q-learning | Temporal Difference Learning explained!
zhlédnutí 13KPřed 8 měsíci
Foundation of Q-learning | Temporal Difference Learning explained!
Bellman Equation - Explained!9:05Bellman Equation - Explained!
Bellman Equation - Explained!
zhlédnutí 17KPřed 8 měsíci
Bellman Equation - Explained!
How to solve problems with Reinforcement Learning | Markov Decision Process8:04How to solve problems with Reinforcement Learning | Markov Decision Process
How to solve problems with Reinforcement Learning | Markov Decision Process
zhlédnutí 10KPřed 9 měsíci
How to solve problems with Reinforcement Learning | Markov Decision Process
Multi Armed Bandits - Reinforcement Learning Explained!10:33Multi Armed Bandits - Reinforcement Learning Explained!
Multi Armed Bandits - Reinforcement Learning Explained!
zhlédnutí 8KPřed 9 měsíci
Multi Armed Bandits - Reinforcement Learning Explained!
Elements of Reinforcement Learning13:12Elements of Reinforcement Learning
Elements of Reinforcement Learning
zhlédnutí 9KPřed 9 měsíci
Elements of Reinforcement Learning
ChatGPT: Zero to Hero49:14ChatGPT: Zero to Hero
ChatGPT: Zero to Hero
zhlédnutí 4,1KPřed 9 měsíci
ChatGPT: Zero to Hero
[ 100k Special ] Transformers: Zero to Hero3:34:41[ 100k Special ] Transformers: Zero to Hero
[ 100k Special ] Transformers: Zero to Hero
zhlédnutí 41KPřed 9 měsíci
[ 100k Special ] Transformers: Zero to Hero
20 papers to master Language modeling?13:3420 papers to master Language modeling?
20 papers to master Language modeling?
zhlédnutí 8KPřed 10 měsíci
20 papers to master Language modeling?