Activation Functions - Deep Learning Dictionary

What are activation functions within artificial neural networks?
👉 To gain early access to the full Deep Learning Dictionary course, register at:
🔗 deeplizard.com/course/ddcpailzrd
👉 For more in depth lessons, check out the Deep Learning Fundamentals course:
🔗 deeplizard.com/course/dlcpailzrd
🕒🦎 VIDEO SECTIONS 🦎🕒
00:00 Welcome to DEEPLIZARD - Go to deeplizard.com for learning resources
00:10 Activation Functions
04:50 Collective Intelligence and the DEEPLIZARD HIVEMIND
💥🦎 DEEPLIZARD COMMUNITY RESOURCES 🦎💥
👋 Hey, we're Chris and Mandy, the creators of deeplizard!
👉 Check out the website for more learning material:
🔗 deeplizard.com
💻 ENROLL TO GET DOWNLOAD ACCESS TO CODE FILES
🔗 deeplizard.com/resources
🧠 Support collective intelligence, join the deeplizard hivemind:
🔗 deeplizard.com/hivemind
🧠 Use code DEEPLIZARD at checkout to receive 15% off your first Neurohacker order
👉 Use your receipt from Neurohacker to get a discount on deeplizard courses
🔗 neurohacker.com/shop?rfsn=648...
👀 CHECK OUT OUR VLOG:
🔗 / deeplizardvlog
❤️🦎 Special thanks to the following polymaths of the deeplizard hivemind:
Tammy
Mano Prime
Ling Li
🚀 Boost collective intelligence by sharing this video on social media!
👀 Follow deeplizard:
Our vlog: / deeplizardvlog
Facebook: / deeplizard
Instagram: / deeplizard
Twitter: / deeplizard
Patreon: / deeplizard
CZcams: / deeplizard
🎓 Deep Learning with deeplizard:
Deep Learning Dictionary - deeplizard.com/course/ddcpailzrd
Deep Learning Fundamentals - deeplizard.com/course/dlcpailzrd
Learn TensorFlow - deeplizard.com/course/tfcpailzrd
Learn PyTorch - deeplizard.com/course/ptcpailzrd
Natural Language Processing - deeplizard.com/course/txtcpai...
Reinforcement Learning - deeplizard.com/course/rlcpailzrd
Generative Adversarial Networks - deeplizard.com/course/gacpailzrd
🎓 Other Courses:
DL Fundamentals Classic - deeplizard.com/learn/video/gZ...
Deep Learning Deployment - deeplizard.com/learn/video/SI...
Data Science - deeplizard.com/learn/video/d1...
Trading - deeplizard.com/learn/video/Zp...
🛒 Check out products deeplizard recommends on Amazon:
🔗 amazon.com/shop/deeplizard
🎵 deeplizard uses music by Kevin MacLeod
🔗 / @incompetech_kmac
❤️ Please use the knowledge gained from deeplizard content for good, not evil.

[@deeplizard]

💡 Unlock early access to the full Deep Learning Dictionary course at once by registering at:
deeplizard.com/course/ddcpailzrd
💡 For more in depth lessons, check out the Deep Learning Fundamentals - Premium Edition course:
deeplizard.com/course/dlcpailzrd

[@slycer10]

Popular AF - What else would it mean? 😄😄
Great videos. Really easy to understand. 👌🏼👍🏼

[@Mutual_Information]

The transition from sigmoid to relu made all the difference in the early 2010s.. for certain large nets, it was the difference between successful and failing training. In retrospect it makes sense. The sigmoid can easily make the gradient zero for a huge portion of the input domain . Relu doesn’t have that same level of a saturation problem.

[@giovanniguerreiro8640]

Very informative!

[@berlincmos]

you are great 👏🌹

[@emmanuelkoupoh7979]

Thank you for your content.
will you make a video related to diffusion models soon?

[@deeplizard]

Thanks for the suggestion, we may cover this topic in the future!

[@valentinleguizamon9957]

😮😮😮

[@Age_of_Apocalypse]

Please, no comparison - loose or otherwise - with the human brain; there is ABSOLUTELY no comparison between a brain, a computer or neural networks. I have watched videos from neuroscientists and it's what they said. 🤔

[@deeplizard]

The terminology in the field of deep learning is often motivated by the structure or function of the brain. For example, terms like _neural network, neurons, neuron activation, learning, etc._ While the brain may act as motivation for these DL terms and help to shed intuitive insights, this doesn’t mean that these artificial neural networks or network components technically operate in the same way as the brain.

[@leanwolf6667]

Never trust anyone who speaks in absolutes. Most things exist on a spectrum and are subject to variation. Also, do not let the title "neuroscientist", or any other title for that matter, mesmerize you. Keep an open mind.

[@adamblack2255]

@@leanwolf6667 That sounds like a pretty absolute rule ;O

[@Age_of_Apocalypse]

@@leanwolf6667 Ignorance talking = YOU! There is absolutely no comparison between how a human brain works and how a computer works, if I can't trust a neuroscientist, who the hell can I trust?
Please stop making that absurd comparison! Next, people will compare peoples with cars because both can go from point a to point b. 🤦‍♂️

[@Age_of_Apocalypse]

@@adamblack2255 🤣 You got that right!