A Very Simple Transformer Encoder for Protein Classification in PyTorch

The purpose of this video is apply previously explored transformer encoder approaches to protein language learning and large multiclass classification problems using the protein family (PFam) dataset.
Code Repo:
github.com/BrandenKeck/pytorc...
Attention Is All You Need:
arxiv.org/pdf/1706.03762.pdf
Music Credits:
Eternal Springtime by | e s c p | www.escp.space
escp-music.bandcamp.com
Gate by KV | / kvmusicprod
Music promoted by www.free-stock-music.com
Creative Commons / Attribution 4.0 International (CC BY 4.0)
creativecommons.org/licenses/...
Winter Morning by Purrple Cat | purrplecat.com
Music promoted by www.free-stock-music.com
Creative Commons / Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0)
creativecommons.org/licenses/...
East Side Manhattan by Popoi | / popoimusic
Music promoted by www.free-stock-music.com
Creative Commons / Attribution 3.0 Unported License (CC BY 3.0)
creativecommons.org/licenses/...
the art of self-care by foxxy mulderr | www.foxxymulderr.com
Music promoted by www.free-stock-music.com
Creative Commons / Attribution 4.0 International (CC BY 4.0)
creativecommons.org/licenses/...

[@hackerborabora7212]

Pls put more videos you are awesome ❤❤❤ good luck 🙏🏻

[@lets_learn_transformers]

Thank you!