Pride and BPE: How We Solved Tokenization but Got It Wrong

Sdílet
Vložit
  • čas přidán 7. 09. 2024

Komentáře • 8

Další v pořadí
Automatické přehrávání
Subword Tokenization: Byte Pair Encoding19:30Subword Tokenization: Byte Pair Encoding
Subword Tokenization: Byte Pair EncodingAbhishek Thakur
zhlédnutí 17K
Huffman Codes: An Information Theory Perspective29:11Huffman Codes: An Information Theory Perspective
Huffman Codes: An Information Theory PerspectiveReducible
zhlédnutí 228K
The Most Important (and Surprising) Result from Information Theory9:10The Most Important (and Surprising) Result from Information Theory
The Most Important (and Surprising) Result from Information TheoryMutual Information
zhlédnutí 89K
Throwing Swords From My Blue Cybertruck00:32Throwing Swords From My Blue Cybertruck
Throwing Swords From My Blue CybertruckMini Katana
zhlédnutí 11M
Guys help!, She won't stop🥹😂 @isabellaafro Credit: @JasminandJames 🫡 #dance #trending00:13Guys help!, She won't stop🥹😂 @isabellaafro Credit: @JasminandJames 🫡 #dance #trending
Guys help!, She won't stop🥹😂 @isabellaafro Credit: @JasminandJames 🫡 #dance #trendingJaymondy
zhlédnutí 18M
Nurse's Mission: Bringing Joy to Young Lives #shorts00:17Nurse's Mission: Bringing Joy to Young Lives #shorts
Nurse's Mission: Bringing Joy to Young Lives #shortsFabiosa Stories
zhlédnutí 15M
Ondřej Novotný - GELNÁROVÁ JE HODNÁ HOLKA, TRILOGII VYHRAJE KARLOS,PRODALI JSME 17.000 LÍSTKŮ ZA DEN1:30:59Ondřej Novotný - GELNÁROVÁ JE HODNÁ HOLKA, TRILOGII VYHRAJE KARLOS,PRODALI JSME 17.000 LÍSTKŮ ZA DEN
Ondřej Novotný - GELNÁROVÁ JE HODNÁ HOLKA, TRILOGII VYHRAJE KARLOS,PRODALI JSME 17.000 LÍSTKŮ ZA DENVláďa Kadlec - EXPERIENCE
zhlédnutí 270K
Understanding the Llama 3 Tokenizer | Llama for Developers24:50Understanding the Llama 3 Tokenizer | Llama for Developers
Understanding the Llama 3 Tokenizer | Llama for DevelopersAI at Meta
zhlédnutí 6K
Emmanuel Candès: Statistical methods for assessing the factual accuracy of large language models57:29Emmanuel Candès: Statistical methods for assessing the factual accuracy of large language models
Emmanuel Candès: Statistical methods for assessing the factual accuracy of large language modelsASA Statistical Learning and Data Science
zhlédnutí 545
Quality and Quantity of Machine Translation References for Automatic Metrics [HumEval 2024]12:02Quality and Quantity of Machine Translation References for Automatic Metrics [HumEval 2024]
Quality and Quantity of Machine Translation References for Automatic Metrics [HumEval 2024]Vilém Zouhar
zhlédnutí 158
5 Simple Steps for Solving Any Recursive Problem21:035 Simple Steps for Solving Any Recursive Problem
5 Simple Steps for Solving Any Recursive ProblemReducible
zhlédnutí 1,2M
User Trust in AI under Uncertainty [EMNLP 2023]3:41User Trust in AI under Uncertainty [EMNLP 2023]
User Trust in AI under Uncertainty [EMNLP 2023]Vilém Zouhar
zhlédnutí 241
LLM Tokenizers Explained: BPE Encoding, WordPiece and SentencePiece5:14LLM Tokenizers Explained: BPE Encoding, WordPiece and SentencePiece
LLM Tokenizers Explained: BPE Encoding, WordPiece and SentencePieceDataMListic
zhlédnutí 5K
"I want Llama3 to perform 10x with my private knowledge" - Local Agentic RAG w/ llama324:02"I want Llama3 to perform 10x with my private knowledge" - Local Agentic RAG w/ llama3
"I want Llama3 to perform 10x with my private knowledge" - Local Agentic RAG w/ llama3AI Jason
zhlédnutí 385K
*(char*)0 = 0; - What Does the C++ Programmer Intend With This Code? - JF Bastien - C++ on Sea 202354:28*(char*)0 = 0; - What Does the C++ Programmer Intend With This Code? - JF Bastien - C++ on Sea 2023
*(char*)0 = 0; - What Does the C++ Programmer Intend With This Code? - JF Bastien - C++ on Sea 2023cpponsea
zhlédnutí 280K
Big O Explained (You NEED This for Coding Interviews)14:35Big O Explained (You NEED This for Coding Interviews)
Big O Explained (You NEED This for Coding Interviews)Aaron Jack
zhlédnutí 84K
Sergei Barracuda - Ostrava (OFFICIAL VIDEO)03:31Sergei Barracuda - Ostrava (OFFICIAL VIDEO)
Sergei Barracuda - Ostrava (OFFICIAL VIDEO)Sergei Barracuda
zhlédnutí 95K
NEJLEPŠÍ KVÍZ NA YOUTUBE @Duklock @EvilBender4723:24NEJLEPŠÍ KVÍZ NA YOUTUBE @Duklock @EvilBender47
NEJLEPŠÍ KVÍZ NA YOUTUBE @Duklock @EvilBender47Vidrail
zhlédnutí 229K
SPONGEBOB POWER-UPS IN BRAWL STARS!!!08:35SPONGEBOB POWER-UPS IN BRAWL STARS!!!
SPONGEBOB POWER-UPS IN BRAWL STARS!!!Brawl Stars
zhlédnutí 25M
Be a princess for Halloween: DIY guide! 👸🏰01:00Be a princess for Halloween: DIY guide! 👸🏰
Be a princess for Halloween: DIY guide! 👸🏰Speedy Crafts
zhlédnutí 13M
МЫ ОТМЫЛИ ОСКАРУ ПОПКУ 😍00:25МЫ ОТМЫЛИ ОСКАРУ ПОПКУ 😍
МЫ ОТМЫЛИ ОСКАРУ ПОПКУ 😍HOOOTDOGS
zhlédnutí 12M
Stop Watch + Wolverine00:27Stop Watch + Wolverine
Stop Watch + WolverineJake Ceja
zhlédnutí 12M
He bought this so I can drive too🥹😭 #tiktok #elsarca00:22He bought this so I can drive too🥹😭 #tiktok #elsarca
He bought this so I can drive too🥹😭 #tiktok #elsarcaElsa Arca
zhlédnutí 44M
Moja Prvá Šialená Skúsenosť s Alkoholom - Animácia CZ/SK26:40Moja Prvá Šialená Skúsenosť s Alkoholom - Animácia CZ/SK
Moja Prvá Šialená Skúsenosť s Alkoholom - Animácia CZ/SKStudioMoonTV
zhlédnutí 378K