Can AI Learn Language the Way Babies Do?
Vložit
- čas přidán 30. 05. 2024
- AI systems like GPT-4 have made headlines for how well they learn and use human language, but they do that by ingesting astronomical amounts of data from the internet-more text a human would encounter in 100,000 years. Human babies, meanwhile, learn words with much less input, just by absorbing what's in their own environment. What would happen if an AI system had to learn words the way kids do, based only on what a single toddler sees and hears? NYU data science researchers recently Wai Keen Vong and Brenden Lake conducted that exact experiment, using video and audio captured from a camera mounted to a child's head over a period of months to train a multimodal neural network. The results-published in the journal Science-shed light on long-standing debates on language acquisition processes in children, as well as on what it would mean to make AI learning processes more childlike, and potentially more efficient.
Very interesting! But if I understand correctly - the learning part was done in the same way as "regular" ML (with image-speech-text methods) and it's only the data that was collected differently? and if so, why would there be any difference between this data and data from the web?
there is fantastic feedback between the world and the focus of attention. This data is unique. Only human brain works as truly general intelligence. Best research ever! I actually dreamt of something like that to be checked out, and it happened :)
I must say I'm not as impressed, because so far it's just word learning. I'm saving my "WOW!" till AI starts learning utterances with some grammar in the same way.
@@taivkl-ds1wdI bet you know ChatGPT. The beauty of the experiment is the selection of data. The rest is easy! :)
Was the data annotated by humans somewhere in the loop?
@@andrea-mj9ceif a real baby does not need it (other than the interaction with humans) so should not the artificial one
One of the most interesting pieces of research ever! :) btw: 0:54 When a baby hears the word "cop", it is really cute to figure out what it means! :) ❤
"Promo SM"
Kinda seems like humans are holding the AI models back. Hopefully we outgrow those vain and greedy meat bags.
Excuse me? It is precisely the opposite. AI tries to figure out the genius of babies! :)
@@funkdrunk Well it should interesting to see who grows up faster that's for sure.
@@marshallmcluhan33babies are optimized so well than they will be hard to catch up with
@@funkdrunk Yeah good point but I wonder if it might end up being like a tortoise and the hare type situation.