Sébastien Bubeck on Phi-2 and the surprising power of small models

Sébastien Bubeck leads the Machine Learning Foundations group at Microsoft Research. He and his team have released a suite of small language models (SLMs) called “Phi,” the latest of which (Phi-2) matches or outperforms models up to 25x larger. After debuting Phi-2 at the annual NeurIPS machine learning conference, Sébastien sat down with Microsoft CTO and EVP of AI Kevin Scott to discuss Phi-2 and what it suggests for the future of how we build AI models.

[@torarinvik4920]

Absolutely love the Microsoft Research interviews. It puts faces on the AI stuff we read about. Microsoft Research has just an insane amount of intelligence, both human and artificial.

[@LoneFarrell]

Well his addition of spirit is excellent.

[@kittylam23]

Mahalo for posting this. Love this!!!

[@abnermusonda5376]

Very exciting -thanks for sharing this insight!

[@charlesgrp]

really love Phi-2 model

[@cleo1488]

Please bring him back

[@Proud_Indian_Kashmiri]

Thankyou Microsoft you have added kashmiri language

[@mshonle]

10:59 - hold up, there is way more to modular elliptic curves than “beauty”. ECC, for one.

[@emc3000]

I'm super interested in the role that language models can play in the creation of better audio interface for blind or low vision users. Sadly, there seems to be very little interest in the subject of accessibility oriented ai.

[@KP-sg9fm]

Bring Back Bubeck

[@dinoscheidt]

5:31 „There are no text books for common sense“ … yeah, the publisher is about 8.1 billion copies behind 😵‍💫

[@Li-rm2gj]

I guess the reason sometimes people form a type of superiority complex, is out of frustration or a sense of disillusionment with societal trends. There is a lot not perfect with the world but on average things are getting better.

[@mechanicalmonk2020]

r/im14andthisisdeep