Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast
Vložit
- čas přidán 31. 05. 2024
- Andrej Karpathy is a legendary AI researcher, engineer, and educator. He's the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford. Please support this podcast by checking out our sponsors:
- Eight Sleep: www.eightsleep.com/lex to get special savings
- BetterHelp: betterhelp.com/lex to get 10% off
- Fundrise: fundrise.com/lex
- Athletic Greens: athleticgreens.com/lex to get 1 month of fish oil
EPISODE LINKS:
Andrej's Twitter: / karpathy
Andrej's CZcams: / andrejkarpathy
Andrej's Website: karpathy.ai
Andrej's Google Scholar: scholar.google.com/citations?u...
Books mentioned:
The Vital Question: amzn.to/3q0vN6q
Life Ascending: amzn.to/3wKIsOE
The Selfish Gene: amzn.to/3TCo63s
Contact: amzn.to/3W3y5Au
The Cell: amzn.to/3W5f6pa
PODCAST INFO:
Podcast website: lexfridman.com/podcast
Apple Podcasts: apple.co/2lwqZIr
Spotify: spoti.fi/2nEwCF8
RSS: lexfridman.com/feed/podcast/
Full episodes playlist: • Lex Fridman Podcast
Clips playlist: • Lex Fridman Podcast Clips
OUTLINE:
0:00 - Introduction
0:58 - Neural networks
6:01 - Biology
11:32 - Aliens
21:43 - Universe
33:34 - Transformers
41:50 - Language models
52:01 - Bots
58:21 - Google's LaMDA
1:05:44 - Software 2.0
1:16:44 - Human annotation
1:18:41 - Camera vision
1:23:46 - Tesla's Data Engine
1:27:56 - Tesla Vision
1:34:26 - Elon Musk
1:39:33 - Autonomous driving
1:44:28 - Leaving Tesla
1:49:55 - Tesla's Optimus
1:59:01 - ImageNet
2:01:40 - Data
2:11:31 - Day in the life
2:24:47 - Best IDE
2:31:53 - arXiv
2:36:23 - Advice for beginners
2:45:40 - Artificial general intelligence
2:59:00 - Movies
3:04:53 - Future of human civilization
3:09:13 - Book recommendations
3:15:21 - Advice for young people
3:17:12 - Future of machine learning
3:24:00 - Meaning of life
SOCIAL:
- Twitter: / lexfridman
- LinkedIn: / lexfridman
- Facebook: / lexfridman
- Instagram: / lexfridman
- Medium: / lexfridman
- Reddit: / lexfridman
- Support on Patreon: / lexfridman - Věda a technologie
Here are the timestamps. Please check out our sponsors to support this podcast.
0:00 - Introduction & sponsor mentions:
- Eight Sleep: www.eightsleep.com/lex to get special savings
- BetterHelp: betterhelp.com/lex to get 10% off
- Fundrise: fundrise.com/lex
- Athletic Greens: athleticgreens.com/lex to get 1 month of fish oil
0:58 - Neural networks
6:01 - Biology
11:32 - Aliens
21:43 - Universe
33:34 - Transformers
41:50 - Language models
52:01 - Bots
58:21 - Google's LaMDA
1:05:44 - Software 2.0
1:16:44 - Human annotation
1:18:41 - Camera vision
1:23:46 - Tesla's Data Engine
1:27:56 - Tesla Vision
1:34:26 - Elon Musk
1:39:33 - Autonomous driving
1:44:28 - Leaving Tesla
1:49:55 - Tesla's Optimus
1:59:01 - ImageNet
2:01:40 - Data
2:11:31 - Day in the life
2:24:47 - Best IDE
2:31:53 - arXiv
2:36:23 - Advice for beginners
2:45:40 - Artificial general intelligence
2:59:00 - Movies
3:04:53 - Future of human civilization
3:09:13 - Book recommendations
3:15:21 - Advice for young people
3:17:12 - Future of machine learning
3:24:00 - Meaning of life
💪🧠
@20:20 were you finally debriefed? lol jk! .. 🎯, though. ☝💙
great interview , lex
AI is way behind especially in "solving Universe" - which was recently solved in free "Time Matters eBook" (Hubble redshift is not due to expansion and Big Bang, but thanks to time dilation in past translates into redshift today; Vera Rubin puzzle about fast spinning spiral galaxies and not falling apart is not due to dark matter, but due to time faster at ~0.001 rate in spiral arms, that alone holds galaxies together; and other, if not all, puzzles about our Universe, "UFO" including).
Imagine if there’s a lag or hack on a self driving car 🚙 it needs a lot of work
This is what made Lex famous. We need more scientists, less celebrities!
Blink twice if Joe Rogan has you held at gunpoint and forces you to watch these videos.
Jokes aside, if you don't like listening to celebrities; don't watch the videos where they're being interviewed. Lex is allowed to have fun and do whatever he wants with his platform.
I think you are wrong. I think the variety is what brings in over a million subscribers. There are definitely more subs here because of that then they are for only scientific discussion
@@MattWalkerTxranger Wrong, most of lexs fanbase is here for scientist podcasts
Don’t watch it if you want it’s that simple. the celebrities pull millions of views so people are obviously interested
I think the more perspectives/kinds of brains Lex talks to the better! If he keeps following his own interests and heart, I feel that's where we'll get the most interesting conversations :)
Seems mind-blowing to me having access to a 3.5 hour talk with one of the greatest minds in the history of AI, while having the chance to learn from his habits, thoughts, and way of seeing life. Such an outstanding job as usual, Lex.
yes Andrej is lucky to have this time with him
This.
Lex is not the smartest in world bit he is up there
This is what youtube should be used for, not all the crap that drowns the servers and sucks the energy grid like a starving prostitute in red light district
9:41 he suggests that he understand abiogenesis intuitively? uhhhhhhh ok there guy
Would be happy to see andrej a second time
heavy plus one!
For sure
he's a moron ..
absolutely
The intensity and quality of this long interview reveal the intellectual capacity of both speakers. This has been well worth my time. Thank you!
Andrej is one of the most generous person there is in AI. His stature is so well deserved.
From Movie he show it...
Romans.. 😎😎😎
geohot > andrej
Thanks Chinese bot
@@doge0069 I would certainly disagree with you , not on any technicality because geohot might be better programmer ,but he is to ego driven of a person to be any kind of great leader.
@@avaksaputra huh?
after listening to the Kanye West episode I had to listen to this one urgently at the attempt to recover the neurons that flew my brain. Thank you Andrej for such beautiful insights and clear explanations :)
Did you have the patience to listen to the whole episode? I gave up after 20 minutes
@@boghy1996 I tried, cause a friend told me the end was epic, but then I saw that this episode was published... like a present from heaven, so I changed automatically :)
Hahahah dude. Same here.
Pretty close minded lol
@@callamburles3075 sometimes people are so open minded that their brains fall out...
Andrej's laugh is so funny and pure. He is a good natured fellow. Lex is a die hard AI fan boy and I think him interviewing Andrej is like talking to someone who shares that passion for AI. Great interview!
I like the way the Andrej can't quite believe some of the answers he gives, given his depth of knowledge, and laughs nervously as if he's some how breaking the matrix of what knowledge he should disseminate. Very intelligent, very humble chap. Very grateful to Lex for allowing this fascinating interview to take place and to Andrej for being forthright and honest and taking part. I'll certainly remember this interview for a long time to come.
Andrej speaks so quickly, yet it doesn't sound rushed or thoughtless. Fascinating dude.
I set the speed to .75 to make sure I don’t miss anything
I had to double-check I didn't have it set to 1.25 haha
He’s is overclocked 😊
Reminds me of Ben Shapiro
His brain is bottlenecking his mouth.
One of his biggest plus is his ability to be very efficient, precise and clear in his descriptions and answers
You can tell from the length of the time stamps in the video
"If you can't explain it simply, you don't understand it well enough." - Some random guy
one of the best podcasts out there on the internet.. the clarity of thought and the depth of answers of Andrej is insane!
Lex and Andrej podcast feels like Saturday morning cartoons all over again.
This all the way!
That's the best compliment he could get right Lex? Burn a Burner PEACE
Exactly. Thanks.
I wish “aliens”would just dear john us so we all can move on with fucking this earth up.
BEST, SPOT-ON analogy. 😁
Amazes me that we have people like Lex and Andrej on this planet. Smart, ahead of their time yet present in moment and both empathetic to our world.
“AI”just like “aliens” need to not be the be all solution for human made problems. If this planet was mostly water and now it’s not and we are mostly water ..
Thank the Lord he gives humanity men with this level of intelligence and sensibility!
@@Notwoke7 They develop this level of intelligence through practice and challenging the limits, not being given by imaginary entity.
Lex is smart? I think he is alright, but he never came across as "smart" to me.
He definitely has some sway getting high profile individuals on his show, and is a reasonable conversationalist.
@@scottydog9997 Lex has a remarkable way of speaking. It looks to me as if he wants to get into a state of purposelessness, to be able to express what his mind finds, uninfluenced and without too much control by his everyday consciousness. It's like ink painting in Zen or Cy Twombly’s struggle for elimination of personal influences on the image result. So it is that Lex lets the words flow out of him, with a minimum of control and at the pace at which they form in his mind. And that's what creates this slurred, indistinct speech pattern. One should not interpret this as a lack of smartness. If you pay attention to the content and less to the form, you will better recognize the sharpness of his mind. (Funny, of course, is the contrast with Andrej's super-accented, extremely efficient speaking style...)
In my view, this is the best AI interview conducted by Lex to date.
41:50 - This is the main reason why large language models understand and reason, in many cases, in a similar way to how humans do.
The psychological and/or philosophical (extremely simple) idea underlying the success of these large language models is that the brain may be, fundamentally, a predictive system. Whose main goal is the prediction of characters/words, pixels/images, ... If we consider this hypothesis (that could be) true, then we should focus our efforts on developing architectures (e.g. Transformers) that allow us to make better predictions.
Intelligence is all about predicting the future, nothing more, nothing less
Live in the eternal Now and be free of space and time.
I can't help but really like Andrej. There is a childlike excitement that exudes out of every part of his demeanor. His obvious passion is contageous and that is truly endearing & critical in moving this field forward in a positive direction. Not too many people you could say that about.
I really like when Lex interviews people in AI. The questions that he comes with are more refined than normal questions and we also hear his voice more since he is also an expert in the field.
I mean… ai is his main thing
Andrej...went from relative unknown 5 years ago to a absolute legend today. Good for him.
His "Unreasonable Effectiveness of RNNs" was top of hacker news eight years ago. He has been a top content producer/big voice/educator in the community for a while. Him blowing up is sampling bias of AI generally being more popular now.
How Andrej described working on a problem is exactly how I do. And what he said about night time quietness being great to focus, 200%. And also becoming obsessed with it and having it all on RAM, it's like he's describing my process, I can relate so much! This happened to me last night and this morning! Best problem solving I've ever done was, hands down, at night! Amazing how he described this so accurately to match my process.
Dont know him personaly. Did save his 2018 video Re Tesla
Awww, I absolutely love Andrej! He's so sincere and kind, and such an amazingly accomplished guy. His laugh is so full of joy. My favorite Lex interview to date!
This is the kind of conversation that takes me time to digest because of the complexity of the topics and I found that challenging but satisfying because I get to learn new things, thanks Lex for making knowledge more accessible to everyone
right?? Its so awesome to have access to this very mainstream channel of media that attracts such big players and thinkers in the world that makes our own what it is.
Andrej really comes across like a hacker/tinkerer in every way. Even the way he talks seems optimized to get information across fast, precise and to the point. He really gives of a vibe that Life is too short to waste, too much to discover,and every second not used to think about the puzzles around us is a wasted second. I think for Andrej life is a Rubiks cube😊
Amusingly, Andrej is also actually "one of the most influential people in the Rubik's cube community" apparently.
@@AllanSustainabilityFan Badmephisto was the GOAT channel for speedcubing concepts from 2007 until the early 2010s. It's very likely the current crop of top speedcubers used his resources in the early stages of their development. His influence there is certainly on the decline, young cubers won't have a clue who he is
@@MrClarktom so he is literally a rubics cube guru.. woah
My thoughts as well. For how fast he talks, it's easy to keep up with him. It's like listening to an audiobook at 1.5 speed. Love it!
Great minds yes, but seriously ignorant of latest developments in physics.
I'm truly inspired, overwhelmed, motivated, shocked at how much I can learn. Lex's questions range from the super geek way over my head to the extremely daring "what does it all mean". His questions really bring out who Andrej really is. On the other end, Andrej is so truthful, transparent, present, it is a pure joy to see and hear the best of how we can be in the world. This podcast is a turning point for me.
This is one of the most interesting and fascinating interviews I have ever seen. Honestly. It's 2 am in the morning. I gotta sleep, but I can't stop.
Apart from everything else he's done, Andrej is also one of the most influential people in the rubik's cube community - his old tutorial videos on F2L OLL and PLL on the badmephisto channel were the entry point into high level cubing for a lot of top solvers and content creators today
My mind is blown - I didn't know that! 😱
yes!! from the timestamps it seems as if lex did not bring up his past content related to cubing which is such a shame. I'd love to hear if he's still into it at all and what he thinks about the impact he had as badmephisto
I was just about to say the same thing! About 9 years ago I learned how to solve the 3x3 from his tutorials! Love this man and it's incredible to see what amazing thing's he's done since then. I remember seeing his video about working at Stanford and Google on deeplearning and as a software developer myself, being so inspired!
Whenever I see his name I always think of his tutorials despite using them ages ago.
why did he leave tesla? Tesla please get him back pls
Lovely interview. Andrej speaks in 1.5x speed and I love that.
I watch him at 1.5x speed while he speaks at 1.5x speed
@@agicortexI was just gonna say the same thing. Lol. It’s what sounds normal to me. I usually do 1.75. He did get me down to 1.5 this round though 😂
I love Andrej's laugh... And the absolute humility of his own ego in the purpose of solving his goals- People like him bring me so much joy~
This CD has three separate relaxation/meditation sessions on it czcams.com/users/postUgkxzpa8CIfZcihW4Z0F_ja0QF3W9KIatrsq guided by a very pleasant and direct male voice. Unlike so many other products of its type, this CD does not have bad synthesizer music, does not feature a phony or affected style of narration, and does not make any bogus claims to be subliminal or to re-train the brain or any of that balderdash. What you get is 1. a guided meditation for getting into a pleasantly relaxed state of body awareness while taking a stroll (superb for those easing back into a fitness routine slowly after an illness or injury) 2. A nice long breath-awareness relaxation session that if followed diligently can put you into very deep states of full-body relaxation and mental calmness, and 3. a buddhist-inspired meditation session designed to help you develop and maintain feelings of loving kindness toward not just yourself and your friends, but toward people you don't even like. The CD makes no claims to be designed for advanced meditators or for buddhists or hindus/yoga practitioners looking for very deep and esoteric stuff. It is geared more toward the average person who just wants to develop the habit of relaxation and stress relief through natural, healthy means. him, if you happen to be reading this, keep up the good work fella, and I love your accent. I would also like to note that I have never fallen asleep while listening to this product. I would like to kindly suggest to the reviewer who said this CD makes him fall asleep, that he might want to get checked to see if he has a sleep disorder, or if he is simply not setting aside ample time for restful sleep at night. A healthy person getting adequate rest at night should be able to go into deep states of mental relaxation without dozing off, if not all the time, then most of the time.
1:29 Lex taking notes while Andrej is explaining neural nets is pure gold😂
he learned that trick from kanye
@@user-gp7zt8sm4w that dude takes notes from HIMSELF
Andrej is really an incredible person in many ways. Thank you so much for letting us discover more intimately the genuinely kind human being behind the great genius, Lex 🙏
Lex, what you said at 1:57 in this podcast was so important for me to hear today. I truly appreciate the way you are working to make our world a better place.
For the creator of the universe to notice us, we are trying to create systems that are loud enough to answer back.
wow, that is awesome, one of the best quotes I've heard in my life, definitely resonates with me.
Wow
Thank you for the update AMC2V is done right, and waiting is part of the process,
Cool interview. I think you should ask for book recommendations for every candidate.
I love that idea! Would be cool to make that a fixed question in every podcast
He made a few actually!
Really humble guy. Loved learning some of his insights. Also loved that he dropped major hints at the Microsoft + OpenAI partnership while it was still brewing.
The following realization made me laugh. For all other channels, I routinely increase the playback speed to at least 1.5 - even before I listen to the content. This video made me realize that I need to slow it down to fully understand. Still, I am grateful for the level of knowledge that is being shared by your efforts, Lex. It is unique.
Yay! Back to Ai talk !!! :) More tech interviews! Back to the roots! Thanks ! Loved the synthetic biology talks too. Would love a neuroweapon expert talk and how to counter them. Or any neuroscience technology is really interesting!
Really needs to happen specifically because of the recent patent of nervous system manipulation through magnetic fields of monitors. Lol. Aka your computer or 0hone screen can actually mind control you to some extent and I'm exited to learn how much and ways to counter it. I sadly can't remember the patent number.
cyberpunk intellectualism ftw :)
@@caseyalbright2762 i f0und out how it works. Just imagine a man with a beard on a cloud talking telepathically to the people down here and think of what Good can come of that. And now that you are doing so, reason about Why you are doing so now and realise it was, because of some screen in front of you manipulating your thoughts. Read more...
Please do more podcasts like this.
If there where moore people like it he would, but the amount of people who built up a department at Tesla from zero to succes is scares to say the least.
10000 hours was the most incredible insight for me. Thanks, Lex for all effort that you are doing to make such educational podcasts.
One of Lex’s best interviews, Andrej is fascinating
I love how excited Lex is during this interview
Why do you guys all kiss his ass in the comments section? He doesnt even form succinct questions that can provoke direct to the point Simple responses it’s the easiest job in the world
What a pleasant surprise! Thank you Lex, you just leveled up my weekend from great to awesome! Keep up the great work and content 🙂
Smart phones facial recognition bio energies electro magnets detect frequency plus finger prints. See plus average heat moister. Move ment sens er to detect. To recognise. See alice resident evil Tvirus. X
❤❤❤
I am super impressed with what Andrej and team accomplished. Thank you for allowing me to know him a bit better through this interview. You are both very pleasant and interesting people.
I'm an AI grad student. My younger sister is in high school right now and she is very eager to start exploring the subject. I just sent her a clip of Andrej's advice for beginners. Thank you so much Lex and Andrej! Sending you love from the other side of the globe.
I used to work in the auto pilot department (data labeling team) for Tesla and actually got interviewed by him. I always felt like he was the smartest most technical person I've ever met. BTW, he was the only one in the office who had a rubix cube on his desk.
👆👆👆👆 .. ...
😁
I like your youtube handle
rubix cube seriously?
The entire flow of the podcast has been so natural. I'm sure, it's not only us but Lex and Andrej also enjoyed the conversation.
The chemistry tho 🔥🔥
This was a great episode! It's amazing to hear Andrej breakdown complex topics into understandable chunks. It's also helpful when the interviewer knows a lot about the topic and asks the right questions.
Books recommendations:
- The Vital Question
- The Selfish Gene
- The Molecular Biology of The Cell
The most interesting question in this interview is asked at 13:59 when Lex Says, 'The jump from bacteria to more complex organisms is the hardest jump'.
How can it be that on earth we made the jump from bacteria to where we are today: a technological society. (and how can it be that we haven't found other planets where this happened too)/
I suspect the main reason lies in the fact that the earth got tilted 4.5 billion years ago.
Because of this we have our seasons and every day differs from all other days in terms of temperature and the amount of sunlight and weather conditions overall.
Evolution thrives on constantly changing environments . A bacteria might thrive with 18 hours of sunlight everyday (June) but fail to do so with only 6 hours (December). In a situation where earth was not tilted you would get 12 hours of sunlight everyday.
So it's plausible that on a tilted earth evolutionary forces are factor X higher than evolutionary forces on a non-tilted earth. This might have speeded up evolution with X billion years and be the main reason we are the most advanced form of life in the universe relatively close to us.
@Lex really interested to get your take on this.
Extremely intesting thought! This might indeed be one of the main reason we have made this jump so quickly.
Very interesting indeed. It should be possible to estimate different evolutionary speeds by simulating this in a scientific controlled environment. This could give an estimate of how quickly life would get to the current level of complexity in a situation where the earth is not tilted.
Andrej's laughter :D Love it!
1:04:20 - Dude hit the bullseye with Bing, kudos
With the discussion regarding the future of AI and being able to render things from voice dictation, at that point, we’re literally wizards casting spells.
"Any sufficiently advanced technology is indistinguishable from magic" -Arthur C. Clarke
I knoww right?
The best interviews - sharp, fun, thought-provoking. Keep it up Lex, love it.
This is so worth taking time for. Thank you Lex Fridman and Andrej Karpathy.🤓
I like his reservedness when speaking about NNs and avoiding over-philosophising a mathematical structure, that's akin to clay, of course you can morph it into something arbitrarily complex, its more the morphing process, the optimiser that's doing the work...
I wish there was an AI to speed up the video when Lex talks and slow it down when Andrej does.
Andrej speaks so fast. There are moments I think the video is sped up and then Lex’s smooth jazz questions brings everything back to pace.
👆👆👆👆 .. ...
Lol right 🙂
That's because Andrej is probably a hybrid of man and machine.
@@Solarxstorm you're genius extreme !
@@Solarxstorm Artificial Hybrid Intelligence
Long awaited interview! Great stuff Lex
I loved this interview! Andrew is so full of joy. What a likeable guy. Two of my favorite people just chatting….
Great podcast, keep them coming
Finally we are back to the OG Lex podcasts. Please do more of this!
Fck chess and other bs! aliens is the shit! 👽🚬
I want lex to interview everyone.
Not evry one ? But the best ones ...
Kanye was extremely disappointing, what a prick he was. I loved the chess interviews though, it inspired me to pick it up, as strategy and problem solving are my weakspots.
I was extrimly engry after that bodcast wtf was that I mean ? be thenkful for lex becous he didn't live that room in the middle of that entrveiw ?
Lex, this is probably your greatest interview to date. Only Ray Kurzweil's may be considered better. Absolutely mind-blowing!
I would add the 2 Joscha Bach episodes to that list as well
@@imransuhail82came here to say this
Incredible interview. Andrej's Zero to Hero series on youtube is highly recommended if you know some Python and have an interest in neural networks. His mind is on full display there as well. Thank you, Andrej, and thank you Lex for an amazing interview.
Is it good as a full stack developer
This and many other interviews inspire me. I am currently in healthcare informatics and am looking to make the next step. Trying to use the will and the intellect to take the leap. Hopefully this deterministic future is kind. Thanks Lex and Andrej.
I really appreciate you try to show how amazingly complex and how blessed we are to exist,how much we don’t know and how much we need to learn.it’s pure love.
Thank you so much for making these Lex. You get down, you get burnt out, you get lost in the vast field we work in, and these talks help me to motivate and refocus, your work is tremendously appreciated.
This is the best techie interview for November 2022. Clean pure and honest.
1:47:50 somebody who turns down being a manager for more technical roles is absolutely the type of person that should be working on things like this.
Wish the finance industry was the same
Magic = physics exploit?
Mr. Fridman, The treasury of knowledge and wisdom I find in your meaningful discussions are a bright spot in my life. Stay safe and take care.
My favorite podcast so far. I am a big fan of Andrej. Thank you both!!
That's what I call an interview!
Such a piece of normality in today's times feels really refreshing.
Greetings from Kosice, Slovakia.
This is my favorite podcast episode. I never listen to or watch any podcasts and i can't believe i watched the entire 3 and half hours of it.
Thank you for this fascinating episode with so much positive vibe between you Lex and Andrej. There seems tremendous mutual respect between you too. It's been a pleasant experience. Thanks.
😊
This is one of the most inspiring interviews I ever witnessed. It might be the base for a Turing test right here...
Yhee imagine if he was an AI, or both was an AI, then end game for humans.
😊😊😊🤧😁😁😁
It's refreshing to watch this again. It's nice watching you share from this from the hip, Lex! Karpathy is always a joy. I gleam deep insights from him. Thank you
He is so inspiring to listen as a future AI/ML engineer. I am a computer science student. Thank you so much for this, Lex Fridman
Hi Lex, I am a big enjoyer of your interviews! I love how you focus so much on the humanity of yourself and your guests and always have a respectful line of questioning. I don't see that too often in interviewers these days, and watching these are so relaxing. And thanks for taking the time to meticulously timestamp everything. Have a great day!
Dope interview, Andrej is a beast, can't wait to watch Tesla solve autonomy, intelligent/useful humanoid robots, and ultimately AGI.
Look who it is 👋
I think he left Tesla
Nick Lane and Andrej Karpathy are my 2 favorites. Have watched both > 3 times.
1:08:07 - how code writing is changing since the 80s
1:10:42 - changing datasets, loss functions
1:14:09 - supervised learning (lots of data of input) and lots of data of desired output
You guys should have more podcast together. This is so insightful and very entertaining.
I really hope eventually we will get a second run on this. AI moves so fast, they could probably do this yearly without any issue. :)
Such a delight! Two great minds talking about deep questions.
Watched this episode a few days ago and literally can't get the concept of language models out of my head, super interesting stuff!
I sleep at 5am and wake up at 12noon because the 12am-5am night hours are so incredibly peaceful. No text messaging no social media activity. Incredible.
Wasnt it?
Awesome podcast and i really love Andrej. His latest lectures really are fantastic and i can't recommend them highly enough!
Where can these lectures be found? I discovered Andrej in the last days and I'd like to know also if there are courses taught by him :), thanks
What a refreshing video and so contrasting compared to the last podcast (which I was only able to listen for 5 minutes).
I love listening to your show Lex! There’s no other word for it! You’re entertaining me, you entice me, you make me think way outside the box!
🙂😊
Lex, thank you 🎉🎉 for posting your fascinating conversation with Andrej😊
I was an artist's model for 12 years and I reached my 10k hours in the first 10 years. My final two years were the most enjoyable for me because I really embraced what I learned from my audience.
You both are inspirational as intelligent and compassionate communicators. Bravo🎉🎉
I am not an engineer. I am an audio engineer. But I love listening to engineers speak because, even if I don't fully understand, it expands my mind and peaks my interest. Thanks Lex for all the great content. Thanks for spreading love in this world
He believes the universe has intelligent life outside earth, I like this guy.
26:25 Stanislaw Lem - His Master's Voice
The way Andrej explained the transformer architecture 33:34 is just magnificent! What a Scientist!
Just wanted to comment and say I'm an average guy. I don't watch all your videos however I do find them very in-depth very interesting when I watch them. THANK YOU for all your hard work I highly appreciate you. You help inspire me to do the best I can. I'm trying to change my life for the better because of people like you.
Legendary. One day humans will look back at this era and people like Karpathy will be etched in history like we view Turing, Von Neumann today. Both OpenAI (GPT-3) and Tesla autonomous driving are the first “consumer” friendly applications of AI that truly impressed me, and are the stuff of science fiction. What stood out to me most from this convo is Karpathy’s push back on relating neural nets to the human brain, an often made analogy. Learned many new things today, very grateful for the internet and Lex ❤
OR the advent of artificial super intelligence destroys humanity and this comment ages like milk 😅
Thank you, Andrej.. This was a brilliant podcast! Absolutely loved it.. Hope to see a part 2 this year, given the pace of AI progress :)
I like how Stephen Wolfram talking about deterministic nature of the universe, giving an interpretation that shed some light on shady aspects of modern physics in such an elegant way, without touching any personality, but just giving us more ideas for free.
And at the same time, the same idea unrolled by Andrew in such a way, that traps the mind by making us thinking, that we are just the machines (solving puzzles all of a sudden, though) in other words, that our thoughts means nothing - by exploiting the same idea, which is the basis of the Lifespring sect, which they use along with the hypnosis to take control over people in a literal way.
Such a big difference between these two: hated by many, but insanely passionate Stephen who brings tons of inspiration, and cute conformal Andrew, who speaks of such things that take away all inspiration and meaning.
Thank you @lexfridman for helping us see what is what.
Right…
I don't often comment on youtube videos, but Andrej was a joy to listen to. Thank you.
this got so gnostic so quickly. ive never thought about the potential of AI to find 'exploits' in physics. good episode.
basically the plot of the metamorphosis of prime intellect
Metamorphosis… love the word choice😊
As usual. Questions on point. Conversation seems very natural. Educational, informative and generally very interesting.
You discuss topics that interest me. Unfortunately I can’t have conversations like these because no one in my group thinks like me. They look at me weird. I’m a PhD engineer with an interest in ai, aliens, astronomy and cosmology, evolution and general science and technology.
In my works, I’m on my own. Thank goodness for CZcams and podcast like this.
Hello Lex,
Thank you for sharing so much knowledge though this conversations, I really enjoy them. Please consider taking the chance to interview Adriene Mishler from the Yoga With Adriene youtube channel, I think she is also an amazing person and I would love listening some deep conversation between you two.
Again thank you for your effort bringing great information to all of us.
Cheers from Spain,
Carlos