Jim Keller: Most People Don't Think Simple Enough | AI Podcast Clips
Vložit
- čas přidán 9. 02. 2020
- Full episode with Jim Keller (Feb 2020): • Jim Keller: Moore's La...
Clips channel (Lex Clips): / lexclips
Main channel (Lex Fridman): / lexfridman
(more links below)
Podcast full episodes playlist:
• Lex Fridman Podcast
Podcasts clips playlist:
• Lex Fridman Podcast Clips
Podcast website:
lexfridman.com/ai
Podcast on Apple Podcasts (iTunes):
apple.co/2lwqZIr
Podcast on Spotify:
spoti.fi/2nEwCF8
Podcast RSS:
lexfridman.com/category/ai/feed/
Jim Keller is a legendary microprocessor engineer, having worked at AMD, Apple, Tesla, and now Intel. He's known for his work on the AMD K7, K8, K12 and Zen microarchitectures, Apple A4, A5 processors, and co-author of the specifications for the x86-64 instruction set and HyperTransport interconnect.
Subscribe to this CZcams channel or connect on:
- Twitter: / lexfridman
- LinkedIn: / lexfridman
- Facebook: / lexfridman
- Instagram: / lexfridman
- Medium: / lexfridman
- Support on Patreon: / lexfridman - Věda a technologie
2:19 - "If you constantly unpack everything for deeper understanding you never get anything done. If you don't unpack and understand it when you need to, you'll do the wrong thing." Loved this, well said.
Right, that's where experience helps. Michael Clarke is ground up redeveloping the Zen5 design following Jim's philosophy.
11 months later... whelp, we're there.
Reminds me of Bruce Lee. "If you have one to the extreme, you'd be very unscientific. If you have another to the extreme you are all of a sudden a mechanical man, no longer a human being"
The fun stops when you're about to rebuild an AI from scratch and it says:
"no, don't worry, I got it"
Luke Passos paaahahaha
The AI is going to say. You're using up valuable resources but I have a solution for that.
The fun begins!
When you hit the build button, but all that happens is your laptop speakers say: "I'm sorry, I'm afraid I can't let you do that... Dave".
user:
>mkdir AI_2
computer:
"say no more, fam"
loving Jim's Logical mind, he is so exact and to the point .
"If you really want to make a lot of progress in computer architecture, you should write one from scratch every 5 years"
I'll keep it in my frontal lobe cortex in my next SW job, sir.
Actually we could have things much sooner.
Don't listen to short - sighted behavior or ignorance.
Check out my other channel's playlists and the other channel's "About" tab for more info.
Check out my Graphene Computing playlist.
Be sure to check each playlist's description with the "more" button.
czcams.com/play/PLAUtk-Q2DF7yXpZ9mVoTfXdnKVp0SvF4v.html
Graphene playlist.
czcams.com/play/PLAUtk-Q2DF7wXgENPNkvc5JXH5ocia_Fo.html
Photonic Computing playlist.
czcams.com/play/PLAUtk-Q2DF7yx80jrh7uORkHKowzGy7pi.html
Quantum Computing playlist.
czcams.com/play/PLAUtk-Q2DF7zcaxLKdVe7KGlZW6VZBYn6.html
Quantum Teleportation playlist.
czcams.com/play/PLAUtk-Q2DF7zTCO6cHkW-KthScqhyMeNH.html
Quantum Internet playlist.
czcams.com/play/PLAUtk-Q2DF7zyieucbh6bynqYO80kcYX3.html
Spintronics playlist.
czcams.com/play/PLAUtk-Q2DF7zicJm2a61R4BAhekeTF64N.html
All the playlists on the channel.
Be sure to scroll down in this link and click the "load more" button to see more playlists.
czcams.com/channels/B9ezXYprgvhMaPWLhyoJ7A.htmlplaylists?view=1&sort=dd&shelf_id=0
My other channel's "About" tab for more info that is important, and also official website links to the companies from the videos. Be sure to read the info under the About tab first before going to the playlists.
czcams.com/channels/B9ezXYprgvhMaPWLhyoJ7A.htmlabout?disable_polymer=1
Please check out all the playlists on the channel not shown in links above, and each playlist description with articles and info.
Also they found a new way to produce Graphene, called Flash Graphene.
Here are 2 videos on it.
czcams.com/video/hzm5AMPFMqs/video.html
czcams.com/video/GzDrnoGdLO4/video.html
Graphene as a super conductor.
czcams.com/video/HSn57YVDvHg/video.html
Also check out Archer Exploration also known now as Archer Materials, a company from Australia that uses Graphene to make Quantum Computers for room temperature, for our homes.
Check their youtube channel and website, the "Proactive" news channel for the latest updates on them, and when you do a search for that, be careful not to get the wrong Proactive channel, type in something like Proactive Archer Graphene.
I have the videos under my Graphene playlist, and Quantum Computing playlist, be sure to check each playlist description for articles and more info on this.
Archer Materials mentioned in a video interview, "integrating into modern electronics, for room temperature, wide - spread, allows open access to the consumer markets".
And with new materials, this is the key to many "emerging" technologies, Quantum Technologies, and so new materials change everything, like Graphene and beyond that with new materials.
The Graphene Flagship found thousands of new materials made from Graphene, recently.
Here's an article.
www.techradar.com/news/dummy-40-ways-graphene-is-about-to-change-your-life
Also the Graphene Flagship Roadmap.
graphene-flagship.eu/project/roadmap/Pages/Roadmap.aspx
Be sure to check pages back in this news link.
graphene-flagship.eu/news
Graphene Flagship Products.
graphene-flagship.eu/material/GrapheneApplicationAreas/Pages/Graphene-Products.aspx
Graphene Flagship Application Areas.
graphene-flagship.eu/material/GrapheneApplicationAreas/Pages/default.aspx
Graphene and vehicles.
czcams.com/video/JjNrQ3wf3kM/video.html
Skip to (2 : 02) in this video about vehicles with Graphene, and then watch it from the start.
Be sure to check out my other channel's Graphene playlist and watch all videos from top to bottom in that order, the link is located in my other comment above.
Please also check out the rest of the other channel and the "About" tab, the link is located in my other comment above.
czcams.com/video/vlApBbhZoAE/video.html
That melted my noodle a little also... how applicable is that other facets of our lives...
i don't have a deep understanding of Tensor flow because i wrote my own version from the ground up 👍
@@thefootballpunnedit so true brother
"Rewrite more often!" - Less about perfection, more about action, more synchronization to end user needs
4:52 Lex: "So... where does the x86_64 standard come in? Or, how often do you..."
Jim: "I was the co-author of that spec back in '98."
Completely badass.
And by co-authored he means, "I wrote it, and a colleague rewrote it to make it easier to understand for other people" :P
I wasn't even surprised seeing his other accomplishment
My wife makes this point about surgery frequently...she performs surgical procedures that didn’t exist when she was a resident.
Im curious on what you mean by this 🙂 Can you elaborate?
What?
tf 😂
you sound like a lucky man
@@yominorwemajor7235 Means don't trust surgeons words if anything goes wrong.
because they're praised for seeming smart, and we equate complexity with intelligence
Great way of putting it, might steal that one.
I wonder if this has anything to do with group evaluations in schools dragging people into positions they are not capable of handling...
Being smart involves taking a very complex thing and extracting a pattern from it, a.k.a. pattern recognition. So it is partially right.
@@Moreoverover ants are smart, I agree
@@nathankayhan4358 i believe that. one time i worked with this girl who used all these big words and spoke for a long time when making a simple point, i remember a couple times when i sat there knowing her point but waiting for her to stop dressing it up
I've always expressed this as "Architecture beats optimization"
Architecture IS optimization
@@ADogNamedElmo I can't be as optimization depends on something that already exist in order to happen.
@@paulovinicius9940 I think you misunderstood what I said
@@ADogNamedElmo Is but isn't. Architecture doesn't necessarily perform optimally and sometimes has no real point other than personalization. Although I do suppose that personalization in essence is equivalent to optimization for the individual.
Love that quote. Laying out architecture effectively is significantly more optimal than trying to optimize the hell out of something that is fundamentally imperfect
Lex, you and your guests have an undefinable knack of explaining something in a way that the average person can understand what is being explained- without actually understanding the entire topic. That is truly amazing. Thank you
00:00 start
00:38 difference from being able to follow a recipe and seeing the layers of complexity behind the recipe
01:28 When you get to be an expert at something you're hoping to achieve deeper understanding not just memorize a large set of recipes to go execute
02:15 if you constantly unpacked everything for deeper understanding you never get anything done , if you don't do deep understanding when needed, you will do the wrong thing.
03:30 the need of refactor and redesign to achieve a new local maximum since the previous one has plateaued. (every 3-5 years in a non-trivial project)
06:00 a project starts, improves and then improves through diminishing returns. Then refactor/redesign. The starting point will be lower than the past peak, but the peak will be higher.
06:30 Short term oriented business is not going to like redesign.
Lex, I admire your tenacity and strong mindset! The community is growing, keep it up with the amazing work! I'm not kidding, I consider you as a mentor, even tho we never met. I guess this is the real magic of social media.
Thank you for hosting this discussion and sharing it with us. I hope you can keep finding such wonderful guests.
No beating around the bush, the practical objective reality, pure and "simple." (literally simple).
Einstein once said, everything should be as simple as possible but not simpler. Jim Keller's thinking style is just that.
Thanks to Lex and Jim Keller for the video.
This principle has a name! Occam’s razor ^^
Àl0
True.
@@DonArmadillo
This guy looks like a cross between Mark Hamill and Dax Shepard.
😆😆😆
Lol. I couldn't figure out why he looks so familiar. Now I know.
I see a little bit of Kiefer Sutherland in there as well
I see a little of Kevin Costner in him too
🤣🤣 dammit
I love how Jim is refering to human beings as "them"
What are you referring to?
@@vasileturus Us?
@@variator7466 I was asking more to get the timestamp. I agree we should use "us" :). God bless your mind.
@@variator7466 most people on this planet are trash, look at how they are blindly going with this propaganda rona bs virus, I don’t wanna be associated with such a dumb and logic lacking society.
@@Archonsx I hope the irony of your comment isn't lost on you :)
There is something called "deep learning" which means that you not only memorize the "recipe" but also understand the relationship between ingredients, how they connect and affect different variables (ingredients) within the recipe.
Excellent video, thanks for posting, much appreciated. Love your work Lex : )
Thank you for taking the time to do this.
This whole conversation about starting new project at lower level than your optimization point reminds me principle of deload and progression in strength training. One step back, two steps forward.
Actually strength training was the first thing that convinced me and made me truly realize the KISS principle. Now I try to apply it for everything in my life
The energy in this conversation! 😂🥱😴
Jim Keller is a great listen, glad you had him on!
Amazing interview, Jim Keller is an absolute legend! Thank you, Lex
Wow going to watch this full talk. 🙏
These podcasts are great, keep em going!
Very intriguing points: Running projects in parallel as a strategic approach
Great clip from a great podcast!
Wonderful interview. This guy is brilliant!
I guess that’s the beauty of humbly taking it back to 1st principles
One of the best videos, it’s what a lot of people have lost around the world. Details to basics. Losing what real living has to offer. Traversing through constant change rapidly. Major changes creating havoc. It happens on every level. The dangers of young not having a clear path.
i love youtube for all the resource it provides. thanks for all this.
I keep re-watching this. Jim Keller is just so interesting.
People like Jim Keller are the best people to learn from. They are out in the real world DOING amazing things, figuring out problems, solutions, getting shit done. Professors, philosophers, they don't ever need to deliver something, all their ideas are conceptual, never practical. Those who cannot do, teach...
I love his no nonsense approach. You can tell his understanding is deep, he knows it all inside and out. Amazing role model for engineers.
yeah tell that to multi-billion dollar "motivational" industry..
No really although I understand how you might be led to believe that. Professors of all kinds including philosophy professor are required to deliver regularly. Publish or perish is the saying
@@ouimetco A publication is not the same thing as delivering on a real world practical need or function. There are countless publications and journals out there that don't lead to anything.
@@thepunisherxxx6804 yes and there are countless they do lead to greatness. Witness CAS9 and crispr
damn this podcast really gave me some serious insight on how companies like Intel or AMD work. Not only that, you can seriously tell how smart the guy is just from how he says things confidently and how on-point his answers is. Respect for Jim, he's basically what brought us the best in computing as in today, along with his team of course.
I love that idea: every 5 years, do a rewrite. That’s the best way to make things better and simpler over time, even though it’s hard in the short-term.
Beautifully put
Case in point: The Von Neumann Machine. It was supposed to be a placeholder architecture, implemented in the way it was ONLY because of the limitations of the technology of that time.
Fast forward to 2020.....
Taken another way, we're stuck with Ptolemaic Epicycles, until the model totally collapses and it no longer has any utility.
We need a Copernicus.
This is profound. On many levels. Thank you.
This was really insightful.
great talk, fascinating insights
3:45 the rewrite is half as complicated and takes half the time. Rewrite more often! Great tips.
Extremely accurate and applicable to so many areas of life. Well said.
Amazing podcast, keep on going
great clip to share... I shared this exact timestamp already and now they get it cut perfect
Great interview with straight answers!!!!
These videos are getting me hyped on the podcast
Love it, this is the difference between asking how or why.
It's good to keep these things in moderation.
Finding a good balance is hard.
I agree doing something well the first time is going to take way longer than doing something meh and then re-iterating,
since knowing more about the subject at hand is hard without actually tackling it in the first place.
Jim is a really smart dude - cheers for this mate!
The "Understanding vs Recipes" is so incredibly brilliant.
This guy is one of the smartest guys I've ever heard
Buckminster Fuller said the
Same thing :
In , ' Operating Spaceship Earth '
Chapter 2 Origins of specialization . Fascinating.
It makes sense to me, since I am usely like that, but I also get hardly something done, and my hardwork gets ignored too. Gave me bad depression in crucial teen years. Though I learned to not give effs, I will hope to work hard now
Fascinating point about overcoming design plateaus and diminishing returns.
unbelievably relatable. honestly unlike anything ive ever heard for how spot on this is, thank you.
blarg derp Right? Always amazes me when someone brilliant comes along and explains something so simply, eloquent and mind blowing
This is the best CZcams video I've watched in my life; Period! because these guys: "Gets it"!!!
Great content, been talking about exactly this lately and came up to the same conclusions!
@s__n_Ghs_w_J_g_r_v_ well ofc my good sir
Interesting fellow. He's right. The desire to dig down and understand what's actually happening is an attribute of true intelligence. Also, the ability to reduce things to their simplest terms. Too many people over-complicate things, believing that as a sign of intelligence. One of the best compliments I ever received was a technician that told me, "I like working on things you've programmed because the programming is easy to follow, simple, but always efficient and effective".
Sales come from making things look/sound simple and express them to people who don't understand it... that's why engineer are terrible in sales :p and psychology people great at it
i feel so honored!! to hear a man who created my joy as a kid :)!
Congratulations on 1M Subscribers !!
Oh my god. This is so insightful!
If the whole software industry would listen to this man, we just might get something done.
money speaks louder than progress
This is an LGBT phobic statement, and it's probably racist as well.
yes. Frequently, money is only made if progress is controlled and conveniently postponed.
@@BeHappyTo
youtube works? no?
So... we need a new javascript framework?
I heard this guy on Joe Rogan now I can’t get enough 👍
I don’t see an interview with Rogan
lol everyone is searching "Joe Rogan Jim Keller" now... (I did it too)
I guess the OP meant "Joe Rogan Lex Fridman" .. Right?
Someone correct me if I'm wrong. I wanna watch both of them haha
Joe Rogan interviewed Lex Fridman. Jim Keller was not on Rogan´s show.
@@alansmith4655 I noticed that. It seems like it's the go to mic for podcasts, others like Eric Weinstein use it too
@@quantumhealing341 It's probably for the best. Joe's brain would have exploded...
Damn, this talk hit the nail on the head
2:50 - Friedrich Hayek, nobel prize winner in economics, noted in his book "The Sensory order" that there is a fundamental limitation inherent in our brains, which is that our brain is an apparatus of classification, which means that it cannot classify anything more complex than itself. In other words you can describe the principles and patterns of our brains, but never anything in detail. There are quite simply too many variables. This is one of the primary reasons why it is impossible to predict the market in detail.
Jim Keller's Steve Jobs quote is basically what Apple has done since the A6 SoC. The starting point of a new architecture is lower than desktop CPUs, but the ceiling is higher. For years, Apple put big powerful SoCs in their iPhones, often overkill for the applications of the day. All the while developing CPU design expertise subsidized by massive iPhone sales. Then in 2020, wham, the Apple M1 comes out, seemingly out of nowhere, and crushes Intel's best chips at lower power consumption.
Excellent interview ! I see that Jim is now President and CTO of "Tenstorrent" Co. I wish him the best !
I would love to see have Ben Goertzel on sometime Lex! I think it would make for some interesting conversations
Wow. This is really great
Lex you are one of my favorite interviewers!
Awesome explanation, carpentry work is like that, plans anyone can build, repair is a different game.
as an amateur carpenter, I still cling to recipes, but at the margins I'll make adjustments out of necessity.
CPU Jesus Jim Keller is a fascinating individual - the man dug ditches in college and went on the be part of teams that revolutionised personal computing.
Have him on again to give us an update on what's happening in the tech space.
I think the point is that when you are building something each tech doesn't have to have deep understanding of his component, chips etc. However, the person overseeing the project has to see the bigger picture, He must understand the capabilities of each component and how they come together to accomplish the overall mission.
Back to the basics! That's my philosophy when people start complicating things.
David Deutsch wrote a whole book about this issue (The Beginning of Infinity). For tens of thousands of years, humans made very little progress in generating real knowledge, because they did not generate good explanations (explanations that are hard to vary) for natural phenomena, but relied on trial and error to generate rules of thumb (recipes) without any underlying understanding. Only since the scientific revolution has good explanation seeking really taken off.
Love this guy!
A recipe/process is necessary exactly because not everyone gets to be an expert in every field due to resource constraints, so I think these two can not be compared in this way.
I was taught to never rewrite but everything he says on that point makes total sense.
Danke!
thanks lex
Understanding the abstraction rather than relying on black box magic
What's meant by this ?
@@morgenthau5986 Understanding something that's hidden away behind some framework and/or UI instead of relying on said framework and/or UI.
He says exactly what I have been thinking
I made this comment, but i rewrote it before posting it. It was way more efficient this way, the last attempt was two lines.
Seems the people who would be (generally) the greatest asset to an organization are those who can quickly recognize when it's appropriate to use "the recipe" and when it's best to re-engineer/re-design. Most people I know seldom look beyond the recipe.
Seek to understand, not simply to learn/remember.
This is absolutely correct!
Question for anyone who can shine a light: When he says people aren't thinking simple enough, what does that mean in the context of his explanation of deeper understanding vs. recipes?
Searching for deep understanding has always held me back. The relationships between objects and systems has always been much more interesting to me than the objects and systems themselves. Very few people seem to care or even acknowledge that these relationships exist, they just want to tell you more facts about the object. I think the invisible nature of these relationships makes them difficult for many to perceive and easy for them to ignore.
@Thelondonbadger A good idea is only as good as the thousands of follow up ideas needed to make that idea into something tangible and fully functional.
I love cooking and food analogy’s 🍞
pure gold
Congrats on 1 million subscribers. KUTGW.
I love this man
Nice Video!
This is sorta obvious and you can see this on brain imaging when you compare the difference between an amateur at something and a professional. When attempting a task the amateur doesnt know what their doing, they feel more anxious and excited, more regions of the brain light up, they don't know what to focus on. Professional does the same task, they know what to focus on, only a single part of the brain is lit up, as if all the energy of the brain is focused on the one pathway perfect for that task, they're calm, focused, tunnel visioned. etc.
It's not something you canjust do from jump. It takes trial and error.
As a software developer, I like to apply the "start over every n years" to my career. If I don't make tangible progress (salary, skill set, work/life balance etc) in a year (max 2), something has to change. Something being me/my mindset.
I also see the need for a re-write on most projects I have worked on over the years. So many places end up with monolithic systems that have grown over the years and everyone is scared to unpick it cos the guy who designed it moved on years ago. It's funny how most dev teams call them selves agile but can not/will not entertain a fundamental rethink of solutions to problems that really get simpler over time (due to experience and technology advances). I guess this decision rests with the higher ups tho.
So to simplify it, understand the why more than the how but still have the knowledge of the how too fully understand the why.
very insightful/ eye-opening! Ben Goertzel would be a great guest!
Jim Keller: Humans are a mess
Me: reporting for duty Sir!
I know who this guy Keller is. He's a freakin' genius. AMD benefited 40x in the last 5-8 years, basically in large part to him.
watched this 8x in a row.