How Your Brain Organizes Information
Vložit
- čas přidán 31. 05. 2024
- To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/ArtemKirsanov/
The first 200 of you will get 20% off Brilliant’s annual premium subscription.
My name is Artem, I'm a computational neuroscience student and researcher. In this video we talk about cognitive maps - internal models of outside world that the brain to generate flexible behavior that is generalized across contexts.
Patreon: / artemkirsanov
Twitter: / artemkrsv
OUTLINE:
00:00 - Introduction
02:08 - Edward Tolman
03:48 - Zoo of neurons in hippocampal formation
06:40 - Non spatial mapping
08:21 - Graph formalism
12:21 - Latent spaces
17:22 - Factorized representations
21:51 - Summary
24:47 - Brilliant
26:19 - Outro
REFERENCES (in no particular order):
1. Behrens, T. E. J. et al. What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior. Neuron 100, 490-509 (2018).
2. Constantinescu, A. O., O’Reilly, J. X. & Behrens, T. E. J. Organizing conceptual knowledge in humans with a gridlike code. Science 352, 1464-1468 (2016).
3. Aronov, D., Nevers, R. & Tank, D. W. Mapping of a non-spatial dimension by the hippocampal-entorhinal circuit. Nature 543, 719-722 (2017).
4. Whittington, J. C. R., McCaffary, D., Bakermans, J. J. W. & Behrens, T. E. J. How to build a cognitive map. Nat Neurosci 25, 1257-1272 (2022).
5. Whittington, J., Muller, T., Mark, S., Barry, C. & Behrens, T. Generalisation of structural knowledge in the hippocampal-entorhinal system.
CREDITS:
Icons by biorender.com and freepik.com
Brain 3D models were created with Blender software using publicly available BrainGlobe atlases (brainglobe.info/atlas-api)
This video was sponsored by Brilliant
To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/ArtemKirsanov/.
The first 200 of you will get 20% off Brilliant’s annual premium subscription.
Hey Russians I have a Question Only you Can Answer:
Why if Brain shows Regenerative Processes in Delta Waves during Delta wave Sleep, Telomerase that is one of the most important Regenerative Processes, if not the Stem of them all, induce a Rem Fase, Deeply Disturbed Sleeping time..?
It is just Circadian Rithm ?
I am Just too Sick ?
[That is Most Definitely, but I Read other reports]
Ergo if Delta is The Most Regenerative Status for our Brain's why Telomerase bring up the Wavelength to Something more Comparable to Rem Fase..¿
Synaptic Hyperactivity?
It isn't necessarily a Bad Thing...
Mullis Discovered PCR with that..
Just Saying..
Where is the evidence for "generalization"? And why would we need to generalize, when using "indirection" (as programmers use pointers) would accomplish the same thing with less work?
Artem, please consider changing the design. The pitch-black background and scorching white are hurting my eyes. I know, it’s fashionable, but for viewers with astigmatism, it’s torture to watch. I know, I belong to a minority, just spreading the word. Still, I’ll listen this video till the end.
Did you finish your degree? I tried looking you up on LinkedIn but couldn't find anything. Apologies for the intrusive question, but I promise it's for a good reason. More of a potential collaboration.
structure and location are different? everybody knows that? can you explain the point of over 25 minutes talking about what it is like to walk around?
wait are you telling me there is an arbitrary hexagonal grid of points in my room where specific cells light up the most?
you wouldn't think of it like that, but you can feel where you are in space if you walk around your room with your eyes closed, right? thats probably the sense of the different levels those cells have.
@@xymaryai8283 I think it’s more like your brain compartmentalizes different areas of the room. In real life, your room is one continuous space, but our brain may think of it is different sections as we a
walk around the room.
It's actually many grids with different scales, rotations, and offsets, but yeah.
Yep :)
I'm not sure whether "arbitrary" is a good word, though, since we don't really know how random they are.
But yeah, as Ryu has mentioned in the previous comment, there are different modules of grid cells that tile the space with hexagonal patterns of different scales and phases in order to uniquely pinpoint your location
Replace Rat 🐀 with Pigeon 🐦. Some Beehive 🐝 and Ant Colonies 🐜 visuals can help in study and understanding the abstraction concepts.
I'm a postdoc in the intersection of neuroscience and AI, specifically about the generalization subject, and I just want to say that you are doing an amazing job communicating scientific discoveries, which is specially hard for things that happen in the brain. Huge congrats.
Neuroscience MSc here - couldn't agree more! This is excellent stuff.
There's no such thing as A.I. it's a misnomer to describe algorythms and machine learning which is nowhere in the realms of intelligence...
@@spectrumofreality long discussion. Intelligence can be defined in a variety of ways.
Im tired of having this discussion, usually with people that thinks that they have all the answers already, dismissing a lot of different possibilities.
*concepts do not need clarity for meaning*
Think in the word "game" - an everyday word and familiar concept that we use all the time and generally don't have much trouble with, but which, under scrutiny, is very hard to define precisely
You can find a variety of games... ball games, card games, games of change, games of skill, scored & unscored games, turn-based games, timed games, etc.
For any explicit definition of "game" you might offer, we can find a counterexample that doesn't satisfy your definition, but which is still a game.
There is no core "game-ness" concept that separates games from non-games, and there does not even appear to be any features or qualities that all games have, or that all non-games lack.
This is relevant, the lack of precision does NOT mean the term "game" is meaningless, a dog is not a game, a tree is no a game, the Superbowl or the world cup final is a game, we can agree on that.
The concept of "game" has fuzzy boundaries.
The same is true for "understanding", "thinking", "intelligence" etc - if we define them to mean "in the exact way a human brain does”, then AIs will never qualify, but even more drastically even if you define intelligence based on several properties of humans, it is possible that you will rule out several cognitive processes of humans that don't get into your definition, but that can be considered intelligent under a slightly different one, that applies also for differences in biological species , some species do things that we can only dream with, involving several computations that we don't do, but we agree that humans are still intelligent, and that animals are intelligent.
Well, moving far from agency problems, machines using AI clearly share some similarities with processes that happen in the brain, at least algorithmically, and exploring those similarities and obviously the differences, can help us to understand our own intelligence.
So I never follow when a smart guy comes and say: "you are dumb, this is X and that is Y". When this debate is way more complex than that.
Greetings.
@nunezkant9835 what a lovely simile. Never heard it put quite like that.
@@spectrumofreality You must be fun at parties. And what are you, 14? No way you just said that to a literal doctor, thinking you're being smart.
Amazing video! Neuroscience for those of us without a PhD -- explained as simply as possible but no simpler. It's so fascinating to me how complicated the brain is, and yet it has these basic building block structures that we can actually make sense of.
Thank you! I'm really glad to hear that!
@@ArtemKirsanov do you think these concepts this could be applicable to the design of AGI systems?
You don't have to be a neuroscience major to know this lol
@@petricor1420 fascinating and useful comment
@@lydianlights it’s ok, he even spelled his own username wrong
This videos, apart from having concise and beautiful animation, really get to the core idea of explaining the subject. Keep going, you are doing an amazing job at neuroscience divulgation
Thank you!
core of the idea of walking around...
@@ryanbillie7708 what do you mean ?
@@waydenrd4539 was anyone on earth surprised it needed different cells for different things?? Seems like this whole video could be covered in 10seconds
Somehow it's all drastically obvious, since you're explaining the simplest way to learn, yet simultaneously it's very fascinating to learn these basic methods.
The most curious part is where this "grid" comes from. Since many things don't need to be "relearned" does that mean these are impressions from the regularized, physics based world around us? Or is it something like a rhythm, say a cycle like the heartbeat sending signals in a relatively regular pattern that creates this "grid"?
@@CarlosVixil Surely any periodicity, external or consequent to the system itself, can be used as a grid -- no need to pick a single source.
AI/HPC researcher here.
I just love how you integrate neuroscience, math, physics and computing in your stubs ❤
Greetings from Brazil
hu3 hu3 teach metal brain how to samba.
@Moonlight Gamers he clearly said "HOW" he integrates not "THAT" he integrates.
@Moonlight Gamers you clearly are not understanding what he meant to say... i dont know if you just want to criticise for the sake of criticising or... what he meant to say is that he likes the way he connects the broader field "neuroscience" to the minor fields "physics", "maths", etc... for example: i like the way you integrate calculus with trigonometry. I can infer from this statement that the person likes the lecturer's capability to show or explain aspects of calculus (broader) through a trigonometric (minor) lens, or aesthetic. Its not that deep.
@Moonlight Gamers yes i understand, but trust me my guy, i think youd be better off treating people with politeness and altruism, you'll find maleficent and benevolent souls in all areas of society.
I've been teaching this subject matter for three years, and you've done a great job of simplifying the subject.
is this video really just talking about walk it is like to walk around?
@@ryanbillie7708 no it's using that as an example. perhaps you missed the audio reference as a complement. The video is describing how our brains work. So far he has presented how we can start to think about this. One way is to say the brain uses "1-dimensional" data sets to simulate other possibilities without actually experiencing/creating memories of those possibilities.
@@CarlosVixil But... but walk...
Thanks!
Wow, thank you!!
Thank you so much for all the effort to make these videos, I found your channel yesterday and is amazing, it's one of the best I've seen on CZcams, especially this video. I loved the way you explain all these abstract mathematical concepts in such a clear way. Greetings from Chile!
thank you for taking your viewer's suggestions into account! I especially appreciated the explanation of factorization
Excellent editing skills, second only to your depth and exactitude. I am inspired to delve deeper into these topics and find the commonality between this and contemporary QM
This is really interesting when applying it to sport. It may explain "home ground advantage", and certain training strategies that could aid with spatial awareness despite sporting locations.
This content is so good I draw mind maps and summarise on a massive whiteboard while I listen to you. It’s great content, thank you.
This video is amazingly clean and beautifully put together/choerent. I am appalled this video (and the rest of your videos) don't have millions of views (yet). Even if I have barely any hope of understanding most of what was said in this video, you came as close as possible to making me I think I do. And either way, if this entire video was in a completely foreign language with no subtitles, I would still have watched the whole thing for the visuals alone. Fantastic
Artem, mate, your videos are just amazing. You are the future of education. Keep up the stunning work!
3:14 -- Amazing transition: visuals + voice + story flow work perfectly!
Your visual and verbal explanatory ability are absolutely masterful.
14:01 “To completely capture all the relevant information about this task you need a configuration of a cognitive map which keeps track of both the location in the physical 2D space of the maze and a binary location in this abstract space of left and right trials.”
No, you don’t. All the rat has to do-and probably does-is behave _with respect to the space,_ specifically the walls of the maze and itself. When it reaches the point of the T where it can no longer move forward, to get the reward it turns one way or the other. It turns the opposite way with respect to itself from that in which it turned in the previous trial. That’s a far more parsimonious and likely explanation. There’s no “cognitive map” keeping track of “the location in the physical 2D space of the maze” or “binary location in this abstract space” required.
Awesome presentation, thanks for sharing.
Yet another outstanding video. Thank you for making such high quality content.
I look forward to the second part discussing the Tolman Eichenbaum Machine. It is especially interesting, considering they were able to replicate the results by modifying a transformer, the backbone architecture to popular LLMs such as ChatGPT.
Again thanks for providing the highest quality computational neuroscience content on youtube
Fascinating and visually stunning video, as always. Thank you Artem!
This is such an excellent summary of the field's findings, well done!
Wow, what an amazing video, very well explained and simplified just in the right amount so that we can understand it but we know there's a lot more about the subject to be studied.
Great job man, these videos breaking down how we learn at a fundamental level are really helpful for creating better studying techniques.
Thank you and keep it up!
This video was fantastic! The visual models really helped me get a good grasp on all of these unfamiliar concepts. Thank you!
The production quality on this video is incredible. Amazing work
Fascinating video! Next year I am going to college to study cognitive science. So as a request for future videos, I would appreciate it if you could further explore the interdisciplinary nature of neuroscience because it would nicely complement what I learn from my studies. Thanks
Thank you so much for making this video! It helped me finally understand what makes me so interested in neuroscience, AI - the principles that let things organize themselves. Great job, I’ll have to do some further reading!
Nice! I was asking about just this in one of your previous videos!
Wow, very interesting video! The visuals help follow along. Great job!
Wow. It's an amazing work. Thank you for sharing it with us!
Hey, I appreciate you citing the sources in your description.
Thanks for presenting such a cool topic in such an accessible way! Your clear explanations and engaging visuals really made a complex subject easy to grasp. Fantastic work!
Amazing video! Thank you ❤️❤️
I believe that it would be more correct with regards to factorization that the categories are: (1) object qualities and (2) valuation/dynamics, not "sensory". All organisms use their senses to discern features or qualities, but then must relate these to valuation and dynamics within a context. The term sensory as used in this video would be imprecise within the discussion of factorization. How one "feels" about something is grounded on the recognized valuation within a context.
The hippocampal formation also includes the subiculum and the dentate gyrus, besides the hippocampus proper and the entorhinal cortex.
absolutely stunning work. Congrats once again! I think you have found your calling.
Excellent production. I thoroughly enjoyed this. Everything about the brain is so fascinating.
Thank you for a great video! Looking forward to the next part!
Super informative videos. Good work.
Another brilliant video Artem. Love what you are doing!
Artem, you absolutely set the bar for sci-comm on CZcams. I truly haven't seen anyone better.
Thank you ❤
this is incredible, now that i'm aware of the system you mentioned, about the hexagonal points in space mammals seem to use to find their way, i can *feel* them as i move around.
Just fell in love with a new channel here. I love the graphics.
Hi Artem! Great video on a challenging topic. Congratulations! I like that you represented the different types of cells in the entorhinal cortex-hippocampus system as a way of a brain to label any context, whether it is qualitative relations, organization of a space or decision making. I am not a specialist in electrophysiology, but recall there were also papers on “time cells” encoding events in time. I recall my feeling from reading them - it was clear to me that it is more than simply way to encode separately different modalities in the environment but rather a way to organize it utilizing different properties. Since then, I did not follow this line of studies. And it is cool that you put the current understanding of this area together in this video.
I have a critique though. To me, your example of cooking lasagna at home vs at a friend’s kitchen is somewhat confusing as an illustration of brain’s ability to generalize (adopt). The fact is that if we want to illustrate the generalization of a cooking skill, then we must show that a person can cook lasagna from different ingredients. Whereas if we want to illustrate the generalization of a skill to navigate in a different space of a friend’s kitchen (with a complex mix of similar and dissimilar properties) then (as in your example) we may show that a person can recognize and discriminate tables, stoves and refrigerators. In your example, everything is a little bit mixed together.
Anyway, consider this as a minor revision! Overall, a solid and inspiring video!
Cheers!
Wow, such a great video! Many thanks!
You, my friend, should be regarded as an international treasure. Im speechless at how great this video is in all facets i can think of right now. Thank you!
Thank you for such great video!
Thank you for sharing your knowledge
Quality of content really improving together with accuracy of animation, making videos more interesting and clear, very good job man!
Thanks!
Great summary in the end.
Hey, that's stuff I've been working on for the past couple years, although in relation to artificial neural nets! So nice to see it works the same way with brains, haha!
I am asking myself all the time how much knowledge is transferable between neuroscience and transformer-based networks, because it seems like A LOT. I guess knowing both is like being bilingual.
This is why, if you haven't yet, you may be interested in "Topology of Deep Neural Networks".
Also, you should try interrogating GPT-4, it interpolates between the two disciplines very well and it's a lot of fun!
Thank you! I've just read the abstract for the "Topology of Deep Neural Networks" and it sounds like an incredibly promising approach! Can't wait to read the full paper!
When I first saw the title I thought it was about the topology of the networks themselves (in terms of connectivity between the layers), rather than how the _topology of the data_ changes as it flows though the network. So personally I would have named the paper a bit differently, but that's just nitpicking :D
Perhaps you would be interested to know, that the Tolman-Eichenbaum Machine - a computational model of the hippocampus and the topic of the next video - is actually a modification of a *Transformer network* ! I'm not sure whether I'm going to dive deep in this equivalence in the upcoming video, but here's the brilliant paper about relating Transformers to hippocampus, where they show that when the model is trained to navigate on graphs, grid, place and boundary cells emerge naturally: arxiv.org/abs/2112.04035
@@ArtemKirsanov Thank you, this looks very interesting, and I never knew this model existed.
I'll do a first read today, sounds very promising!
@@ArtemKirsanov A few days ago, I asked Claude+ "What does physically happen in your brain, when after having exerted a prolonged mental effort you feel unable to focus?" and look at points 4-7. They look very interesting in light of several of your videos.
Claude+:
Several things are likely happening in the brain when mental fatigue sets in after prolonged mental effort:
1. Depletion of mental resources: The brain requires glucose and oxygen to function properly. After prolonged mental activity, the brain's stores of glucose and oxygen can get depleted, leading to fatigue.
2. Buildup of waste products: As the brain is active, waste products such as lactate accumulate. Too much buildup of these waste products can impair brain function and lead to fatigue.
3. Neurotransmitter imbalance: Prolonged activity can lead to depletion or imbalance of neurotransmitters such as dopamine that are important for attention, focus and motivation. This can contribute to fatigue.
4. Decreased activation of attention networks: Parts of the brain involved in attention and focus, especially the dorsolateral prefrontal cortex, show reduced activation after prolonged mental activity. This makes it harder to sustain attention and concentrate.
5. Increased mind wandering: When mentally fatigued, there is more erratic activity across multiple brain networks, indicating increased mind wandering and distractibility. This makes it difficult to focus.
6. Altered brain wave patterns: There is a shift in the brain's electrical activity or brain waves, away from more alert patterns to slower waves as fatigue sets in. Slower, more irregular waves are associated with lower arousal and alertness.
7. Disrupted neural connectivity: Temporary mental fatigue may alter the levels of connectivity between different parts of the brain, disrupting optimal communication and coordination between brain networks. This impacts attention, focus and other functions.
With rest, all of these changes are reversible as the brain restores its mental and metabolic resources. Getting adequate sleep, taking breaks, and reducing cognitive load can all help prevent and relieve mental fatigue.
@@matveyshishov or you work through that mental fatigue and wait till your live does its damn glycolysis work.
Nah kidding this is great because I've been forcing myself to focus on this video right now because mental fatigue did set in.
But i also thing that it's attention span based, lien you say wandering off, i wander off seeking the next thing that would release more dopamine than previous.
So yeah it's depletion of Neurotransmitter but it's also based on learned imbalance, meaning other shit is more tempting and will release the dopamine needed to keep going isntead of focusing and having that delayed more longer reward pathway going.
This is why I focused on that video, and reading and writing this comment give me the closure i need for my brain to be more sure through a successful task that it was worth the forced focus amking more apt to have higher attention spans in the future. Do thanks for providing me that actionist with your comment. Haha
Great explanations. And awesome animations.
Impressive! I’m a M1 student in Neuroscience who’s interested in the computational aspect. Your contents are very helpful !
Impressive quality! Can't wait for part 2. If you've heard about Vicarious AI (which is trying to solve some of the things talked in the video) would love to hear your thoughts about it.
This is such an excellent summary of the field's findings, well done!. This is such an excellent summary of the field's findings, well done!.
The visual and explanatory parts are insanely good! ✨
Thank you for the quality content 😊👍
great video! i'm learning vector algebra rn and it helped a lot in understanding this!
Thanks for providing this knowledge
As always great stuff! This one particularly was amazing
Excellent content! I would be very curious to see how this research is conducted, like how do you record neural activity of a mouse brain while it's moving through a maze? Maybe you can make a video about your lab at some point?
Thank you! Totally, I was actually considering making a video like this for quite a while :)
I agree, it would be more engaging to film a video like this in a real lab. Right now I'm finishing my bachelor's degree (which is mostly computational) and transitioning to begin experimental work in graduate school this fall.
So, hopefully, at some point, I would be able talk about the experimental side of things first-hand 🐁
Great video. I will definitely be looking forward to the rest of your videos.
Hi Artem, thank you for your fantastic videos! I really enjoy them and admire your ability to explain visualize such topic so elegantly and comprehensive! Brilliant visuals!
Small glitch at around 10:43 path integration: East arrow points West.
This is what I'm talking about! It's very rare to find videos that talk about the mechanisms of function in the brain - they're almost always purely empirical and focus on biology (i.e. this part of the brain is responsible for X etc), or very vague and broad without really suggesting any specific mechanisms of cognition.
Keep em coming & thanks for posting!
Btw I would love to know your thoughts on H.M. and how he remained cognitively normal despite destruction of hipp, and the anterograde amnesia. And perhaps the mechanisms of voluntary control in relation to memory formation and lookup.
I have to say the production of your videos is superb (I can't think of another word). Well structured and animated.
The only presentation tip I could give you, is to use short pauses on the conclusion and on important notes or exciting facts.
Otherwise perfect!
crazy good video. best channel on youtube to explain neuroscientific topics. hope you will gain more attention
Exceedingly professional work!
This was absolutely incredible and mindblowing
Two things that came to my mind.
1. This video reminds me of when I studied Kant's Aesthetics and philosophy in general during high school.
2. Now I wonder what goes on in a mathematician's mind when he's writing a proof to a theorem, or a surgeon applying his knowledge to a case he's going to operate.
It's videos like this that support some personal theories about the world and natural laws, that touch on other theory's, and then leave me with a better respect for what it all is. Humbling myself in the pursuit of better understanding. Thank you.
Wow thanks for this excellent video!
Awesome video, cant wait for more
This is mental....amazing work!
10:37 i believe the intention was to have also E and W going in opposite directions 😂
Amazing summary!
Absolutely wonderful liked and subbed!
Thank you Artem
ngl super super super underrated channel... i never noticed before... keep up the insanely high quality work
Just commenting to say I thoroughly enjoyed this video. More power to you.
Amazing visualizations. As someone looking to teach through youtube, I'm definitely taking notes.
Great video as always
Keep up the work, you are one of the top science youtube channels!
AMAZING VIDEO! keep it up brother!!
I'm always very impressed by these videos.
Great video, It has increased my curiosity in computational neuroscience...
Beautiful animation and explanation, you would make an amazing professor.
Exceptionally good visual aid in this video, nice!
Thanks for this high quality video clip！Both interesting and informative🎉🎉
And re- subscribed to the Brilliant premium😂Reinforcement Learning course looks so cool！Thank you for the recommendation❤❤
good video! Thanks share
lovely visuals.
What are your thoughts on the Forward Model mechanism for planning and coordination? I'm wondering if you can also make a video explaining the relationship between cognitive map and FM. Thanks for making such amazing content!
Your videos are incredibly interesting and beautifully illustrated, makes 25 minutes feel like 5. Amazing stuff!
Thank you!
what was the point of this video, can you help me out seeming like he takes 25 minutes to say "its totally different for you when you walk around"
@@ryanbillie7708 I have no idea what you mean
amazing video! well done
Amazing work, hope this blows up soon
Really interesting, thanks for your work!
But I feel you didn't mention an important point; quid of the mapping between the environment and the enthorinal cortex?
If you have a small environment or a big environment, does it mean the hexagonal pattern becomes sparse, relative or just repeats? What if you stretch or contract the environment?
Then quid of the unbounded walls (like the horizon)? How do you properly map such a situation ad infinitum?
And I'm also wondering; what about those directed mapping relatives to objects? Are those objects maps then a direction is added? Are all directions consider (which would be an ad infinitum problem as well), only a few of those or only one? If only one is considered, is it determined relative to us or relative to it? And would that be why we have this tendency to put a front and a back to everything? What about a sphere?
=> As I can picture that there is a part of the sphere facing me and as I can consider that people have a front anyway if they're facing me or are not part of any scene (like people represented in my mind independently of what they're facing; I would guess that either we have both direction existing or we can switch to both and integrate the information of where's the front and what is it facing in a more complete representation)
That opening line itself made me subscribe. Flexible behavior generalized across contexts. Chef's kiss.
I’m so lucky this video popped up in my results, thank you and more please:)
Very nicely explained and interresting, just a little detail that I guess nobody noticed.. or was it on purpose to demonstrate what the brain is capable of.... at 3:45.. "neural represenations"...
I have subscribed and eager to learn more, thank you very much for this good work of sharing knowledge to everybody!!
the title of this video really made me think you were gonna talk about the recent Tim Berhrens paper on HPC and mPFC representing the specifics and the generals of tasks… but nonetheless, nice video.
This is so cool, can't wait on part 2
Incredible quality