Video

IDK but I’ve been testing Chat-GPT 4o and its answers are pretty amazing.

Liked, subscribed and followed you on X too, Edan. Thanks for your insights :-)

Training models as you guys are is how humans learn generally

If there's no documentation for the library, what will you train your model on? If there's not enough information for context, how is there enough information for learning?

I would think it's probably more interesting to start with a micro LLM (few Gigabytes weights), to not have to pull the weight (pun intended) of too much pre-learning. I would also avoid to add multiple iterations of a documentation, but only differences after the first learning. There's a lot to experiment, and eventually learn.

That’s kinda the reason why the default education style in the US and probably much of the world is a liberal education. Being well-rounded is important to problem-solving

The problem is research requires logic hierarchies far beyond the capabilitiriew of what AI is doing now with a few attention layers. Continual learning is not solving the problem either. Its just creatung more useful models for non research purposes. Sure some niche advances could come but none of this os real AI or fundamental peogress it is just evolutionary atop the current LLM foundation.

I'm officially a fan of Rich! hahaha a lot of good insights, thanks for sharing!

Utterly without redeeming social value Bury it.

Has anyone built an AI chatbot for a client/ company? If so, I wanted to know if a tool that monitors your AI chatbot for incorrect or dangerous responses and alert the developer and log it when it happens would be useful? Me and my friends had built such a AI monitoring tool for a hackathon and wanted to know it would be helpful for others.

24:11 I noticed that hidden layers combine top-down inputs and bottom-up inputs, but why there are blue arrows for hidden layers to top layers?

I think this was the limiting factor for me trying to build an AI chess coach. I could give it access to chess analysis APIs in-context and explain how to use them, but I couldn’t get it to actually reason about the positions and break them down for a human. Chess was the poetry in your example. Surprised because I’m sure there’s plenty of chess content in the training data for large models, but I guess chess is orders of magnitude more complicated than most topics, so it needs much more targeted and focused coaching data 🤷🏽‍♂️

We dont do continual learning in production not because it is not technically possible, but because it is not economically possible. As always GPUs are the answer. You cant run from the bitter truth.

The credential is nice ... it MIGHT open some doors ... but it's important to establish a lifelong habit of being able to do serious study without institutional handholding. Yes, of course, self-starting is not for everyone ... not even for most ... but consider doing your own AUTODIDACTIC Masters of Science deep dive [on an accelerated, self-paced schedule]. A big part of autodidactic study involves networking/outreach, which means it's up to you to build your own network [rather than having the University furnish connections for you] ... in order to come up with something like a more dedicated, but still ad hoc advisory committee with an appointed a thesis advisor [an co-author] to be on record as having reviewed / helped revise your work [in early draft stage, before polishing and submitting it to Arxiv]... but the outcome is similar; it sort of requires some artifact of your study like a paper with code/data [which you might "publish" on Arxiv or other equivalent channels].

1. 6:07: there's no such thing as _"surpass the human knowledge"_ LLM:s use human knowledge as their database. 2. I'm positive towards LLM:s but we must realize that they are inferior to ourselves, that cannot achieve our precision of thinking, and a tool to shortcut *_some_* research that would have taken hours to perform all by ourselves. 3. we must realize that when using LLM:s we don't train our own vastly superior intuition, and get a lack-of-training deficiency that we need to compensate for later, 4. we are the testers and the reality check: in order to serve LLM:s with new human knowledge, we are morally obligued to publish some of our code OpenSource on Internet for improved LLM:s in the future, 5. when will LLM researchers acknowledge that a better system is when LLM:s interacts with a logic resolver?

Technical question: How do you create the training signal for real time learning while interacting with a human? How do you tell which answers are more successful than others, especially in new situations that have no known answers? In other words: Having the weights shift over time is one thing, but how do you give it direction so it shifts towards the right capabilities? One way I could come up with is that you train it on user feedback, but I don't think continuous RLHF with thumbs up or thumbs down would work. The users don't know yet what a good solution looks like and we don't want to rate things all the time. It's just not practical. So the model would need to learn to recognize other patterns in the environment, e. g. in our ongoing behaviour, indicating whether its output moves us towards a solution. But that pushes the question one step further. How does it learn to assess those patterns? Or is the approach something entirely different? One more thing: Real time learning also sounds a potentially a bit risky in terms of alignment? The explicit goal is to have it change its behavior in real time. We cannot successfully set boundaries on models that are static. What issues will arise with this? How do yo control what it optimizes for in a work environment, interacting with the world and humans in real time?

This to me was one of the big differences between us and whatever LLMs are doing. The model is trained and then static. Any "context" given can be viewed of part of the prompt. It's static. By making the model learn from the world in real time, by allowing to develop in relation to it, it starts to really be in the world. To me, this points to a lot more than just a promising way for better results, it's a philosophical difference.

I'm surprised as to why this kind of stuff isn't more popular on youtube.

sounds like it would be very usefull for devops workflows where a bunch of often poorly documented systems need to be joined together, often by some degree of trial and error

Why use continual learning? After pausing the video my guess is to reduce marginal cost of execution. Instead of context stuffing and consuming that many tokens by embedding the knowledge into the weights it reduces output size/cost

Math literacy, even amongst computer scientists, is needed. Otherwise you think that AI there is real. And just like that lady on the plane said, "that mf aint real".

This sums up my current Evaluation of the LLM hype: those models are limited (by input data, like quality and field/focus). I do not see the hyped exponential growth, just bigger training provided by more data and computing power. And regarding creative and smart combination solutions for (new) tasks, without really good prompting leading the LLM nothing happens in that direction.

I am totally ok with RAG. Specially when context is large. In last project i have 95% retrival accuracy. It is more then just enough

If you continually fine tune then you eventually lose much of what your old weights “knew”. How do prevent over fitting and forgetting?

That fake laugh at 2:42 is cringe af

the first thing that comes to mind when thinking about using continual learning as compared to RAG, is that the LLM is quite like our brains, and we can't effectively retrieve all the relevant information or solve the problem with comparable accuracy if we are seeing something for the first time, even if we have all of the context there is.

I wish this was continued 😭

In the event of pursuing research in the realm of "Theoretical Physics" or any theory-based research that prolongs for decades and decades before a theory is debunked... or until a new theory arises, what effect would that have on a Large Language Model applied to these areas? Having an LLM trained on theories that in the end may prove false would create a "hyper-intelligent" LLM built on incorrect data... would it not? Is this an area of research that allows for the application of LLM's? If so, to what extent? Perhaps this is not an area of research an LLM would even be trained on. I am in no way educated on the subject, but this video did immediately bring to mind those questions. I think continual learning may prove successful only in the event we are continually learning in a direction that leads to a "correct" conclusion.

You'd like to bless the model with better priors, there are some tasks like writing Smuts the model simply can't do. It makes sense to continually train on that, and becomes more important as vision gets introduced as modality.

LLMs do come up with solutions based on mosaic analysis -or combining different relevant assumptions in one analysis. Even for human it is not straightforward. One research paper may take more than five years to complete in certain cases

Domain specific AI trained only on factual data is a great trajectory at this point..

For me, RAG is just cheating. It doesn’t do anything substantial. It gives false hope to people that it’s going to solve problem. It’s always going to be a half baked solution. BUT if your search is powerful like hooking it up to a Google Search, it can be effective and good enough for most use cases. If you are hoping it would solve your company’s dataset or if you truly want your LLM to know it all/have context, you are going to be disappointed.

Current LLMs can only do what has been done before.

I have been thinking about this a lot for a couple months now, would love to chat more with you, just added you on LinkedIn

I was thinking this would be about the censorship 😂 To me as a highly intelligent creative neurodivergent person it’s absolutely insane that they would spend billions to make the greatest creative tools ever in these generative AI’s and then completely hamstring them for anything truly creative by the horrendously stupid paranoid censorship that keeps growing like a cloud from Mordor…. The first company that makes a version that includes the concept of freedom and inclusivity for creative adult people will become the #1 in the field. And they will richly deserve it. I will support them 100% and I would even volunteer and promote them and fight for them. It’s absolutely vitally important that FREEDOM gets baked into AI at the outset-not fear-based despotism and control.

How does your startup avoid catastrophic forgetting when doing continuous learning?

well if you succeed, let me see the research paper once published.Send me a link when its done.

what's the whiteboard tool you were using btw ?

So what’s the solution? Feed it niche documentation and then critique every response as you get them? I.e. provide feedback as you go so you train the model as you yourself learn?

you voiced some of my misgivings about the RAG in-context learning approach 👍

I like the part where it said to email you but then email is nowhere in sight. :)

I keep saying this for ages. LLMs are just that Language Models...LARGE ones. Intelligence predates language. Cats are intelligent, dogs also, some animals show abstract reasoning. Abstraction is a condition for language not a consequence. What LLMs lack is a model of the world that is continuously updated by experience. If you make sitational questions for LLMs they fail miserably (A is on the left of B, all in the corners of a room, etc). IA today is passive: it can't explore the world an test and try it and it will never be able to do that without an internal model of the world that is constantly update by experience. This is intelligence: that capacity to learn and generalize experiences with a *model of the world* , a multi level model of the world with capacity of abstraction: capable to separate properties of objects from objects (consider the texture of a leaf independent of the leaf the color independent of the leaf and generalize this concepts to other objects. It is particularly compelling to study intelligence from the evolutive point of view: why it happened and how. Rodolfo llnás (a researcher that studies the Cerebellum and created a model of it) believes that it evolved because living things that move and need this model to navigate the world and its dangers. This is backed by some beings that have a movable period o their lives and then become sessile organisms and lose their brains after that. this may seem a bias as the cerebellum that llnás brilliantly studied is related to movement, but makes a lot o sense. The claims of sparks of GAI (or whatever the term they used) from the current owners of AI are simply preposterous. But the hype is too loud for anyone to hear. Even Geoffrey Hinton said similar things (although he has some self conflicting declarations). There are some dissonant voices in the choir, a lot in fact but media don't like headlines like "hype unfounded" or "this won't be done with that". Now I will watch your video I needed to take this out of my chest....again.

I have to question whether LLMs - even in their most advanced form - are even plausibly capable of doing what you've declared your goal to be (generating brand new ideas that have never been thought of before). LLMs are prediction engines, and in order to predict, they learn from the past. How can one predict what has never happened, strictly from learning from the past? You might be able to predict that something new will happen, but never what that would be. I su[ppose that could be interesting in it's own right; the combination of factors X, Y, and Z results in a hole in the LLM's prediction. _Humans_ are pretty terrible at this task. Rarely does anyone have a truly new idea. Most of what feels like new is just recycled bits and pieces of old, reassembled into a different whole.

I really liked the interview. Ignore other's comments.

LLMs only imitate, they can't innovate

I think that the key context that needs training that would resolve this issue is a tool that we actually shun in modern society. Im an aerospace engineering lecturer and i preach this tool to all my students. Its the tool that let einstein and newton become household names of genius and innovation. Its how nasa won the space race. The best tool.in the human toolkit for learning... is our unfaltering moron. Gravity was the idea a sightless, senseless thing pulled every single thing to the ground. Einstein is famous for being the one physicist brave and stupid enough to follow through on the idea of "what if time relatively slows down if you speed up" AI need to be able to test utterly random and dumb ideas, even at risk of those ideas and approaches being wrong. You programme an ai with the context of research and innovation being non sensical steps devoid of logic other than a guese when all logical avenues are spent, i think we coild reach an approach that gets us over this hump.

Sparse training data in highly specific problems is always going to be a problem. Its basically where hallucinations come from.

RAG: will they notice we made them answer their own question?

Corporate censorship is what limits current LLMs. That's it.

Anything below a 34B model is kinda stupid. Also I’ve actually had good success with running LLM’s on a mounted tmpfs RAM drive, the speed was pretty higher than that of normal ssd