Self-reflective RAG with LangGraph: Self-RAG and CRAG
Vložit
- čas přidán 6. 02. 2024
- Self-reflection can greatly enhance RAG, enabling correction of poor quality retrieval or generations. Several recent RAG papers focus on this theme, but implementing the ideas can be tricky. Here, we show that LangGraph can be easily used for "flow engineering" of self-reflective RAG pipelines. We provide cookbooks for implementing ideas from two interesting papers, Self-RAG and C-RAG.
Code:
github.com/langchain-ai/langg...
Excellent breakdown! This video really helped me grasp the concepts, and it's one of the first Langchain videos that clicked for me. While Harrison's brilliance is undeniable, Lance, you're truly a great teacher.I love your approach of using diagrams to break down complex code into easily understandable logic. It really enhances the learning experience!
Thank you. This video was informative. Your explanation was clear. For me personally the examples that us local LLMs are interesting. Thanks once again.
great video Lance! The way you diagrammed the flow made it easy to understand the concepts.
This is sooooo cool 🤯
And I love that you guys are putting out all these educational videos - thank you!
Thanks Lance for more one great tutorial! Really useful and easy to follow.
Lance, you are great! Thank you for your splendid video!
wow. Excellent demonstration.
Great tutorial. Keep up the great work!
Really great video! Keep 'em coming
Thank you for the great explanation!
Please record your videos in 1080p
(This is Lance, guy in the video.) Good feedback. I record w/ Loom. It was a UX issue w/ Loom where vids were not defaulted recorded to 1080p. Apologies!
Excellent !
very helpful! thank you.
Great video! I have a question about recent RAG papers which talking about RAG paradigms such as advanced RAG and modular RAG. Could we say that using LangGraph have we applying modular rag? I’m not sure in which paradigm fall self rag and crag.
Thanks!!
Wooooo Skynet wooooooo
Thank you for breaking this down!
Is there a way to do cyclical/iterative agents when one produces an answer and the other checks the answer, and if not correct/satisfied with it, sends it back to the first agent to produce a better answer?
Thanks for that ! Do you have a video that helps build an ui associated for prompting ?
Hi, I have one question here related to the Retrieval Evaluator. Let's suppose we are not allowed to do a web search. Can we again play around with chunking and different retrieval methods?
Very interesting, I assume this would have very long response times?
(This is Lance, guy in the video.) I'm running on a Mac M2, 32GB. Latency is ~5-10 sec for final generations.
@@r.lancemartin7992 lance from langchain has a nice ring to it😅😂
Do you have any resources for deploying this type of solution on AWS/GCP?
at around 13 minutes, based on your story i would assume that it wouldnt run web search as there are at least a few documents that are relevant, but as i understand even if 1 of the retrieved documents isnt relevant it will do a web search?
(This is Lance, guy in the video.) Yes, with this logic it will do web search if *any* documents are irrelevant.
What are other possibly ways to utilize this on a local database? I mean, if there are no relevant docs what it can do?
is thsi still effective with conversational memory?
Lance - isn't the workflow you outline here a DAG? The LangGraph docs are very explicit about not using LangGraph for DAGs - can you help us understand this nuance?
"The main use is for adding cycles to your LLM application. Crucially, this is NOT a DAG framework. If you want to build a DAG, you should just use LangChain Expression Language."
How to deploy langgraph using langserve, can you please help me do it?
I'm working on developing RAG Application on CSV File. It is working fine for some queries, but queries like
1. Get total count of persons
2. Get average salary
These type of questions that include to search all the rows of the given document Is not working fine. Is there any fix I can do or Implementing RAG is not a correct option.
Are you using csv agent for the solution you built? if not, then you can try either csv agent or pandasAI.
What worked for me was converting my CSV / multi page xlsx into a minimal database
And then query that database, SQL queries worked much better for me
It works for csv's but if it's pdf @tushii
@@sridevigogusetty8371 what would you like to do with your pdf ?
@@Tushii for example if I have some pdf which has financial transactions of i want to query how I will convert that to db
The video was great, thank you. Small comment about something that puzzled me. If you don't abbreviate documents as docs. Please don't use dic(t) for dictionary. I'm sure I won't be the last wondering 😅
(This is Lance.) Ok!