Building and Evaluating Advanced RAG

Instructors: Jerry Liu, Anupam Datta

Enroll for Free

All Courses
Short Course
Building and Evaluating Advanced RAG

Beginner
1 hour 55 mins
6 Video Lessons
4 Code Examples
Instructors: Jerry Liu, Anupam Datta
TruEra and LlamaIndex

What you'll learn

Learn methods like sentence-window retrieval and auto-merging retrieval, improving your RAG pipeline’s performance beyond the baseline.
Learn evaluation best practices to streamline your process, and iteratively build a robust system.
Dive into the RAG triad for evaluating the relevance and truthfulness of an LLM’s response:Context Relevance, Groundedness, and Answer Relevance.

About this course

Retrieval Augmented Generation (RAG) stands out as one of the most popular use cases of large language models (LLMs). This method facilitates the integration of an LLM with an organization’s proprietary data.

To successfully implement RAG, it is essential to enhance retrieval techniques for obtaining coherent contexts and employ effective evaluation metrics.

In this course, we’ll explore:

Two advanced retrieval methods: Sentence-window retrieval and auto-merging retrieval that perform better compared to the baseline RAG pipeline.
Evaluation and experiment tracking: A way evaluate and iteratively improve your RAG pipeline’s performance.
The RAG triad: Context Relevance, Groundedness, and Answer Relevance, which are methods to evaluate the relevance and truthfulness of your LLM’s response.