Evaluating AI Agents
- IntroductionVideo・3 mins
- Evaluation in the time of LLMsVideo・7 mins
- Decomposing agentsVideo・6 mins
- Lab 1: Building your agentVideo with Code Example・16 mins
- Tracing agentsVideo・4 mins
- Lab 2: Tracing your agentVideo with Code Example・16 mins
- Adding router and skill evaluationsVideo・12 mins
- Lab 3: Adding router and skill evaluationsVideo with Code Example・17 mins
- Adding trajectory evaluationsVideo・5 mins
- Lab 4: Adding trajectory evaluationsVideo with Code Example・9 mins
- Adding structure to your evaluationsVideo・7 mins
- Lab 5: Adding structure to your evaluationsVideo with Code Example・15 mins
- Improving your LLM-as-a-judgeVideo・4 mins
- Monitoring agentsVideo・6 mins
- ConclusionVideo・1 min
- Appendix - Resources, Tips and HelpCode Example・1 min