DLAI Logo
AI is the new electricity and will transform and improve nearly all areas of human lives.

Welcome back!

We'd like to know you better so we can create more relevant courses. What do you do for work?

DLAI Logo
  • Explore Courses
  • Community
    • Forum
    • Events
    • Ambassadors
    • Ambassador Spotlight
  • My Learnings
DLAI Logo

Vishal Yadav, congratulations on completing Evaluating AI Agents!

Evaluating AI Agents
Short Course

Evaluating AI Agents

Learn how to systematically evaluate, improve, and iterate on AI agents using structured assessments.

AgentsEvaluation and MonitoringGenAI ApplicationsLLMOpsMLOpsPrompt EngineeringTask Automation
  • Arize AI
Arize AI
100% Completed
View Course
  • Introduction
    Video
    ・
    3 mins
  • Evaluation in the time of LLMs
    Video
    ・
    7 mins
  • Decomposing agents
    Video
    ・
    6 mins
  • Lab 1: Building your agent
    Video with Code Example
    ・
    16 mins
  • Tracing agents
    Video
    ・
    4 mins
  • Lab 2: Tracing your agent
    Video with Code Example
    ・
    16 mins
  • Adding router and skill evaluations
    Video
    ・
    12 mins
  • Lab 3: Adding router and skill evaluations
    Video with Code Example
    ・
    17 mins
  • Adding trajectory evaluations
    Video
    ・
    5 mins
  • Lab 4: Adding trajectory evaluations
    Video with Code Example
    ・
    9 mins
  • Adding structure to your evaluations
    Video
    ・
    7 mins
  • Lab 5: Adding structure to your evaluations
    Video with Code Example
    ・
    15 mins
  • Improving your LLM-as-a-judge
    Video
    ・
    4 mins
  • Monitoring agents
    Video
    ・
    6 mins
  • Conclusion
    Video
    ・
    1 min
  • Appendix - Resources, Tips and Help
    Code Example
    ・
    1 min