AI Evals: Essential for PMs Building AI Products

If you’re looking to sharpen your product thinking or build confidence in real product decisions, this session gives you the clarity most professionals lack. Learn how modern Product Managers think, use AI effectively, and turn everyday work into stronger product outcomes.

  • May 21, 2026 (Thursday)
  • 8:30-10:00 pm IST
  • Online
Register Now

What will be the coverage

Are you building AI features or products but unsure if they truly work as expected? AI evaluations (evals) are the key to measuring performance, reliability, and real-world value.

This session explores why Product Managers must prioritize AI evals, the core components and considerations involved, practical tools and frameworks, and high-level use cases for Conversational AI, RAG Systems, and AI Agents. You’ll also get an overview of automations for testing and monitoring to ship better AI products with confidence.

Agenda

Welcome + Introduction

What are AI Evals & Why PMs Should Care

Key Components and Considerations for AI Evals

Tools, Frameworks & Best Practices

Use Cases: Conversational AI, RAG Systems & AI Agents

Automations for Testing & Monitoring + Q&A

Agenda

Welcome + Introduction

What are AI Evals & Why PMs Should Care

Key Components and Considerations for AI Evals

Tools, Frameworks & Best Practices

Use Cases: Conversational AI, RAG Systems & AI Agents

Automations for Testing & Monitoring + Q&A

Speaker Details

Chaitali Deb Purkayastha

Associate Director

Novartis

Chaitali Deb Purkayastha, Associate Director at Novartis where she leads global Generative AI product initiatives, focusing on AI governance, product strategy, and end-to-end GenAI solution architecture. She drives the adoption of advanced AI technologies to build scalable, customer-centric solutions across global teams.

Previously at MetricStream, Chaitali led the Compliance Management product suite and spearheaded the creation of the first Generative AI–powered GRC portal. She played a pivotal role in implementing AI governance and risk frameworks, managing a global BFSI customer base, and driving initiatives that reduced churn while enhancing product impact.

Key Takeaways

  • Understand what AI evals are and why they are critical for Product Managers
  • Learn the key components and considerations when designing effective AI evals
  • Discover practical tools and frameworks to implement AI evaluations
  • Explore high-level use cases for Conversational AI, RAG, and AI Agents
  • Get insights on automations for continuous testing and monitoring of AI systems

Save Your Spot

₹ 149
  • ✔️ Free for PLF members
  •  
  •  
  •  
Register Now


Add Your Heading Text Here

Affiliations, Accreditation & Eco-System Partners

Copyright © 2026 Product Leaders Forum