Partner with us

Save $100 on your pass

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Sai Krishna
Rallabandi
Director, Data Science
Fidelity Investments
Sai is Director of Data Science at Fidelity Investments, leading applied AI initiatives focused on deploying LLM agents into production with robust evaluation, safety, and governance frameworks. He holds a PhD from Carnegie Mellon University's Language Technologies Institute and is a recipient of the Facebook Fellowship, with published research spanning speech synthesis, natural language processing, and human-computer interaction. Beyond his role at Fidelity, Sai develops open-source AI projects, including Judith, a personal AI agent integrating group chats and smart glasses, and Jataayu, a security framework focused on prompt-injection detection and privacy protection for LLM agents.
Button
24 February 2027 12:00 - 12:30
Panel | Is it doing the right thing? Catching agent errors that look correct
AI agents can complete tasks, follow expected workflows, and produce convincing outputs while still making critical errors. Successful execution doesn't always mean an agent has made the right decision or achieved the intended outcome. As agentic systems move into production, engineers must identify subtle failures that traditional monitoring misses. This panel explores how teams can evaluate agent decisions, trace hidden errors, and build safeguards that improve reliability in production. Key takeaways: → Detecting hidden agent failures when outputs and workflows appear correct. → Using evaluations, observability, and execution traces to validate decisions. → Building automated validation, guardrails, and human intervention into production workflows.