Ankit Anand
Keynote Speaker
Ankit Anand is a Data and AI executive and Managing Consultant at Syniti. His work focuses on neuro-symbolic architectures and deterministic AI governance, and he holds four pending USPTO patent applications related to Neuro Symbolic AI and AI Token Optimization. He is the author of "The Deployed Data Scientist: MLOps and Analytics in Practice" by Technics Publications.
Title: The AI Memory Crisis: Why Agentic Systems Fail in Production and What to Do About It - Abstarct: Enterprises are racing to deploy autonomous AI agents into core workflows—financial audits, compliance reviews, product configuration, and multi-tier supply chains—only to discover that systems that look precise in testing quietly degrade in production. Drawing on seventeen years of building enterprise data systems across regulated industries and current research for my forthcoming Harvard Business Review article “The AI Memory Crisis,” this keynote will argue that the failure mode most leaders are seeing is not primarily a model or prompt-engineering problem, but a structural memory problem in the underlying hardware architecture of large language models. Today’s agentic systems rely on a single-tier KV cache in high-bandwidth GPU memory to hold everything an AI “knows” during a workflow: governance rules, schemas, access policies, and conversational context. As context grows, this cache scales linearly until it is forced to evict content with no concept of the difference between what is old and what is non‑negotiable. The result is an invisible form of drift: agents begin approving what they were designed to block and forgetting constraints they enforced correctly days earlier, all while continuing to produce fluent, confident outputs. I will introduce a new hardware–software co-design architecture, the Neural‑Holographic Cache Controller (which is pending patent), which physically separates structural business logic from conversational noise before it ever reaches the memory hierarchy, I will show how this architecture changes the engineering trade-offs for AI/ML teams and why neuro‑symbolic memory design is rapidly becoming a first-class concern in AI/ML engineering, MLOps, and intelligent software architecture. The session will close with three actionable decisions for CTOs, chief data officers, and AI platform leaders: how to reframe AI infrastructure budgeting around memory architecture, how to build determinism standards into AI governance for high‑risk workflows, and how to evolve roadmaps toward neuro‑symbolic capability rather than model scale alone. Attendees will leave with a concrete mental model and design vocabulary for diagnosing AI memory failures in their own systems, and a practical path to building agentic AI that can actually be trusted in production.