🤝 💻 LLM: Lackluster LLM Maintenance **

Our industry has evolved to incorporate AI in our products. AI can deliver innovative new features but also presents operational challenges. This session goes into how we can identify and mitigate operational challenges with AI starting from how we design our products. Drawing from real experience building large‑scale AI‑powered features across different domains, this talk explores practical strategies for designing systems that remain stable when incorporating LLM unpredictability in software architecture. We’ll cover multiple architecture iterations and how to design products and software to build an excellent user experience. Attendees will come away with a list of questions to consider and architecture templates for building applications that leverage LLMs.