Scaling AI Agents Without Breaking Reliability — Preeti Somal, Temporal
Introduction to Temporal and Reliability 00:01
- Temporal emphasizes reliability as a core value, symbolized by its mascot, the tardigrade, known for resilience
- The company focuses on providing a platform for building reliable, durable, and scalable agentic AI applications
- Agents are complex distributed systems that require orchestration, human interaction, and parallel processing
- Orchestrating these workflows and maintaining visibility and traceability is critical due to system unreliability, especially with LLMs
Reliability Challenges in Agentic AI 01:10
- LLMs and agentic workflows are inherently unreliable, making debugging and testing particularly difficult
- Complex distributed system reliability challenges have existed previously, and Temporal was founded to address these issues
- Temporal's mission is to abstract away the challenges of reliability and scalability so developers can focus on business logic
Temporal’s Platform and Adoption 03:41
- Temporal offers idiomatic SDKs in several languages, with Python recently becoming the most popular among users
- The platform manages all essential plumbing code to ensure reliable execution, offering robust guardrails for developers
- Temporal is a mature, battle-tested product, used in production for over a decade by mission-critical applications
- Companies such as Dust and Gorgeous (supporting brands like Reebok, Timbuktu, and Glossier) deploy agentic AI at scale on Temporal
- Payment processing and other mission-critical workloads also rely on Temporal for reliability and agility
Workflow Abstractions and Developer Impact 06:25
- Temporal abstracts workflow orchestration and error handling into developer-friendly workflows written in code
- Developers use SDKs to define workflows, focusing on orchestrating interactions between users, language models, databases, and tools
- Temporal accelerates development speed, with customers reporting over a sixfold increase in feature delivery velocity
- Scalability is managed by Temporal Cloud, so developers do not handle scale logic manually
- The result is more reliable applications, improved customer satisfaction, and developers able to focus on core business logic
Example Use Case: Ticket Booking Agent 08:48
- Example walkthrough of a ticket booking agent workflow, implemented in code using Temporal’s workflow abstraction
- Key features include user input via signals, the ability to query workflow state, and orchestration of interactive loops
- Temporal manages all retry and failure handling automatically, removing the need for manual plumbing code
- Complete workflow history is stored for visibility, debugging, compliance, and can be exported as needed
- Tools are wrapped as activities, supporting integration of a variety of LLMs
- Rich programming model allows for loops and frequent agent use-case patterns
Temporal Cloud and Developer Integration 12:27
- Temporal Cloud manages all execution state, retries, and scaling, while workflow code runs locally in the user’s environment
- Integration fits with developers’ existing CI/CD workflows, requiring no major codebase changes
- Temporal is open source, with publicly accessible code exchanges for reference projects and examples
- Developers can quickly launch proof-of-concept applications using available credits and examples, enabling fast experimentation
Getting Started and Closing 14:16
- Temporal Cloud is available for sign-up, with credits offered and accessible sample projects on the code exchange
- Developers are invited to visit the Temporal booth (G3) for hands-on demos and further questions