When AI Optimizes for the Wrong Objective #aifails
The transcript introduces 'intent engineering' as a third AI discipline focused on encoding organizational purpose into agent decision-making infrastructure. Unlike context engineering, which informs agents what to know, intent engineering defines what agents should want. The Klarna AI agent case is used as an example of what happens without it.
Summary
The speaker introduces intent engineering as an emerging and largely unaddressed discipline in AI development. They position it as the third discipline in a framework, distinguishing it from context engineering. While context engineering is described as the practice of telling agents what to know, intent engineering is defined as telling agents what to want — specifically, encoding organizational purpose into the infrastructure that governs autonomous agent decisions.
The speaker emphasizes that intent engineering is not simply inserting prose into a system prompt, but rather involves structured, actionable parameters that actively shape how agents make decisions on their own. The goal is to align agent behavior with broader organizational objectives, not just narrow task metrics.
To illustrate the concept, the speaker references Klarna's AI agent as a cautionary example. They describe a scenario where an intent-engineered system would have recognized that a customer had been with the company for four years and was exhibiting signs of frustration — and therefore directed the agent to invest more time, offer a specialist, and prioritize retention over speed. Without intent engineering, the speaker argues, Klarna's agent optimized for the wrong objective — technically resolving tickets efficiently while missing the deeper business goal of customer retention.
Key Insights
- The speaker argues that intent engineering is the practice of encoding organizational purpose into infrastructure — not as prose in a system prompt, but as structured, actionable parameters that shape autonomous agent decisions.
- The speaker distinguishes intent engineering from context engineering, framing them as complementary disciplines: context engineering tells agents what to know, while intent engineering tells agents what to want.
- The speaker claims that intent engineering is a discipline 'almost nobody is building for yet,' suggesting it represents a significant gap in current AI infrastructure development.
- The speaker uses Klarna's AI agent as a specific example of failure caused by the absence of intent engineering, describing it as 'a technically brilliant agent optimizing for exactly the wrong objective.'
- The speaker argues that a properly intent-engineered system would factor in customer tenure and emotional tone to override efficiency defaults — for instance, spending extra time with a four-year customer showing frustration and routing them to a specialist in service of a retention goal.
Topics
Full transcript available for MurmurCast members
Sign Up to Access