DiscussionTechnical

HS141: EA vs AI

Jon and Jonna debate whether Enterprise Architecture (EA) and AI can coexist, concluding that EA remains essential for governing AI systems. They argue that while AI is inherently non-deterministic and boundary-crossing, organizations need architectural frameworks to define data governance, security policies, and business alignment—especially for high-stakes applications.

Summary

The episode opens with Jon Burr explaining why EA and AI coexistence is challenging: EA aims to create known, reliable, and deterministic IT environments by defining boundaries and data flows, while AI—particularly agentic AI—operates in emergent, probabilistic, and unpredictable ways, often crossing data and functional boundaries to achieve immediate results without long-term perspective.

Jonna challenges whether EA is actually necessary, prompting Jon to distinguish between EA as a high-level architectural vision versus low-level engineering implementation details. They agree that true enterprise architecture must include infrastructure considerations and should define what systems exist and how they interconnect at a strategic level, without prescribing implementation minutiae. The debate hinges on the level of abstraction appropriate for architecture versus engineering.

When discussing whether AI eliminates the need for EA, Jon argues that relying on AI to maintain boundaries is contradictory given AI's documented inability to respect boundaries. Jonna counters that some organizations might adopt a framework where AI builds and modifies software on-the-fly, with governance enforced through access controls rather than traditional architecture. Jon responds that this reasoning is circular: without understanding what data belongs where and why, you cannot create meaningful governance policies.

They explore whether AI could replace detailed architectural documentation with dynamic, AI-assisted architecture updates—quarterly or monthly reviews where AI suggests changes while humans validate them. Both agree this could work if humans remain in the loop and changes occur on human-friendly business cycles rather than machine speed.

The hosts emphasize that architectural understanding depends on organizational context: UPS-level complexity requires street-level detail maps, while simpler organizations need only interstate-level views. However, both assert that absent significant improvements in AI reliability (such as implementing ACID properties for AI), enterprise architecture is more important than ever for providing guardrails and governance.

They distinguish between different forms of AI, cautioning against using LLMs for mission-critical, deterministic requirements like algorithmic trading, aviation safety, or medical systems. The more you force non-deterministic AI into deterministic applications, the less reliable the results. Finally, Jonna invokes Hilary Putnam's critique of the Turing test to argue that output-based definitions of intelligence ignore semantics and meaning—divorced outputs from reality eventually lead to failures when stakes are highest.

About this episode

What does Enterprise Architecture (EA) mean when AI is everywhere in the stack? Enterprise Architecture is about nailing down relationships and functions while AI pushes back with dynamic processes and probabilistic results. Join Johna and John as they discuss the possibilities for EA: does it prevail, adapt, or die? Episode Links: Watch this episode on<a class="excerpt-read-more" href="https://packetpushers.net/podcasts/heavy-strategy/hs141-ea-vs-ai/" title="ReadHS141: EA vs AI">... Read more &#187;</a><img height="1" src="https://feeds.packetpushers.net/link/22503/17436567.gif" width="1" />

Key Insights

  • Jon argues that agentic AI fundamentally threatens EA by crossing data and functional boundaries unpredictably to achieve immediate results, lacking the long-term perspective and deterministic behavior that architecture seeks to enforce.
  • Jonna contends that enterprise architecture operates at a level of abstraction focused on what systems exist and how they connect, not implementation details like specific API designs or database mechanics—a distinction that matters when evaluating AI's impact.
  • Jon claims that meaningful AI governance is impossible without architectural understanding because you cannot enforce a policy that 'data shouldn't flow from system A to B' unless you understand what both systems contain and why the boundary exists.
  • Both hosts agree that organizational context determines architectural detail requirements: UPS-scale operations need street-level detail maps while simpler organizations only need strategic highway-level views.
  • Jon argues that forcing inherently non-deterministic LLMs into deterministic use cases (like algorithmic trading or medical systems) contradicts their fundamental nature and produces unreliable results, suggesting non-LLM AI should be used for such applications.
  • Jonna proposes that AI could assist in dynamic architecture updates on human-friendly business cycles (weekly, monthly, quarterly) with human validation, potentially reducing cycle time without creating a black box.
  • The hosts establish that even well-designed organizations lack complete understanding of their actual IT environments, making the question not whether to rely on AI without understanding, but rather what level of architectural abstraction humans can meaningfully maintain.
  • Jonna invokes Hilary Putnam's semantic critique of the Turing test to argue that AI outputs appearing correct while being divorced from real meaning eventually causes critical failures in high-stakes environments.

Topics

Enterprise Architecture necessity and designAI governance and control mechanismsDeterminism versus probabilistic AI behaviorBoundary definition and data governanceDynamic and adaptive architectureLLMs versus other forms of AIBusiness alignment and ROI measurementInfrastructure layer in enterprise architecture

Transcript

Hello, I'm Jonna Till-Johnson, CEO of Nemerti's. I'm here with my co-host, Jon Burr, CTO of Nemerti's. And you are listening to Heavy Strategy, the show that tries to ask the right questions, not give the right answers, and occasionally to launch the correct debates, the right debates. We're going to be talking today about EA versus AI. So, John, you wanted to talk about whether EA and AI can coexist or can there only be one? Talk to me about why you think... No, no, you've got to say it the right way. Can there be only one? Like in Highlander. Okay, can there be only one? Okay, tell me why you think coexistence might be impossible. Tell me…

Full transcript available for MurmurCast members

Sign Up to Access

More from The Everything Feed - All Packet Pushers Pods

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.