HS134: Dodging the AI Iceberg: Midcourse Corrections
John Attil Johnson and John Burke of Numerides discuss when and how to make mid-course corrections to IT and AI strategies. They cover triggers for strategic reassessment, the value of wargaming and scenario planning, and how business imperatives should drive technology decisions. The episode emphasizes structured, recurring strategy reviews rather than reactive responses to crises.
Summary
In this episode of Heavy Strategy, co-hosts John Attil Johnson and John Burke of Numerides explore the topic of mid-course strategy corrections, with a particular focus on AI and IT strategy. They open by identifying several non-emergency categories that should prompt strategic reassessment: things that were unclear at the outset but are now visible, developments that arrived faster than anticipated, projects that are over budget or under-delivering, and unexpected surprises—both positive and negative.
The hosts use AI deployment in help desks as a concrete example, referencing research showing roughly 20% productivity gains for entry-level help desk work but weak to negative correlation for higher-level staff. They argue this kind of differential outcome should prompt organizations to revisit where and how they are applying AI, rather than assuming uniform benefits across all use cases.
A significant portion of the discussion focuses on the importance of after-action reviews and the 'five whys' methodology—drilling down into root causes rather than simply noting that something didn't work. They recommend at least quarterly strategic check-ins at the leadership level to assess whether strategy is on track and whether external conditions have shifted. They also connect IT strategy back to business imperatives, noting that if the core corporate objective changes—say, from margin improvement to revenue growth—the technology strategy must be re-examined from the ground up.
The hosts advocate strongly for wargaming as a proactive tool, arguing that organizations should red-team their strategies to identify contingencies in advance. They cite the example of clients who had pre-built pandemic response plans and were able to activate them smoothly when COVID-19 hit. They extend this logic to current geopolitical and supply chain risks, such as helium shortages affecting MRI centers, TSMC disruption affecting hardware procurement, and rare earth mineral dependencies on China.
They also discuss how technology advances can render entire business processes obsolete, warning against over-investing in technically enabling processes that new technology will soon eliminate. This is illustrated through the anecdote of Cooper Union's original architects pre-building an elevator shaft in the 1800s, anticipating future need. The hosts close by noting that course corrections should also prompt a review of whether the IT organizational structure—particularly its degree of siloing—is still fit for purpose.
About this episode
By now most organizations have AI strategies (among their other tech strategies). But how do you know when it’s time to make a midcourse correction? Better still: How can you predict when, and what kind of corrections you might need? John and Johna discuss, and tell the story of how a university prepared for technology<a class="excerpt-read-more" href="https://packetpushers.net/podcasts/heavy-strategy/hs134-dodging-the-ai-iceberg-midcourse-corrections/" title="ReadHS134: Dodging the AI Iceberg: Midcourse Corrections">... Read more »</a><img height="1" src="https://feeds.packetpushers.net/link/22503/17352804.gif" width="1" />
Key Insights
- The hosts argue that research shows AI produces roughly 20% productivity gains for entry-level help desk work but has a weak to negative correlation with productivity at second and third support tiers, suggesting AI benefits are not uniform across organizational levels.
- Johnson contends that many IT projects are launched without a clear definition of what they are supposed to accomplish, making it difficult to assess whether a course correction is needed.
- Burke argues that wargaming IT and business strategies—where someone red-teams the plan with simulated external events—can convert reactive course corrections into the activation of pre-planned contingencies, reducing the cost and chaos of mid-stream pivots.
- The hosts assert that if senior executives are repeatedly asking about a technology or risk that is not currently on the IT strategy roadmap, that is a reliable signal that a strategic reassessment is overdue.
- Johnson argues that organizations should explicitly map critical resource dependencies—such as rare earth minerals, helium, or TSMC silicon—and model how disruptions to those resources would force changes to IT and business strategy.
- Burke contends that when designing new IT systems or infrastructure, teams should proactively identify the conditions under which that investment will become obsolete, so transitions can be planned in advance rather than reverse-engineered under pressure.
- The hosts argue that IT strategy must be traced back to corporate-level business imperatives, and that a change in top-level objectives—such as shifting from margin improvement to revenue growth—should trigger a full re-evaluation of the technology strategy stack.
- Johnson suggests that when making a course correction, organizations should also evaluate whether their IT organizational structure, particularly the degree of siloing versus horizontal integration, is still suited to the new strategic direction.
Topics
Transcript
Hello, I'm John Attil Johnson, CEO of Numerides, and I'm here with my co-host, John Burke, CTO of Numerides. And you're listening to Heavy Strategy, the show that tries to ask the right questions, not give the right answers. This episode is sponsored by Meter, which is the company building networks from the ground up. Meter delivers a complete networking stack, wired, wireless, and cellular in one integrated solution. With METER, you get fast, secure, scalable connectivity without the burden of managing multiple providers or tools. METER scales from branch offices, warehouses, and large campuses to data centers. And its integrated network stack is designed to give you deep control and visibility. METER covers everything, from first site survey to…
Full transcript available for MurmurCast members
Sign Up to AccessMore from The Everything Feed - All Packet Pushers Pods
HW083: Inside the WLAN Pros Toolbox – A Free, Multipurpose App
Keith Parsons introduces the WLAN Pros Toolbox, a free cross-platform app containing over 100 Wi-Fi tools, calculators, and references available on iPhone, iPad, Mac, Android, and web browsers. Built using Flutter and AI-assisted development, the app is intentionally free with no ads, subscriptions, or data collection because Parsons believes essential professional tools should be accessible to all engineers worldwide.
NB582: Infoblox Adds Network Observability with Kentik Buy; Satellite Data Centers vs. the Environment
Network Break covers major tech news including Infoblox's acquisition of Kentik for network observability, alarming electricity consumption by data centers (especially in Ireland), security advances in AI agent detection, and developments in space infrastructure including Rocket Lab's acquisition of Iridium and environmental concerns about orbital data centers.
TCG079: Why Your State File is Actually a Distributed Systems Problem
Malcolm Matalka argues that Terraform's value lies not in its HCL syntax but in its state management, which is fundamentally a distributed systems problem inadequately solved by file-based locking. He discusses how StateGraph reimagines infrastructure state as a database rather than a JSON file, enabling concurrent operations, better queryability, and solving the scalability issues that plague teams as they grow.
NAN126: Fine-Tuning Open Source LLMs for Network Engineering
Edward Tuharu, founder of VXpert AI, discusses his career pivot from pursuing CCIE certification to building AI-powered NOC/SOC systems after recognizing the transformative potential of transformer architecture in 2022. He outlines the progression of AI technologies from prompting to RAG to fine-tuning to agentic systems, drawing parallels with networking protocol evolution and emphasizing the importance of domain-specific knowledge and fundamentals.
D2DO306: Platform Engineering in the Agentic Era (Sponsored)
Jad Elzane and Miles Gray from VMware by Broadcom discuss how platform engineering evolved from DevOps to address developer cognitive overload, and how Platform Engineering 2.0 must now accommodate AI agents as consumers alongside human developers, requiring new security guardrails and observability controls.