HN836: Optimize AI Traffic on the WAN with Ciena’s Integrated IP Networking (Sponsored)
This sponsored podcast episode explores how AI inferencing is changing WAN infrastructure demands, with Ciena executives discussing the need for latency optimization, dynamic traffic engineering, and integrated IP-optical networks to support distributed AI workloads across multiple cloud providers.
Summary
The episode begins by establishing that AI inferencing—the deployment and consumption phase of AI models by enterprises and end users—represents a fundamentally different traffic pattern than traditional broadband or training workloads. Rafael Francis and Vinny Santos from Ciena explain that while AI inferencing increases bandwidth demands, especially with multimodal (video, image) content, the core challenge is not simply adding capacity everywhere. Instead, service providers must optimize for multiple competing constraints: latency (often more critical than compute latency), deterministic performance, always-on availability for agentic AI, and multi-cloud connectivity where traffic flows across diverse providers rather than following traditional north-south data center patterns.
The hosts discuss how AI inferencing traffic represents an amplification of existing network challenges rather than entirely new problems. Multi-cloud deployments, for instance, require enterprises to interconnect multiple specialized providers, creating significant east-west traffic flows that demand sophisticated traffic engineering. The solution cannot be solved through raw bandwidth increases alone; instead, it requires intelligent path selection and dynamic adaptation.
At the IP layer, Ciena advocates for Segment Routing with FlexAlgo as a modern alternative to legacy MPLS technologies like RSVP and LDP. FlexAlgo creates multiple virtual topologies within a single physical network, allowing segment routing to dynamically select paths based on real-time constraints like latency. The example given involves a financial trading infrastructure customer where a service provider network failure causes unacceptable latency increases; through FlexAlgo and latency measurement via TWAMP or Y1731, traffic can automatically reroute to the lowest-latency path without human intervention.
A key distinction emerges between distributed path computation (via FlexAlgo within routing domains) and centralized computation (via Path Computation Elements for multi-domain scenarios). The speakers emphasize that AI agents operating 24/7 require networks that adapt at machine speed—far faster than traditional human-driven configuration management. Legacy technologies like RSVP are described as too rigid and complex for this autonomous, near-real-time responsiveness.
FlexEthernet (FlexE) is presented as a complementary underlay technology that provides service isolation and latency reduction by functioning as a Layer 1.5 technology, enabling TDM-like guarantees within converged IP infrastructure. The integration of these capabilities—segment routing, FlexAlgo, and FlexE—allows service providers to combine the flexibility of modern IP with the performance guarantees historically associated with optical networks.
On the optical side, Ciena emphasizes the integration of coherent optical modems directly into routers via coherent pluggables rather than deploying separate transponders. This eliminates operational blind spots between IP and optical layers while reducing power consumption and latency. The discussion of Shared Risk Link Groups (SRLGs) highlights a critical operational benefit: understanding that two supposedly diverse IP paths might share the same physical fiber bundle, a visibility that only comes from integrated IP-optical awareness.
Telemetry is positioned as foundational to this closed-loop automation. Streaming telemetry via gRPC and GNMI, combined with performance metrics from TWAMP and Y1731, feeds data into control systems that drive autonomous network adjustments. The speakers stress that telemetry without control is merely a dashboard, while control without telemetry is flying blind.
Ciena's software offerings—Navigator (multi-layer controller for Ciena domains) and Blue Planet (multi-vendor, multi-domain orchestration)—enable this automation. Navigator understands relationships between IP and optical layers simultaneously, eliminating operational silos. Blue Planet extends to OSS/BSS layers and spans multiple vendor domains. Both integrate AI operations capabilities for troubleshooting and predictive analytics.
The role of AI in network operations is carefully positioned: it currently excels at reactive troubleshooting and root cause analysis across multi-layer environments but does not drive routing decisions. Routing decisions remain the domain of protocols like segment routing and FlexAlgo, with AI informing these decisions through trend analysis and failure prediction. The speakers reject the notion of fully autonomous networks running without human oversight, instead describing a spectrum of autonomy where operators retain decision authority while gaining faster insights and more precise tools.
Security is addressed through multiple layers. MACsec provides link-layer or end-to-end encryption on high-speed WAN links (400Gbps, 800Gbps), while WaveLogic coherent modems support bulk encryption at optical layer without latency penalty. Post-quantum cryptography considerations are emerging, with manually pre-shared keys and AES-256 offering quantum-safe properties.
The Ciena portfolio is positioned as comprehensive: capacity via coherent routers (up to 1.16 Tbps bandwidth mode) with integrated pluggables, intelligence via SAOS operating system (including segment routing, EVPN, FlexAlgo, FlexE, MACsec), and orchestration via Navigator and Blue Planet. The company sells to service providers, hyperscalers, enterprises, and vertical markets (financial, healthcare, utilities, research). The speakers emphasize avoiding the misconception that Ciena is only an optical vendor; the routing and IP layer capabilities are equally significant for AI-ready networks.
About this episode
As more applications and services rely on AI inferencing, that means more traffic on the WAN. Yes, bandwidth can solve a lot of problems, it’s not unlimited and AI inference traffic still has to share pipes with other flows. That means things like WAN latency, determinism, security, and traffic engineering are just as important as<a class="excerpt-read-more" href="https://packetpushers.net/podcasts/heavy-networking/hn836-optimize-ai-traffic-on-the-wan-with-cienas-integrated-ip-networking-sponsored/" title="ReadHN836: Optimize AI Traffic on the WAN with Ciena’s Integrated IP Networking (Sponsored)">... Read more »</a>
Key Insights
- AI inferencing creates fundamentally different WAN traffic patterns than training workloads, with significant multi-cloud, east-west flows and requirements for always-on agentic AI connectivity across 24/7 operations.
- Network latency often becomes more critical than compute latency for AI inference performance, meaning service providers must optimize for 10-millisecond latency targets through intelligent path selection rather than raw bandwidth increases.
- FlexAlgo creates multiple virtual topologies within a single physical network, allowing segment routing to dynamically select paths based on real-time latency measurements, enabling near-instantaneous hitless traffic rerouting without manual intervention.
- Integrated IP-optical awareness reveals shared risk link groups that separate IP controllers cannot detect, preventing operators from unintentionally placing supposedly diverse paths on the same physical fiber and causing simultaneous failure modes.
- Legacy MPLS technologies like RSVP and LDP are too rigid and slow for autonomous networks requiring machine-speed adaptation to support AI agents negotiating with each other in real time.
- MACsec operates as a hop-by-hop or end-to-end encryption mechanism on high-speed WAN links (800Gbps capable), making it more suitable than IPsec for bulk encryption of AI traffic at wire speed.
- WaveLogic coherent optical modems support bulk encryption at the optical layer without introducing latency penalties, providing an alternative to higher-layer encryption methods for latency-sensitive distributed training scenarios.
- AI operations currently excel at reactive troubleshooting and root cause analysis across multi-layer IP-optical environments but do not drive routing decisions, which remain the domain of segment routing protocols informed by AI trend analysis.
Topics
Transcript
Welcome to Heavy Networking, the podcast for listeners with strong opinions on EVPN VXLAN versus TradCore. I'm Drew Connery-Murray. Ethan Banks is away on a walkabout. Today, I'm talking optics and more with sponsor Sienna. And if you're guessing this is an episode about optics and AI data centers, not quite. Today's focus is the WAN infrastructure that carries traffic among users, businesses, and the data centers running AI inferencing workloads. We're going to delve into the evolution of IP networks and coherent optical technologies that enable the movement of AI data across the internet. As more applications and services are relying on AI inferencing, that means more traffic on the WAN, and while more bandwidth can solve a lot…
Full transcript available for MurmurCast members
Sign Up to AccessMore from The Everything Feed - All Packet Pushers Pods
TNO067: The Impact of AI on Internet Traffic
In this episode of Total Network Operations, Russ White (Nokia) and Lenny Giuliano (HPE) discuss how generative AI may fundamentally change internet traffic patterns, moving from today's cacheable CDN model to distributed inference computing at the edge. They explore the tension between centralized cloud compute and edge deployment, considering factors like latency, video processing, privacy, power constraints, and the need for deterministic networking similar to training infrastructure.
LIU019: Jason Gooley: The Godfather of Programmability
Jason Gooley, known as the Godfather of Programmability, discusses his journey from poverty in Chicago to becoming a Cisco engineer and author, explaining how financial necessity and early passion for technology drove him to obtain certifications like the CCNA and CCIE, and how he's now focused on building community and making certification paths more accessible through initiatives like the CCST exam.
HW083: Inside the WLAN Pros Toolbox – A Free, Multipurpose App
Keith Parsons introduces the WLAN Pros Toolbox, a free cross-platform app containing over 100 Wi-Fi tools, calculators, and references available on iPhone, iPad, Mac, Android, and web browsers. Built using Flutter and AI-assisted development, the app is intentionally free with no ads, subscriptions, or data collection because Parsons believes essential professional tools should be accessible to all engineers worldwide.
NB582: Infoblox Adds Network Observability with Kentik Buy; Satellite Data Centers vs. the Environment
Network Break covers major tech news including Infoblox's acquisition of Kentik for network observability, alarming electricity consumption by data centers (especially in Ireland), security advances in AI agent detection, and developments in space infrastructure including Rocket Lab's acquisition of Iridium and environmental concerns about orbital data centers.
TCG079: Why Your State File is Actually a Distributed Systems Problem
Malcolm Matalka argues that Terraform's value lies not in its HCL syntax but in its state management, which is fundamentally a distributed systems problem inadequately solved by file-based locking. He discusses how StateGraph reimagines infrastructure state as a database rather than a JSON file, enabling concurrent operations, better queryability, and solving the scalability issues that plague teams as they grow.