NewsTechnical

OpenAI's first AI chip brings the heat

The Rundown AI

OpenAI unveiled Jalapeño, its first custom AI chip built with Broadcom, which benchmarks show outperforms Nvidia's flagship GPUs on speed and power efficiency. The newsletter also covers emerging physical AI startups, new AI agent tools from Perplexity and Claude, and a community member's successful church construction project management app built with AI.

Summary

OpenAI released benchmark results for Jalapeño, a custom-designed chip optimized for running (not training) AI models. The 700-watt chip demonstrated superior performance compared to Nvidia's 1,200-watt systems, achieving up to 3.6x faster response times and 1.9x more work per watt. OpenAI developed the chip in nine months using its Astra model and Codex, though the company won't commercialize it due to high internal demand. The company continues relying on Nvidia for model training while planning two additional chip generations to deploy across its data centers throughout 2027. This trend reflects broader industry movement, with Google, Anthropic, Amazon, and Microsoft all developing proprietary silicon.

Accelerated Understanding, a new startup founded by Caltech professor Anima Anandkumar and engineer Benedikt Jenik, is pursuing physics-based AI rather than traditional transformer architectures. Their neural operator-based model processed 5 trillion data points in a single run—approximately 5 million times more than Google and Anthropic's leading models—and targets applications in chip materials, extreme-weather prediction, and robotics. The founders notably declined a 35% stake and executive positions at Jeff Bezos' Prometheus to build independently, underscoring their conviction in the physics-based approach.

Perplexity and Nvidia launched Portable Computer, an on-device version of Perplexity's Computer agent that runs locally on Nvidia's $4,699 DGX Spark hardware, offering privacy benefits and free local computation. Users can select between open models or access cloud alternatives, with the option to integrate with 15+ cloud services. Claude introduced a shared memory feature across its chat and Cowork products that updates in real-time, while Apple positioned its new $899 Mac Mini as purpose-built for 'always-on agentic computing' with M6 chips enabling 4x faster workload processing.

The newsletter featured a community workflow from a 71-year-old retired cattle rancher building a construction management application in Replit for his church's $13.5M renovation project, demonstrating how non-programmers can use AI to bridge technical and domain expertise gaps.

About this episode

PLUS: Build a website hands-free with Claude Voice

Key Insights

  • OpenAI's internally-designed Jalapeño chip achieves 3.6x faster performance and 1.9x better power efficiency than Nvidia's flagship systems, though OpenAI will not commercialize it due to internal demand exceeding supply.
  • Accelerated Understanding's physics-based neural operator model processed 5 trillion data points in a single run, approximately 5 million times more than Google and Anthropic's transformer-based models, suggesting a fundamental architectural advantage for physical world prediction.
  • Accelerated Understanding's founders declined a 35% equity stake and executive positions from Jeff Bezos' $12B-funded Prometheus venture to pursue their own company, demonstrating confidence in their physics-over-text approach to AI.
  • Perplexity's shift toward on-device inference through Portable Computer reflects industry movement to localize AI computation for privacy and cost reduction, with the added benefit that smaller open models can serve as primary systems rather than backups.
  • Non-technical domain experts can now build production AI applications by describing requirements in plain English and iteratively refining AI-generated code, as demonstrated by a 71-year-old retiree creating a complex construction management system without programming experience.

Topics

OpenAI's Jalapeño custom AI chipPhysical AI and neural operatorsOn-device AI inference and privacyAI chip industry competitionAI-assisted application development

Transcript

Good morning, {{ first_name | AI enthusiasts }}, and welcome to our 3,221 new readers. OpenAI named its first in-house AI chip Jalapeño, and the first benchmarks just came out appropriately spicy. The company's internal tests have the chip beating Nvidia's flagship GPUs on both speed and power efficiency, with a design OpenAI credits its Astra model and Codex for helping create in nine months. OpenAI's Jalapeño chip brings the heat New startup takes AI from words to physics Build a website hands-free with Claude Voice Perplexity, Nvidia go portable with Computer OPENAI The Rundown: OAI just published the first benchmark results for Jalapeño, the custom chip it built with Broadcom to run AI models (not train them), with its…

Full transcript available for MurmurCast members

Sign Up to Access

More from The Rundown AI

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.