TechnicalDiscussion

How this OpenAI engineer uses Codex + ChatGPT Work to automate everything

How I AI

Nick Bowman from OpenAI demonstrates advanced use cases of ChatGPT and Codex, including voice-orchestrated multi-threaded task management, AI-powered website creation via ChatGPT artifacts, and automated video editing for content creation. He emphasizes how these tools are becoming accessible to non-technical users through mobile and voice interfaces.

Summary

In this episode of 'How I AI,' host Clarvo interviews Nick Bowman, an OpenAI engineer, about cutting-edge features in ChatGPT and Codex that most users don't yet know about. The conversation covers three major use cases:

First, ChatGPT voice functionality (released the day before this recording) enables high-bandwidth delegation of complex tasks. Nick demonstrates booking flights and hotels for a Paris offsite while simultaneously creating an expense report—all managed through voice commands with multiple concurrent threads running in the background. The voice feature can see the user's screen via appshots (smart screenshots), access plugins and browser capabilities, and manage up to five or six threads simultaneously. Unlike typical voice AI that uses weaker models, this implementation uses ChatGPT's full intelligence, allowing users to delegate with confidence.

Second, ChatGPT artifacts deployed on custom domains (chatgpt.site) allow users to build and deploy functional websites with SQL databases, S3 storage, and environmental variables. Clarvo and Nick build a live website aggregating tips from How I AI episodes, filterable by tool and function. These sites support access controls (public, private, or email-restricted), can be edited from mobile, and are deployed instantly—representing a democratization of web app creation.

Third, Nick showcases video editing automation via Codex, where he dumps 50-60 raw video clips into ChatGPT with voice notes about desired edits. The system transcribes clips, processes image frames, identifies the best takes based on verbal cues ("cut," "bad take"), and assembles finished UGC-style videos in multiple formats (9x6, 4x5, organic vertical). The system even automatically redacts sensitive information like addresses and API keys with frame-following blur effects. This workflow reduces the barrier to content creation from hours of manual editing to simple recording and voice direction.

Key themes throughout include: the shift from blank-page syndrome through voice as a 'yapper's API,' latency versus intelligence tradeoffs in voice (Nick argues latency matters more when good tools are available for delegation), the challenge of using voice in open offices (requiring meeting pods and whispered dictation), and the importance of discoverability for new features. Nick emphasizes that most people don't know about meta-capabilities like thread creation and forking, which allow AI to manage context intelligently.

Key Insights

  • ChatGPT voice represents a new primitive where full-intelligence models can manage multiple concurrent threads (5-6 threads) simultaneously with delegation capabilities, unlike typical voice AI that trades off capability for latency
  • Nick argues that when delegation tools are available, latency matters more than raw intelligence for voice experiences, as users can tolerate thinking time if the AI effectively offloads work to available plugins and services
  • ChatGPT mobile and work tab features enable non-technical users to set up always-on agents monitoring email and finances, representing a democratization of agent capabilities previously limited to developers and AI tinkerers
  • Video editing automation using Codex can automatically handle sensitive redaction tasks by checking frames iteratively until good results are achieved, solving a previously tedious manual problem for content creators
  • Nick observes that people in OpenAI offices are increasingly using private meeting pods and pods specifically to use voice dictation features, indicating organic workplace adaptation to voice-based AI workflows despite infrastructure challenges

Topics

ChatGPT voice orchestration and multi-threaded task managementChatGPT artifacts and website deploymentAI-powered video editing and content automationVoice as high-bandwidth interface for AI interactionMobile-first AI workflows and always-on agentsPlugin integration and browser automationFeature discoverability and underused AI capabilities

Transcript

[0:00] If we go back to, you know, 2022, 2023 around the release of chatbt, I think a lot of people felt the AI then a chatbot that I say things to and intelligently says things back to me. I think with the advent of coding agents and like the coding agent harness in particular, now this AI is going out and like reading files and creating files, like running commands and this is crazy. I sell it one thing and then it figures out all the other things on it own. >> I haven't gone deep with voice. I want to see it from the pro. How should we be using it? What's cool about it? >> So, I'm…

Full transcript available for MurmurCast members

Sign Up to Access

More from How I AI

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.