Build a harness when the same workflow needs the same setup and the same outcomes, every time
Building a harness for repetitive workflows allows you to be more prescriptive about job execution, resulting in greater efficiency, consistency, and better outcomes. Rather than explaining requirements to an AI agent each time, a harness lets you use a simpler interface like pasting a link while the agent already understands the intended task.
Summary
The speaker discusses the concept of building a harness for specific, repetitive jobs where you want more control over how work gets done. When you can identify the right workflows that have the same setup and same outcomes every time, creating a harness provides significant advantages in efficiency, consistency, and result quality. The speaker contrasts two approaches: using a direct AI tool like Cloud Code requires explicit instructions each time (e.g., 'Please fix this bug' followed by a link), which is verbose and repetitive. In contrast, a harness abstracts away this explanation layer. With a harness in place, you can simply paste a link and the agent already understands your intent and the job to be done without requiring detailed instructions. This approach eliminates redundancy and streamlines the workflow for standardized tasks.
Key Insights
- Building a harness for specific jobs enables more prescriptive control over how work gets done, leading to greater efficiency, consistency, and better outcomes
- Harnesses are most effective when applied to workflows that have identical setup and outcome requirements each time
- Direct AI tools like Cloud Code require explicit verbal instructions and context to be provided repeatedly for each task
- A harness eliminates the need to explain intent each time by encoding the workflow's purpose, so users can simply provide minimal input like a link
- The harness approach allows an AI agent to already understand the job to be done without additional explanation or context being provided
Topics
Transcript
[0:00] Sometimes with a specific job, you just want to micromanage a little bit. You just want to be more prescriptive about how that job gets done. And so if you can identify the right workflows, you can actually be more efficient, more consistent, and have better outcomes if you build a harness. So for this specific use case with a direct AI tool like Cloud Code, I would have to explain what I want the agent to do. So I'd have to say like, "Dear agent, please fix this bug. Here it is." and send the [0:30] link. Instead of this harness, I can literally just paste in the link and the agent already knows my intent, already knows…
Full transcript available for MurmurCast members
Sign Up to AccessMore from How I AI
Running evals on your internal agents is how you keep them trustworthy over time
The evaluation of internal AI agents is crucial for maintaining their reliability. An internal eval platform allows engineers to review agent performance regularly and ensure their responses are accurate, particularly in critical areas like coding.
You don't have to review every AI-generated PR
The speaker describes an AI agent framework that automatically reviews pull requests by scoring them across six risk factors using markdown-based instructions and skills. PRs are classified as low (0-24 points), medium (25-64), or high risk (65+), with only medium and high risk requiring human approval.
Voice is the highest-bandwidth input channel for AI
Voice interaction with AI addresses the common problem of 'blank chat window syndrome' by enabling users to naturally dump context through speech rather than carefully constructed text prompts. Voice-to-voice AI interaction mirrors the experience of delegating to a human assistant, making it a higher-bandwidth and more natural way to communicate with LLMs.
ChatGPT voice doesn't just respond to you: it operates your computer in parallel
ChatGPT's voice interface can now operate a user's computer in parallel, handling tasks like booking flights and hotels in the background while the user continues with other work. The user demonstrates asking the AI to check their calendar, find travel options, and book accommodations for a Paris offsite, with the AI managing browser automation to complete these logistical tasks autonomously.
How this OpenAI engineer uses Codex + ChatGPT Work to automate everything
Nick Bowman from OpenAI demonstrates advanced use cases of ChatGPT and Codex, including voice-orchestrated multi-threaded task management, AI-powered website creation via ChatGPT artifacts, and automated video editing for content creation. He emphasizes how these tools are becoming accessible to non-technical users through mobile and voice interfaces.