Claude Code Computer Use Can Control Your ENTIRE Computer! Automate Your Life!
Anthropic introduced computer use capability in Claude Code, allowing it to control computers through UI interactions, currently available for Mac OS Pro/Max users. A GitHub workaround using dev browser CLI provides similar functionality for Windows and Linux users.
Summary
On March 23rd, Anthropic introduced a computer use capability that allows Claude to control computers by opening apps, navigating browsers, and filling spreadsheets like a human would. This feature was initially released as a research preview in Claude Co-work for Mac OS but lacked seamless integration with Claude Code until now. The new computer use functionality is now available directly within Claude Code as a research preview for Pro and Max plan subscribers on Mac OS. This enables Claude Code to interact with user interfaces, click through applications, and test what it builds directly from the command line interface. The capability allows Claude to handle any task requiring a graphical user interface, including building and testing native apps, running end-to-end UI flows, debugging visual elements, and interacting with GUI-only tools like design software and proprietary applications without CLI or API access. For Windows and Linux users who cannot access the official feature, there is an open-source GitHub workaround called dev browser CLI that provides similar functionality by letting agents interact with browsers through code execution. The speaker demonstrates how this alternative can analyze YouTube channels, create Google sheets with movie data, and perform various automation tasks. The tool can also help with visual debugging, allowing Claude to see and fix errors directly in applications, making it capable of building, testing, and validating apps end-to-end without leaving the terminal.
Key Insights
- Anthropic introduced computer use inside Claude Code on March 23rd, enabling it to interact with UI, click through apps, and test builds directly from CLI, representing a major upgrade comparable to Google's anti-gravity demonstrations
- The speaker explains that computer use is currently only available for Mac OS users on Pro or Max plans, leaving Windows and Linux users without official access
- The dev browser CLI workaround differs from agent browsers in approach - it's more code automation driven making it faster and more deterministic, while agent browsers focus on autonomous visual interactions but may be slower
- Anthropic has acknowledged that rate limits in Claude Code have been frustrating for developers and are actively working on a fix as their top priority
- The speaker demonstrates that computer use transforms Claude from a code-writing assistant into a hands-on agent capable of building, testing, and validating apps or GUI tasks end-to-end without leaving the terminal
Topics
Full transcript available for MurmurCast members
Sign Up to Access