Claude Reads My Handwriting and Sketches Now
The creator demonstrates a workflow for capturing handwritten notes and sketches using PDF Expert on iPad, syncing via iCloud, and having Claude AI read and act on the annotated PDF files. The system connects to a local 'myPKM' folder where an AI orchestrator named Larry processes inputs and outputs. The workflow eliminates the need for complex automations by relying on simple PDF files as the universal format.
Summary
The video presents a personal knowledge management (PKM) system built around a single local folder and Claude AI, with a focus on integrating handwritten notes and sketches into this system. The creator explains that after testing various tools including reMarkable, Apple Notes, Notability, and GoodNotes, he settled on PDF Expert as the simplest solution because it natively works with PDF files, eliminating the need for conversion steps or complex automations.
The workflow is structured around two key folders inside PDF Expert synced via iCloud: a 'Team Inbox' where the user deposits handwritten notes or sketches for the AI to process, and a 'Needs Feedback' folder where the AI places documents for the user to review and annotate. The AI orchestrator, named Larry, monitors these folders and acts on their contents when instructed, reading PDFs directly and interpreting handwriting and sketches without any OCR preprocessing.
Two primary use cases are demonstrated. First, the creator shared an AI-generated plan as a PDF into the Needs Feedback folder, annotated it with checkboxes and handwritten notes using his Apple Pencil, and then had Claude read the annotations to understand his decisions. Claude successfully identified 15 annotations across 6 pages using PDF metadata, correctly interpreted most handwritten feedback, and updated its behavior via a new 'Handwritten Collaboration Loop' SOP stored in the team knowledge base. Second, the creator sketched a rough layout for a membership profile page and dropped it into the Team Inbox. Claude correctly interpreted the sketch — identifying the header, avatar placement, bio section, and activity panels — and generated a polished HTML/PDF mockup that was then sent back for review and further annotation.
The creator emphasizes that this approach scales well, noting he has run up to 12 parallel AI sessions inside the same folder. He argues that expectations for AI handwriting accuracy should be calibrated realistically, comparing it favorably to human assistants working with poor handwriting. The system is described as personal and private, not meant for team sharing, and represents the culmination of a journey through tools like Evernote, Notion, Obsidian, and Heptabase, all now replaced by a local folder and Claude.
Key Insights
- The creator rejected reMarkable, Apple Notes, Notability, and GoodNotes specifically because they do not natively store content as PDF files, requiring conversion steps or third-party sync hacks that introduce fragility into the workflow.
- The creator found that Claude itself performed OCR on handwritten PDFs without any preprocessing by PDF Expert, meaning the AI handled handwriting recognition natively as part of reading the file.
- The creator argues that AI handwriting accuracy expectations should be lowered to match realistic human assistant benchmarks, noting that a human assistant given the same poorly-written, context-free annotated PDF would likely not perform better than Claude did.
- Claude detected that the annotated PDF had increased in file size compared to the original, using this metadata signal to infer that annotations had been added before even reading the content — identifying 15 annotations across 6 pages from metadata alone.
- The creator describes running up to 12 parallel Claude sessions simultaneously inside the same local folder, handling tasks ranging from tax calculations to coding and support tickets, all coordinated through shared team knowledge files like SOPs and workstreams.
Topics
Transcript
[0:00] If you follow this channel, you know that my whole life and business runs through this one local folder and Claude, and that's it. And the the way that we set this up, I showed many times on this channel already. You can download the scaffold of this for free But there is now literally everything in this one folder And if you're into handwriting, then this video is for you because I really look deep. I tested it all to make it possible that my handwritten notes get frictionless into the single source of truth onto my local folder. [0:31] and there are many ways to do this. But I found really literally the simplest solution and the…
Full transcript available for MurmurCast members
Sign Up to AccessMore from ICOR with Tom | AI Productivity
I Made Opus and Fable Grade Each Other. Opus Admitted It Lost.
The creator demonstrates real-world AI applications in their productivity business using Claude Fable and Opus, showing how Fable excels at comprehensive analysis of complex systems while comparing its performance to Opus on specific tasks. The key finding is that Fable's holistic understanding justifies its higher cost for business-critical audits and optimizations.
Our AI invented the numbers. We caught it.
The hosts discuss the importance of double-checking AI outputs and validating information, emphasizing that this is not a new problem but rather a longstanding practice required with any information source. They explore how AI tools can be customized to individual workflows and contexts, arguing that understanding foundational methodology matters more than specific tools.
An AI Just Handed Me a Fake $67B Statistic
The speaker shares how an AI confidently generated a completely fabricated $67.4 billion statistic while researching AI hallucinations, then explains his systematic approach to combating AI misinformation: using dual independent search engines to cross-check answers and identify where hallucinations occur.
AI Is Quietly Taking Your Memory
AI companies are racing to own users' context and memory through integrated tools like Claude in Slack and ChatGPT's auto-memory features, creating a lock-in trap. The speaker argues users should own their context (expensive, irreplaceable) in local plain text files while renting the AI model (cheap, replaceable), and demonstrates his personal knowledge assistant system built on markdown files that work with any AI model.
My AI Team Now Has an Interface. All 12 Agents. Free.
Tom, creator of the iCola methodology, releases My PKA version 3 with a free interface (My PKA Cockpit) that provides 12 pre-built AI agents for productivity, note-taking, health tracking, document management, and task planning—all running locally in a folder structure accessible via Claude and a web interface.