Пост Андрея Карпаты: главная ошибка при создании AI Агентов и RAG систем
The speaker discusses Andrey Karpathy's post about a major problem in AI agent and RAG system design: the difficulty of searching and structuring knowledge bases. The core issue is that notes and knowledge fragments are stored as disconnected elements, making retrieval dependent on remembering exact keywords used during storage.
Summary
The speaker opens by describing a relatable problem many people face: maintaining personal knowledge bases in tools like Telegram or Evernote, where ideas, notes, and inspirations are stored in folders. The fundamental challenge is that retrieving specific notes requires remembering the exact keywords used when the note was created — a task that becomes increasingly difficult as the knowledge base grows over time.
The speaker explains that this problem is compounded by the fact that notes are stored as isolated, disconnected elements with no relationships between them. When browsing or searching, items surface individually without context or connection to related ideas.
This personal knowledge management challenge serves as the entry point into discussing Andrey Karpathy's post, which identifies this same structural problem as the major flaw in AI agent and RAG (Retrieval-Augmented Generation) system design. The problem is not just personal — it scales into enterprise and AI system contexts.
The speaker references practical experience building various AI agents using the N8N service, including: support service agents, HR agents for employee training, agents embedded in Telegram chats with connected knowledge bases for accurate Q&A, and sales agents in Telegram designed to sell products. These real-world implementations highlight the practical importance of solving the knowledge structuring and retrieval problem that Karpathy identifies.
Key Insights
- The speaker argues that the core failure of personal knowledge bases is that notes surface as entirely disconnected elements with no relationships between them, making contextual retrieval nearly impossible.
- The speaker claims that Andrey Karpathy identifies searching knowledge bases as the major problem in AI agent and RAG system design — not model quality or agent logic.
- The speaker observes that retrieval failure stems from a mismatch between the keywords a user remembers at query time and the keywords originally used to formulate and store a note.
- The speaker describes building multiple practical AI agents — including support, HR training, Telegram Q&A, and sales agents — all relying on connected knowledge bases via N8N, implying that RAG architecture is already widely deployed in real workflows.
- The speaker frames the knowledge structuring problem as one that compounds over time: the more knowledge is accumulated, the harder it becomes to structure and retrieve it meaningfully.
Topics
Full transcript available for MurmurCast members
Sign Up to Access