TechnicalDiscussion

Enterprise AI fails on governance, not the model

How I AI

The speaker discusses the importance of skill management and governance in enterprise AI platforms, emphasizing that enabling people to build skills is insufficient without proper monitoring, maintenance, and telemetry. The focus is on providing automatic platform-driven suggestions to keep skills current and using data insights to promote high-value skills while deprecating low-value ones.

Summary

The speaker addresses a critical gap in enterprise AI implementation: the governance and maintenance of skills after they're built. While enabling skill-building capabilities is a foundation, the real challenge lies in ensuring users understand what their skills do and maintaining those skills in optimal condition. The platform provides automatic, data-driven suggestions to help users improve and maintain their skills over time. This is particularly important given that the platform allows any user to publish shared skills that others can adopt, creating a need for quality control and continuous improvement mechanisms. Beyond the user-facing interface, the platform generates telemetry data that helps platform owners (harness owners) make strategic decisions about skill lifecycle management. Specifically, this data indicates which skills should be promoted into general workflows for broader adoption and which skills should be deprecated or delegated out because they consume excessive context without sufficient value. This approach represents a shift from viewing skill creation as an end goal to treating skill governance as an ongoing operational responsibility.

Key Insights

  • The speaker argues that enabling skill-building is insufficient; platforms must ensure users understand what their skills do and maintain them in top condition through ongoing management
  • The platform invests in automatic, platform-driven suggestions to help users improve skills, recognizing this is critical since any user can publish shared skills that others adopt
  • Telemetry data serves a dual purpose: it provides insights to users for improvement while also informing platform owners about which skills to promote or deprecate
  • The speaker describes a curation mechanism where platform owners use telemetry to identify skills that should move into general workflows versus skills that consume excessive context and should be removed
  • The framework distinguishes between user-facing improvements and backend governance processes, treating skill management as a two-sided operational challenge

Topics

Skill governance and lifecycle managementTelemetry and data-driven decision makingPlatform-driven automation and suggestionsUser skill maintenance and upskillingSkill quality control and promotion

Transcript

[0:00] It's not enough to enable people to build a bunch of skills. How do you make sure that they actually know what it's doing and how you keep them in top shape? And that's the other thing that we're really investing in. This automatic, platform-driven suggestions for how to improve your skills so that, especially since we let anybody publish a shared skill that anybody else can pick up, it's become really important to ensure that we can give people the tools, keep those in tip-top shape. But then again, what is the telemetry we have? And part of the process I'm showing here is this is the user-facing [0:33] part of it, but part of the process is…

Full transcript available for MurmurCast members

Sign Up to Access

More from How I AI

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.