Fraudsters wrote PRDs on how to scam my AI product
An AI product founder shares critical lessons about preventing fraud and abuse of AI services, emphasizing that fraudsters actively create detailed plans to exploit AI platforms. Key defenses include monitoring costs instead of request counts, verifying clients thoroughly, and implementing strict policies with no exceptions.
Summary
The speaker discusses how fraudsters have specifically targeted their AI product by writing PRDs (Product Requirements Documents) outlining scam strategies. The core vulnerability stems from the nature of AI service economics: unlike traditional SaaS with per-seat pricing, AI platforms charge based on compute usage, making every free trial, coupon code, and zero-dollar account a potential exploitation vector. The speaker emphasizes the critical importance of tracking spending in dollars rather than request counts, as expensive models create proportionally larger financial exposure to fraud. A key insight is that fraudsters will use the AI service itself to help them devise and execute attacks against that same service. To combat this, the speaker advocates for a multi-layered verification approach that goes beyond simple login credentials to include valid session tracking and bot identification. The speaker acknowledges that false positives will inevitably occur but argues that rules must remain simple while policies must be enforced strictly with no exceptions or wiggle room. The conclusion presented (attributed to Claude Opus) recommends a zero-trust security posture: begin by distrusting all users and require them to earn trust through verified behavior over time.
Key Insights
- Fraudsters actively write detailed PRDs (Product Requirements Documents) specifically outlining methods to scam AI products, turning the platform's own tools against it
- AI service economics are fundamentally different from seat-based SaaS—platforms must track spending in dollars rather than request counts because every free trial and coupon code creates financial exposure to abuse
- Fraudsters will use an AI service to help them devise strategies for stealing that same AI service
- Client verification must extend beyond login credentials to include valid session validation and bot identification to prevent sophisticated fraud
- Security policies must be enforced with absolute strictness and no exceptions, though false positives are inevitable and rules should remain simple
Topics
Transcript
[0:00] They used my own creation against me. Fraudsters need PRDs too. If you sell AI, you sell compute. So act like it. But basically, like you got to watch your model bill. You got to count dollars, not requests, because expensive models get expensive. Every zero dollar door gets used. Every trial, every coupon code. There is no free lunch anymore. It's not like seats. It's not like when your hosting would go up a little. It is so expensive. People were legit writing PRDs about ways they could scam chat PRD. I am not kidding. They [0:32] will use your AI to help them steal your AI for sure. You have to verify your client, not just the…
Full transcript available for MurmurCast members
Sign Up to AccessMore from How I AI
I use Stripe Radar to catch card testing before it costs me
The speaker explains how to use Stripe Radar to prevent card testing fraud by leveraging built-in fraud rules, fingerprint detection, and Spot ID verification. These tools help identify suspicious payment patterns and validate that requests originate from legitimate app users, while allowing tuning to minimize false positives for good users.
Token fraudsters relayed their AI product through ChatPRD
The founder of Chat Purity discusses token fraud, where bad actors authenticate as their service and relay requests from their own AI products through Chat Purity to appear legitimate. Despite existing technical controls, fraudsters employed reverse proxies and relay systems to obscure their activity, creating inefficient and suspicious infrastructure.
How I fight token fraud as an AI founder
Claire, founder of ChatPRD, discusses the widespread problem of token fraud—where bad actors abuse free trials, promo codes, and other mechanisms to steal API inference at the expense of AI product companies. She shares six types of abuse she's experienced, specific fraud examples, and details both technical and operational countermeasures she's implemented to protect her bootstrapped business.
He wants AI that keeps students doing the cognitive effort in math
The speaker emphasizes that AI in mathematics education should support student agency and cognitive effort rather than providing direct answers. Effective AI tools should interpret student ideas, encourage deeper thinking, and engage students in productive struggle while keeping them as active decision-makers in their learning process.
He put the family to-dos on a wall display Claude built
The speaker uses Dakboard, a wall display product, to make personal to-do items and information visible to their family. They had Claude build a script to scrape to-dos, upcoming trips, and other data from their database to display on the wall, including sections for immediate tasks, longer-term needs, and recent wins.