Token fraudsters relayed their AI product through ChatPRD
The founder of Chat Purity discusses token fraud, where bad actors authenticate as their service and relay requests from their own AI products through Chat Purity to appear legitimate. Despite existing technical controls, fraudsters employed reverse proxies and relay systems to obscure their activity, creating inefficient and suspicious infrastructure.
Summary
The speaker, identified as the solo founder of Chat Purity, explains that token fraud has become a significant problem consuming most of their engineering resources over the past year. The fraud scheme involved bad actors authenticating themselves as Chat Purity users in a web browser environment, then taking requests from AI products they were selling and routing them through Chat Purity's infrastructure before returning the responses to their customers. This created a relay system where fraudsters essentially used Chat Purity as a pass-through service to give their products false legitimacy. Despite Chat Purity having technical controls in place to detect and prevent unauthorized requests, the fraudsters implemented multiple layers of reverse proxies and relay systems on top of their products. The speaker characterizes these relay systems as hyper-inefficient and likely performing poorly, but notes that they were intentionally constructed in this bizarre manner—suggesting the fraudsters prioritized obscuring their activity over operational efficiency.
Key Insights
- Bad actors were authenticating as Chat Purity in web browsers while routing requests from their own AI products through Chat Purity's infrastructure and back to appear legitimate
- Token fraud has consumed the majority of Chat Purity's engineering energy and the founder's time over the past year
- Fraudsters implemented multiple layers of reverse proxies and relay systems despite knowing these would be hyper-inefficient and poorly performant
- Chat Purity had existing technical controls in place to block fraudulent requests, yet fraudsters found ways to work around them through relay infrastructure
- The fraudster's relay infrastructure was deliberately constructed in bizarre, inefficient ways, suggesting they prioritized obscuring their activity over operational efficiency
Topics
Transcript
[0:00] If you think AI slop is bad, let me introduce you to my new very unwelcome best friend, token fraud. I am the solo founder of Chat Purity. The last year I have been spending more and more of my time and almost all of our engineering energy focused on blocking one thing, token fraud. One wild example, they were like authenticated as Chat Purity in a web browser and then would like take requests from their AI product that they were selling and like send them to Chat [0:31] Purity and then send them back. And we already had technical controls around these requests, but it was really bizarre to see like the relays that were being put…
Full transcript available for MurmurCast members
Sign Up to AccessMore from How I AI
Fraudsters wrote PRDs on how to scam my AI product
An AI product founder shares critical lessons about preventing fraud and abuse of AI services, emphasizing that fraudsters actively create detailed plans to exploit AI platforms. Key defenses include monitoring costs instead of request counts, verifying clients thoroughly, and implementing strict policies with no exceptions.
I use Stripe Radar to catch card testing before it costs me
The speaker explains how to use Stripe Radar to prevent card testing fraud by leveraging built-in fraud rules, fingerprint detection, and Spot ID verification. These tools help identify suspicious payment patterns and validate that requests originate from legitimate app users, while allowing tuning to minimize false positives for good users.
How I fight token fraud as an AI founder
Claire, founder of ChatPRD, discusses the widespread problem of token fraud—where bad actors abuse free trials, promo codes, and other mechanisms to steal API inference at the expense of AI product companies. She shares six types of abuse she's experienced, specific fraud examples, and details both technical and operational countermeasures she's implemented to protect her bootstrapped business.
He wants AI that keeps students doing the cognitive effort in math
The speaker emphasizes that AI in mathematics education should support student agency and cognitive effort rather than providing direct answers. Effective AI tools should interpret student ideas, encourage deeper thinking, and engage students in productive struggle while keeping them as active decision-makers in their learning process.
He put the family to-dos on a wall display Claude built
The speaker uses Dakboard, a wall display product, to make personal to-do items and information visible to their family. They had Claude build a script to scrape to-dos, upcoming trips, and other data from their database to display on the wall, including sections for immediate tasks, longer-term needs, and recent wins.