OpinionInsightful

LLMs That Write Well

Y Combinator

LLMs have improved at coding and math but declined in writing quality, producing more robotic output than earlier models. This tradeoff stems from structural reward signals that prioritize technical tasks, creating a market opportunity for startups focused on conversational quality.

Summary

The speaker argues that recent LLM development represents a counterintuitive regression in writing capability despite overall model improvements. While LLMs have demonstrably gotten better at coding and mathematical tasks, they have simultaneously gotten worse at writing—a decline that is perceptible and measurable rather than imagined. The current generation of models produces noticeably more robotic and less engaging prose compared to models from 2024-2025. The speaker characterizes this as a structural issue rather than a temporary setback, indicating a fundamental misalignment in how these models are being optimized. The root cause is identified as the reward signals used during training: the same optimization objectives that make models excel at code and math actively work against developing natural, stylistically varied writing. Given that major AI labs face tradeoffs, they consistently prioritize coding performance over literary quality when forced to choose. This structural preference creates an underserved market opportunity for a startup or team that specifically prioritizes producing models optimized for engaging, natural-sounding conversation and writing quality.

Key Insights

  • Current LLM models sound more robotic than 2024-2025 models despite overall improvements in coding and math capabilities
  • The decline in writing quality is a structural issue rather than a temporary glitch
  • The same reward signals that optimize models for coding actively flatten their writing style
  • Major labs will prioritize coding performance over writing quality when forced to choose between them
  • The gap between current models' writing quality and user expectations creates a business opportunity for startups focused on conversational quality

Topics

LLM capability tradeoffs between coding and writingModel optimization and reward signal designDecline in language model writing qualityMarket opportunity in conversational AILab prioritization strategies

Transcript

[0:00] As LLM's have gotten better at coding and math, they've actually gotten worse at writing. You're not just imagining it. The current models really do sound more robotic than the models from 2024 and 2025. This appears to be not just a temporary glitch, but a structural issue. The same reward signals that make models good at code actively flatten their style. If forced to choose, the major labs will always focus on coding over great writing. This has left open an opportunity for a startup that cares about producing a model that people like [0:30] talking to. Maybe that's the opportunity for you.

Full transcript available for MurmurCast members

Sign Up to Access

More from Y Combinator

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.