Winston Weinberg, the co-founder and CEO of legal AI startup Harvey, stumbled into his company almost accidentally — using OpenAI's GPT-3 on a landlord-tenant pro bono case during his single year as a junior associate at O'Melveny & Myers. When he and co-founder Gabriel Pereyra tested the model on 100 legal questions and presented the answers to three practicing lawyers without disclosing the AI source, 86 out of 100 responses were judged good enough to send to clients. That informal experiment convinced them the technology was ready. OpenAI's own leadership, including Sam Altman, reportedly told them they hadn't realized GPT-3 was that capable in legal contexts. Harvey has since grown to an $11 billion valuation.
The core technical insight driving Harvey's approach is that legal reasoning maps almost perfectly onto chain-of-thought prompting — the method of having AI walk through a problem step by step. Law, at its heart, is about applying statutes and their interpretations to a specific fact pattern, which is exactly what chain-of-thought models do well. But Weinberg argues raw reasoning ability isn't the real bottleneck. The harder challenge is context: a commercial transaction may carry 50 to 100 years of institutional history, and the relevant knowledge often exists nowhere on the public internet. That forces Harvey to integrate deeply with clients' internal data systems, building firm- and client-specific intelligence that generic models can't replicate.
Weinberg believes the biggest disruption to law firm economics won't come from AI companies directly — it'll come from in-house corporate legal teams refusing to pay inflated associate billing rates for tasks AI can now do cheaply. His diagnosis of Big Law's current pricing model is blunt: a client paying $100,000 for a deal is really paying for a few hours of a top partner's judgment, but the bill is structured as hundreds of hours of junior associate research at $1,000 an hour. That structure, he argues, is going to break. He expects fixed fees for discrete tasks — like due diligence in M&A — to replace hourly billing for routine work, while advisory judgment remains the high-value product.
On the pipeline problem — what happens to junior lawyers who no longer do the rote work that traditionally built their expertise — Weinberg is cautiously optimistic. He argues associates need to do diligence 10 or 20 times to learn it, not 1,000 times, and that AI compression of repetitive work could actually revive a lost apprenticeship model in law firms. He draws an analogy to calculators and math education: the tool doesn't eliminate the need to understand the underlying process. He also floats a striking prediction — that AI arbitration between commercial parties could emerge within a few years, with both sides agreeing to trust an AI system as a neutral arbitrator, potentially less biased than a human.
The competitive moat question is one Weinberg takes seriously. He acknowledges it's a race, arguing that deep embedment in law firm workflows creates switching costs that make displacement by OpenAI or rivals like Legora increasingly difficult over time. He also points to a two-sided ecosystem effect: Harvey serves both law firms and the corporate clients who hire them, positioning itself as infrastructure sitting between the two. On the evaluation problem — how you verify AI legal work is actually trustworthy — he argues that generic AI lab benchmarks are becoming useless for vertical applications. What Harvey needs, he says, is evaluation frameworks specific enough to cover things like fund formation for a particular fund structure, across 70 jurisdictions, broken down by document type.
Gist is a free AI reader for your browser, iPhone, and Android. Get concise summaries and key takeaways from any article or podcast.
Get Gist — Free