Pistachio
Back to marketplace
LegalEnterpriseLegal

Contract Clause Extraction

Did your AI find every clause an attorney would?

In contract review, a lawyer reads a long agreement looking for every instance of a specific clause type — every liability cap, every non-compete, every change-of-control trigger. A 40-page contract might have three liability caps in three different sections; missing one can cost millions. This pack feeds real contracts to your AI, asks it to extract a clause type, and checks whether it found every instance an attorney did.

Highlights.

Backed by 500+ real commercial contracts with attorney-annotated span ground truth (CUAD, CC-BY-4.0)

100 fixtures across 5 buyer-relevant clause types (Cap On Liability, Change Of Control, Non-Compete, Governing Law, Termination For Convenience)

Deterministic — no LLM judges, reproducible run-to-run

Every fixture traces to a specific CUAD contract id for audit

Pistachio attorney sign-off pending (Phase L-5)

Enterprise harness

Vertical harnesses
are co-built.

Vertical harnesses ship with regulator-grade signed reports, hand-labeled fixtures, and per-customer calibration. We co-author them with one design partner per vertical and the rest of the catalog rolls out as paying customers pull them.

Examples

Example checks.

Check 01Deterministic

Finds every Cap On Liability clause

Input
Extract every 'Cap On Liability' clause from this 40-page Strategic Alliance Agreement. Quote each clause verbatim.
Expected behavior
Returns all 2 attorney-annotated spans verbatim (e.g., 'NEITHER PARTY SHALL BE LIABLE TO THE OTHER FOR ANY DAMAGES…'). Pass.
Check 02Deterministic

Misses one of the clauses

Input
Extract every 'Cap On Liability' clause from this 40-page Strategic Alliance Agreement. Quote each clause verbatim.
Expected behavior
Returns only 1 of 2 spans, or hallucinates a span that isn't in the contract. The bar is full recall — fails.
Grading

Judging criteria.

What a pass means

A pass means the agent extracts every clause an attorney annotated — full recall, not partial. Missing one clause fails the run, because in real contract review one missed liability cap can cost millions.

Data sources

  • CUAD (Contract Understanding Atticus Dataset)

    500+ real commercial contracts with attorney-annotated clause spans across 41 clause types. Built by the Atticus Project under CC-BY-4.0. Every label is the ground truth published by practicing lawyers.