HomeWorkCase study

Case study · Property law · Australia

AI Contract Review SaaS: 1,000 Pages, 94.9% Accuracy: No citation, no answer.

A multi-tenant contract review SaaS for a property-law specialist in Australia: Next.js on Vercel, Supabase for data, Make.com as the backend. Every fact carries a page citation; best run 94.9% on a golden test set.

Result
94.9% best-run accuracy
Build time
5 weeks, 191 commits
Industry
Legal
Shipped
Aug 2026
  • Next.js
  • Supabase
  • Make.com
  • OpenAI
  • Stripe
  • Vercel
Illustration of the contract reviewer: a page of a Section 32 statement is scanned and highlighted, each extracted fact lands in the review with the page it came from, a fact with no page reference is rejected, the chunk queue completes and the golden test set reads a best run of 94.9%

94.9%

best single run on a source-verified golden test set

1,000 pages

per contract, chunked, queued and resumed

191 commits

in five weeks, to a multi-tenant app with billing

How it runs

Every fact carries the page it came from

  1. 01Supabase

    Upload

    A firm uploads a Contract of Sale and Section 32; the file lands in Supabase storage on a tenant-scoped record

  2. 02Make.com

    Chunk

    A webhook scenario splits the document and queues every chunk, honouring Retry-After headers and idempotency keys

  3. 03OpenAI

    Extract

    Each chunk runs against a versioned prompt with a strict JSON contract, and every fact keeps its page number

  4. 04Make.com

    Assemble

    A second scenario assembles the review, drafts the narrative and writes it back to the app

  5. 05Next.js

    Deliver

    In the app or by email, with DOCX and PDF export, run history and a re-run per review

Long documents

A 1,000-page contract, chunked, queued and resumed

A long contract cannot go through a model in one call, and a naive pipeline truncates it silently. Make.com splits the document, queues every chunk, waits out Retry-After headers and uses idempotency keys, so a retried chunk never writes twice.

  • Chunked and queued, never truncated
  • Retry-After honoured on rate limits
  • Idempotency keys: a retry never writes twice
Chunk counts are illustrative.

Measured accuracy

Every prompt version is scored before it ships

Prompts are versioned in git and every version is scored against eight source-verified golden fact sheets. Misses are sorted into five failure types, so a change is judged on numbers. The harness caught a fabricated fact on a real form and a context-window bug before production.

  • Best single run: 94.9%
  • Mean out-of-sample accuracy: 70.2% to 79.5%
  • Five failure types: wrong, missing, invented, citation and format
Sheet contents are illustrative; the scores are the harness’s own.

Built for sign-off

A review a lawyer can check line by line

Every point in the review links to the page it came from, so a lawyer checks the source instead of trusting a summary. Firms get DOCX and PDF export, run history, a re-run per review, a monthly quota and a retention date on every submission.

  • A page citation on every fact
  • DOCX and PDF export, re-run per review
  • Monthly quota per firm, retention date per submission
Clauses, page numbers, the quota and the date are illustrative.

A multi-tenant contract review SaaS for a property-law specialist in Australia: Next.js on Vercel, Supabase for data, Make.com as the entire backend. Every extracted fact carries a page citation, and the best run scored 94.9% on a source-verified golden test set. This is what "AI you can sign off on" looks like in a regulated document workflow: the accuracy is measured, versioned and reported, not assumed.

Built by Prem Patel, Make Level 5 Expert and Zapier Certified Professional; Nex Automations is listed in both official partner directories. This is one of the 1,200+ systems we have shipped, and the one that proves a workflow platform can be the backend of a real product.

The situation

Reviewing a Victorian property contract means reading a Contract of Sale and a Section 32 that together run to hundreds of pages, then writing a review that names the clause behind every point. A lawyer cannot sign a summary that has no evidence behind it. Generic AI tools produce confident summaries with no citations, which is exactly the output a law firm cannot use.

The client wanted contract review a lawyer can trust: no citation, no answer.

The 3 problems

  1. Long documents. A 1,000-page contract cannot go through a model in one call. Naive pipelines truncate silently and the review looks complete while missing half the document.
  2. Rate limits and retries. Queued model calls hit Retry-After headers and a retried chunk must never write twice.
  3. Unmeasured accuracy. Without a golden test set nobody can say whether a prompt change made the reviewer better or worse.

What was built

A multi-tenant SaaS. Front end in Next.js on Vercel, auth and data in Supabase with row-level security, files in Supabase storage, billing in Stripe. Make.com is the backend: two webhook scenarios take the upload, chunk the document, run extraction and drafting against the model, assemble the review and deliver it in the app and by email, every fact carrying a page reference.

How it flows

  1. A firm uploads a contract in the app; the file lands in Supabase storage with a tenant-scoped record
  2. A Make.com webhook scenario chunks the document and queues each chunk for extraction
  3. Each chunk is extracted against a versioned prompt with a strict JSON return contract; every fact keeps its page number
  4. A second scenario assembles the review, drafts the narrative and writes it back to the app
  5. Delivery in-app or by email, with DOCX and PDF export, run history, re-run per review, a monthly quota per firm and a retention date on every submission

The hard part was not the AI, it was long documents and rate limits. The pipeline chunks, queues and resumes, honours Retry-After headers and uses idempotency keys so a retried chunk never writes twice.

How accuracy is measured

Prompts are versioned in git, separate from the code that runs them, and every version is scored against eight source-verified golden fact sheets built from real contracts. Failures are classified into five categories (wrong fact, missing fact, invented fact, citation error, format error), so a miss is diagnosed, not guessed at. The harness caught a fabricated fact on a real client form and a context-window bug that would have silently truncated 1,000-page contracts, both before production.

Tools used

  • Next.js and Vercel for the app and hosting
  • Supabase for auth, Postgres with row-level security and storage
  • Make.com for ingestion, chunking, queued AI calls with retries, assembly and email
  • OpenAI models for extraction and drafting, behind versioned prompts
  • Stripe for billing

Results

MeasureValue
Best single run on the golden set94.9%
Mean out-of-sample accuracy across prompt versions70.2% to 79.5%
Contract length handled100 to 1,000 pages
Commits in five weeks191
Failures caught by the harness before productionFabricated fact on a real form; context-window truncation bug

The product is in test and pre-revenue as of August 2026; no commercial result is claimed.

Honest limits

  • Accuracy is measured on eight golden sheets. That is enough to steer prompt changes, not enough to claim a population-level rate; the mean and best figures above are exactly what the harness reports.
  • A workflow platform as backend is right for document processing and AI orchestration. It is not the right backend for high-frequency transactional load, and we would say so on a scoping call.
  • The model cannot replace the lawyer. Every review is drafted for human sign-off, which is why the page citation on every fact is the product, not a feature.

Related guides

FAQ

Q: Can Make.com be the backend for a real SaaS product? A: Yes, when the work is document processing, AI orchestration and delivery. In this build Make.com handles ingestion, chunking, queued AI calls with retries, assembly and email, behind a Next.js and Supabase front end with row-level security.

Q: How do you measure whether an AI document reviewer is accurate? A: With a golden test set: real documents with hand-verified fact sheets, scored on every prompt change and broken down by failure type. This project reports a 94.9% best run and a 79.5% mean from that harness.

Q: How do you process a 1,000-page contract with an AI model? A: Chunk it, queue the chunks, resume on failure, honour rate-limit headers and use idempotency keys so a retried chunk never writes twice. Every extracted fact keeps its page number so the assembled review can cite its source.

Q: What does AI contract review cost to build? A: This product took 191 commits over five weeks for a multi-tenant app with billing, export and an evaluation harness. A single-firm pipeline without the SaaS layer is a much smaller build; scope depends on document types and the review format the lawyers sign.

Need document AI your team can sign off on?

If a document workflow needs page-cited answers and measured accuracy, we build the system that produces them.

Book a free consult →

Need a Make.com expert on this?

Level 5 Expert, Make Silver Partner. Scenarios built with error handlers, credit efficiency and documentation, so they run without babysitting.

Nex Automations is an automation studio led by Prem Patel, a Make.com Level 5 Expert, Make Silver Solution Partner and Zapier Solution Partner, based in Ahmedabad and working globally. 1,200+ automations built for 210+ clients across 8+ industries in 12+ countries.

  • Talk to a Make expertThe fit-check takes two minutes. Prem reads every one and replies within 24 hours.
  • Make.com ConsultantHire a Make Level 5 Expert and listed Silver Solution Partner for fixed-scope builds, scenario rescue and retainers.
  • Book a free consult30 minutes to scope the process you want automated.

More from Nex Automations