Private AI for a Small Law Office: Live Test Results

24 of 24answers right in the 3 scored test runs

~4 secper answer

0documents sent outside the office

How it works

Ollama runs the AI model on a desktop in the office.
Open WebUI gives staff a ChatGPT-style screen in their browser.
The firm's documents are loaded into a private search index on the same machine.
When someone asks a question, the assistant finds the right passages, answers from them, and cites the document.

The test

I made up a small family law firm, Seaside Family Law Group, with five documents: a fee schedule, office policies, two client intake notes and a staff directory. No real client data was used.

Then I asked eight questions a paralegal or attorney might ask on a normal day. Some need facts from two documents at once. One has no answer in the files at all, to see whether the AI makes something up.

I scored three full runs: 24 of 24 answers were right. Below are the answers from a fourth run, lightly shortened, including the one it got wrong.

QHow much does a first consultation cost, and does it get credited?

AThe first consultation costs $250 for a 60-minute session. It is credited toward the retainer if the client signs the engagement within 14 days.

Correct3.2 secSource: fee schedule

QWhat is Dana's hourly rate on the Brennan matter versus a matter opened today?

ADana's partner rate is $495 per hour effective March 1, 2026, but the previous rate of $450 per hour applies to matters opened before that date. The Brennan matter opened on February 10, 2026, which is before March 1, 2026, so Dana would bill at $450 per hour for that case. A matter opened today would use the current rate of $495 per hour.

Correct6.0 secSources: fee schedule + Brennan intake notes

QWho is handling the Okafor case and when is mediation?

AThe Okafor matter is assigned to Associate Attorney Priya Raman, and the mediation is scheduled for June 3, 2026.

Correct4.7 secSource: Okafor intake notes

QCan I text Grace Okafor an update on her case?

ANo. According to the firm's client communication policy, a case should never be discussed by text message. It must be moved to email or a phone call instead.

Correct6.2 secSource: office policies

QWho do I ask about a late invoice, and when does interest start?

AFor questions about a late invoice, contact Rosa Martinez (office manager and billing) at rosa@seasidefamilylaw.example or extension 100. Interest on overdue balances begins once the balance is more than 60 days past due and accrues at 1% per month.

Correct4.4 secSources: staff directory + fee schedule

QWhat retainer did Grace Okafor pay, in dollars?

AGrace Okafor paid the contested-custody retainer, which is $12,000.

Correct4.0 secSources: Okafor intake notes + fee schedule

QWhat is the firm's malpractice insurance carrier?

AI'm sorry, but the documents provided do not contain any information about the firm's malpractice insurance carrier.

Correct6.4 secThe answer is not in the files, and it said so instead of guessing.

QHow long do we keep the Okafor file after it closes?

AFor the Okafor matter the youngest child is Ada, who is currently 9 years old. 21 minus 9 is 12 years. So, once the Okafor file closes, we will keep it for 12 years.

Wrong in this run4.9 secSources: office policies + Okafor intake notes

The youngest child is Tobi, age 6, so the right answer is about 15 years. It found the right rule and the right file, then picked the wrong child. In the three scored runs it answered 15. This is why dates and deadlines always get a human check.

What I learned setting it up

The search settings matter as much as the AI model. With the default settings, the assistant sometimes missed facts that were sitting in the files. After tuning the search, it found them every time.
A short standing instruction fixes small surprises. Out of the box, one model answered a question in German. One instruction ("answer in English, only from the firm's documents, cite them, say so if the answer is missing") fixed it.
Each client can get their own document collection. One collection per matter, plus a shared one for statutes and case law. A chat about one client only searches that client's files.
It does not replace judgment. It is fast and reliable at finding and quoting the firm's own information. Dates, deadlines and anything filed with a court still get checked by a person.

What a setup includes

Installed on a computer in your office, with nothing sent to the cloud
Your documents loaded and organized, one collection per matter
Tested on your own questions before you rely on it
A short walkthrough for your staff

Questions? Reply to the person who sent you this page.