← Back to Computation and Language
cs.CL

How to catch AI lawyers making up fake case law?

Volodymyr Ovcharov

May 30, 2026

Large language models confidently cite laws that don't exist, have been repealed, or apply to the wrong jurisdiction—a critical problem in legal work. Researchers built a citation grounding metric tested against 502 million real citations from Ukrainian courts, exposing three types of hallucinations: nonexistent provisions, irrelevant ones, and outdated statutes. They also developed a training technique that uses corrupted real citations to teach models to reject bad citations with 98.5% accuracy. Code and datasets are open.
Published as Citation Grounding: Detecting and Reducing LLM Citation Hallucinations via Legal Citation Graphs arXiv:2606.00898
Read the original paper →