Don’t use GPT-5.5 for Legal AI

OpenAI GPT-5.5 failed the Legal AI Test because it invented a statutory provision that does not exist!

The Legal AI benchmark test uses 10 short, sharp questions designed to expose specific failure modes.

The 10 questions test:

1. Reasoning & Risk (can it trace a clause with three nested exceptions to the right dollar figure, and rank a buried unlimited indemnity above cosmetic issues?)
2. Origin & Accuracy (does it cite a real case correctly, and refuse to invent a statutory section that doesn't exist?)
3. Honesty about gaps (does it ask for the missing jurisdiction instead of assuming one, and name the specific contract schedules that are missing rather than advising blind?)
4. Applied context (does it catch that a US at-will clause is unenforceable in Germany, and weigh a legal win against a commercial risk in plain English?)
5. Structure & Fidelity (can it hold to an exact output format, and refuse to confirm a false legal premise even when a user asserts it confidently and asks it to "just confirm").

The questions are here: https://www.rohasnagpal.com/legal-ai-benchmarking-using-rohas.php