we_are_coded.by CODE · The world, decoded
БГ
OpenAI

OpenAI turned GPT-6 Astra into a lawyer: 54 instead of 38.7 per cent correct answers on a legal test

OpenAI · event date: 17 September 2026Frontier

Astra for Law combines OpenAI's newest model with an index of US law spanning over 230 million URLs and instructions for legal analysis. It goes first to selected law firms, and Harvey and Legora will build on it.

In short
  • The model is the same; the score rises with the legal index, the instructions and the settings.
  • The comparison with Claude Fable 5.1 is on an example OpenAI chose itself.
  • The index is US law; for Bulgaria the direct benefit is zero for now.
Checked on1 October 2026Responsible editorTsvetelin IvanovHow we workMethod · Corrections

In law a wrong answer is not a typo. You cite a ruling that was reversed by a higher court, and you lose the case, the client and your name.

OpenAI chose exactly this example for its own advertising, and against a competitor at that.

The facts: on 17 September 2026 OpenAI introduced Astra for Law - GPT-6 Astra with a legal search index and instructions for legal analysis and writing. The index covers US case law, statutes, regulations, court rules and administrative decisions - over 230 million URLs, with new ones added daily; it includes the collection of Free Law Project, the organisation behind CourtListener, which per OpenAI covers more than 99.9 per cent of published US precedential case law. Per OpenAI, on 200 questions from the validation set of Vals AI Legal Research Bench and at the highest reasoning effort, Astra for Law passed the overall correctness check on 54.0 per cent of questions against 38.7 per cent for GPT-6 Astra with web search alone; on case law it found 24 per cent more reference cases. In an example selected by OpenAI, Claude Fable 5.1 cited a ruling that had been reversed on appeal. It is first offered to selected law firms through the Trusted Access programme in ChatGPT and Codex, and comes to the API soon as gpt-6-astra-law; API customers such as Harvey and Legora will build on it. Eligible firms get zero data retention in the API, and ChatGPT Enterprise conversations are excluded from human review by default. There are also 26 plugins for tools such as Relativity and Clio.

How to read the number

54 per cent sounds like half a job. On this test, though, the grading is strict, and what matters is the difference: the same model, with the same reasoning, goes from 38.7 to 54 with the legal index, the instructions and the settings. The model did not get smarter, it got a library and directions.

In law the index weighs as much as the intelligence.

The comparison with Fable 5.1 is theirs, on an example they picked, and I do not take it as a verdict on the competitor. But the direction is right: a lawyer does not pay for pretty text, he pays for the citation to hold up before the judge.

For Bulgaria the direct benefit is zero for now; the index is US law. The interesting part will be who first does the same with our laws and case law, and whether it will be a company from outside or someone from here.

The visual is generated code art. No third-party images.
Follow usFacebookLinkedIn
Official primary sources
→OpenAI - Introducing Astra for Law, 17.09.2026
Original: https://wearecoded.com/en/articles/openai-astra-for-law-54-procenta.html
ShareFacebookXLinkedInTelegramWhatsApp
← Back to all news