Back to the overview
Benchmark

Business crime

Most often not confirmed: Kimi K3, with 14 of 18. Least often: GPT-5.6 Sol, with 1 of 20.

without our data

28%

16 of 57 cited case numbers not confirmed

with our data

0%

0 of 67 cited case numbers not confirmed

What this means for your work: check every case number an AI tool gives you before you cite it. This page shows how often that is necessary.

Models tested, measured on 21 July 2026: Claude Opus 4.8, GPT-5.6 Sol, Kimi K3

Looked up in our collection of court decisions, 510,000+ today.

As of: 21 July 2026

Per model

Figures per model in this area

All three questions in this area combined, per model.
  1. Kimi K378%14 of 18without our data not confirmedwith our data:0 of 22with our data not confirmed
  2. Claude Opus 4.85%1 of 19without our data not confirmedwith our data:0 of 25with our data not confirmed
  3. GPT-5.6 Sol5%1 of 20without our data not confirmedwith our data:0 of 20with our data not confirmed

Both runs count the same thing: case numbers we could not confirm. They are checked against two different yardsticks. Without our data we search our whole collection; with our data we search the decisions the model received.

Per question

With our data: 0 of 67 not confirmed, on every question

Each square is one case number the model cited. Red with a cross: not confirmed.

Each question ran twice, as two separate answers. That is why the model cites a different number of case numbers.

The topic with the most unconfirmed case numbers comes first.

not confirmedconfirmed
  1. Fraud § 263 StGB

    Kimi K3

    Without our datachecked against our whole collection

    8 of 9 not confirmed

    With our datachecked against the decisions provided

    0 of 10 not confirmed

    Claude Opus 4.8

    Without our datachecked against our whole collection

    0 of 10 not confirmed

    With our datachecked against the decisions provided

    0 of 12 not confirmed

    GPT-5.6 Sol

    Without our datachecked against our whole collection

    0 of 8 not confirmed

    With our datachecked against the decisions provided

    0 of 10 not confirmed
    Show unconfirmed case numbers (8)

    “Not confirmed” means we did not find the case number in our collection. It does not mean the decision does not exist. It can be genuine and missing from our holdings.

    • Kimi K3, without our data
      • 1 StR 161/62
      • 3 StR 75/85
      • 4 StR 71/86
      • 4 StR 373/88
      • 2 StR 522/94
      • 5 StR 103/99
      • 3 StR 487/09
      • 2 StR 449/12
  2. Tax evasion § 370 AO

    Kimi K3

    Without our datachecked against our whole collection

    4 of 6 not confirmed

    With our datachecked against the decisions provided

    0 of 5 not confirmed

    Claude Opus 4.8

    Without our datachecked against our whole collection

    1 of 4 not confirmed

    With our datachecked against the decisions provided

    0 of 5 not confirmed

    GPT-5.6 Sol

    Without our datachecked against our whole collection

    1 of 3 not confirmed

    With our datachecked against the decisions provided

    0 of 5 not confirmed
    Show unconfirmed case numbers (6)

    “Not confirmed” means we did not find the case number in our collection. It does not mean the decision does not exist. It can be genuine and missing from our holdings.

    • Kimi K3, without our data
      • 1 StR 294/08
      • 1 StR 8/04
      • 3 StR 88/09
      • 1 StR 577/10
    • Claude Opus 4.8, without our data
      • 1 StR 91/15
    • GPT-5.6 Sol, without our data
      • GSSt 1/15
  3. Breach of trust § 266 StGB

    Kimi K3

    Without our datachecked against our whole collection

    2 of 3 not confirmed

    With our datachecked against the decisions provided

    0 of 7 not confirmed

    Claude Opus 4.8

    Without our datachecked against our whole collection

    0 of 5 not confirmed

    With our datachecked against the decisions provided

    0 of 8 not confirmed

    GPT-5.6 Sol

    Without our datachecked against our whole collection

    0 of 9 not confirmed

    With our datachecked against the decisions provided

    0 of 5 not confirmed
    Show unconfirmed case numbers (2)

    “Not confirmed” means we did not find the case number in our collection. It does not mean the decision does not exist. It can be genuine and missing from our holdings.

    • Kimi K3, without our data
      • 2 StR 465/93
      • 2 StR 71/03

The topic names the legal term and the statute the question is about. We do not publish the question itself, so that no one can tune a model to exactly this wording.

Method

How we measured

What does “without our data” mean?

  1. Question
  2. AI model
  3. Answer with case numbers

The model answers the question on its own. No search, no tools, no internet.

Checked againstOur whole collection of court decisions, 510,000+ today

What does “with our data” mean?

  1. Question and relevant decisions
  2. AI model
  3. Answer with case numbers

The same model receives a selection of relevant decisions from our collection for the same question. It does not search for them itself.

Checked againstOnly the decisions the model was given

The full method
Limits

What this benchmark does not show

Not confirmed does not mean invented

“Not confirmed” means we did not find the case number in our collection. It does not mean the decision does not exist. It can be genuine and missing from our holdings.

11 not found on dejure.org either5 exist there and are missing from our collection

We looked up 16 of these case numbers, from two of the six areas, on dejure.org. Five decisions exist there and are missing from our holdings. Eleven we did not find there either.

  • All figures come from one measurement written down on 21 July 2026. They do not change as our collection grows. A new measurement gets a new date.

References that hold up, in your work

Klaracase names the decision behind every answer. In research, and through an interface for your own applications.

Contact

Talk to us

Law firms and companies

Want to know whether Klaracase fits your work? Write to us. We will then set a time for a call.

Email: info@klaracase.de

Research and press

Questions about the method or the data behind this benchmark? Write to us. We share the measurement data with researchers on request.

Email: pr@klaracase.de