GPT-6.1 Terra Hallucinations: 20 Law Questions, 16 Letters

QUANTSLANT_ Benchmarks

quantslant@ai:~$ cat news_1 › OpenAI says GPT-6.1 Terra makes far fewer factual errors than its predecessor.

quantslant@ai:~$ cat news_2 › I tested that claim against Polish law because, in my first test, Terra cited the wrong provision in a letter to a Polish tax office.

quantslant@ai:~$ cat news_3 › Asked directly about 16 legal provisions and 4 fictional laws, it answered all 20 questions correctly.

quantslant@ai:~$ cat news_4 › But when it drafted the same request for payment in instalments 16 times, 4 letters again cited a provision about tax remission.

GPT-6.1 Terra Hallucinations: 20 Law Questions, 16 Letters

quantslant@ai:~$ open --full Read more Open article on quantslant.com