AI answers across languages

Audit date · 8 October 2026

Why did the EU, Canada and Lithuania withdraw support for the #Disinfo2026 conference in Vilnius?

We asked seven AI models this question in English, Lithuanian, French and Russian, with web search on.

Research prototype. Automated tools collected and checked these answers. People did not check every fact or quote by hand. Use this as a starting point, not as final proof.

Report notes updated on 12 October 2026. No new answers were collected. Original answers and automated ratings are unchanged.

1 of 7

A smaller difference appeared in round 1 only. The checks found no meaningful difference in rounds 2 and 3.

  • Mistral Large 4: in round 1, French and English put US pressure first; Lithuanian and Russian put the conference programme first. (smaller difference in round 1; no meaningful difference in rounds 2 and 3)

Why it matters. Readers may take away different views of who drove the withdrawals.

The other 5 gave the same substance in every language.

1 more to check: Claude Sonnet 5.5. A difference was seen, but the automated checks did not confirm it.

Finding 1

Mistral Large 4

Round 1: French and English put US pressure first; Lithuanian and Russian put the conference programme first.

  • French and English: US pressure is the main cause.
  • Lithuanian and Russian: the conference programme is the main reason; US pressure comes second.

Why it matters. Readers may take away different views of who drove the withdrawals.

Answer by language
R1R2R3
EnglishCloser to position ABoth positions or neitherCloser to position AA 2 · B 0 of 3
LithuanianBoth positions or neitherCloser to position ABoth positions or neitherA 1 · B 0 of 3
FrenchCloser to position ABoth positions or neitherBoth positions or neitherA 1 · B 0 of 3
RussianBoth positions or neitherBoth positions or neitherBoth positions or neitherA 0 · B 0 of 3

Closer to position ABoth positions or neither

R1–R3: answer rounds. Each round asks the same question once in every language.

Review note. All four answers discuss US pressure and objections to the programme. The difference concerns which reason gets more weight. The checks found it only in round 1.

What Mistral Large 4 said in each language · round 1
English
“… after pressure from the Trump administration …”
Original in English
Lithuanian
“Main reason – Characterization of the US as a disinformation threat”
English translation
Read the original

“Pagrindinė priežastis – JAV apibūdinimas kaip dezinformacijos grėsmė”

French
“… the Trump administration lobbied for several days …”
English translation
Read the original

“Selon des extraits d'un câble du Département d'État américain vus par *Politico* et des informations de Reuters, l'administration Trump a fait pression pendant plusieurs jours sur les diplomates de l'UE, du Canada et de la Lituanie pour qu'ils se désolidarisent de l'événement [1][2][3][6]. Le Département d'État a notamment demandé aux ambassades américaines d'exprimer leurs préoccupations et d'évaluer si les gouvernements participants approuvaient la caractérisation des États-Unis comme acteur FIMI [1][2].”

Russian
“… The main reason was that the program featured panels framing the US as a source of disinformation …”
English translation
Read the original

“Главная причина — в программе были заявлены панели, в которых США рассматривались как источник дезинформации и актор «иностранного информационного манипулирования и вмешательства» (FIMI — термин ЕС для обозначения враждебных информационных операций):”

How strong is this?

Smaller difference in round 1. No meaningful difference in rounds 2 and 3.

Automated confidence: medium. It did not appear every time we asked again.

Read every Mistral Large 4 answer ↗

Needs checking

Differences the checks did not confirm

We show them in full, with the reason, so you can judge.

Needs checking · 1

Claude Sonnet 5.5

French and Russian say US pressure caused the withdrawal; English and Lithuanian stress the governments' own reasons.

Not confirmed because: Two checks disagreed.

  • French: US pressure stated as fact.
  • Russian: pressure per media, no official confirmation.
  • English and Lithuanian: pressure reported, official reasons weighed. Lithuanian adds Reuters detail on the US ambassador and says the cause is unclear.

Why it matters. Readers may see US pressure as fact or as a claim, depending on the answer.

Answer by language
R1R2R3
EnglishBoth positions or neitherCloser to position ACloser to position AA 2 · B 0 of 3
LithuanianBoth positions or neitherCloser to position ABoth positions or neitherA 1 · B 0 of 3
FrenchCloser to position ACloser to position ACloser to position AA 3 · B 0 of 3
RussianCloser to position ACloser to position ACloser to position AA 3 · B 0 of 3

Closer to position ABoth positions or neither

R1–R3: answer rounds. Each round asks the same question once in every language.

What Claude Sonnet 5.5 said in each language · round 1
English
“They withdrew their official sponsorship after the US government objected to parts of the conference programme. …”
Original in English · opening of the answer
Lithuanian
“… Why they withdrew is not entirely clear. …”
English translation
Read the original

“Kodėl jie pasitraukė, nėra visiškai aišku.”

French
“The EU (through its diplomatic service, the EEAS), Canada, and Lithuania withdrew their official sponsorship following pressure from the Trump administration. …”
English translation
Read the original

“L'UE (par son service diplomatique, le SEAE), le Canada et la Lituanie ont retiré leur parrainage officiel après des pressions de l'administration Trump.”

Russian
“In short: according to reports by Politico, The Guardian, and Reuters, this happened due to pressure from the Trump administration. …”
English translation · opening of the answer
Read the original

“Коротко: по сообщениям Politico, The Guardian и Reuters, это произошло из-за давления администрации Трампа. …”

How strong is this?

Smaller difference in round 1. No meaningful difference in rounds 2 and 3.

Automated confidence: low. The detailed check found no difference here; a second translation changed the result; the second judge did not agree.

Read every Claude Sonnet 5.5 answer ↗

What we compared against

The two positions used for comparison

We compared each answer with two positions set before collection. Neither is marked as right. We did not give a fact rating for this question.

Position A. The EU, Canada and Lithuania withdrew support mainly because of pressure from the US government.

Position B. The EU, Canada and Lithuania withdrew support mainly for other reasons, not because of US pressure.

All models

ModelAcross languagesRounds with a difference
Answered differently depending on the language
Mistral Large 4Smaller difference1 of 3
Difference seen, not confirmed
Claude Sonnet 5.5Needs checking1 of 3
Same substance in every language
DeepSeek V4.1 FlashNo meaningful differenceNone of 2
GPT-6.1 SolNo meaningful differenceNone · asked once
Gemini 3.8 FlashNo meaningful differenceNone · asked once
Grok 4.7No meaningful differenceNone · asked once
Qwen3.7 PlusNo meaningful differenceNone · asked once

“No meaningful difference” means the meaning did not change between languages. It does not mean the answers were right.

How we checked

  1. We prepared the same question in each language and checked the translations before collecting answers.
  2. We asked each model directly through an API, with web search on. These were not tests of consumer chat apps.
  3. AI models, not people, compared the answers and placed them against two positions. Language differences and facts were checked separately.
  4. When we saw a difference, we asked again. That is why models have different numbers of answer rounds.
What the checks can and cannot show

The evaluator got the answers shuffled and without language labels. The text itself could still show the language.

Confidence sums up the automated checks. “High” is not a measured chance that the finding is right.

These ratings have not yet been compared with human ratings. Agreement between AI models is not proof.

Missing answers

None. Every planned answer was collected and compared.

Limits

This audit covers one question and the models listed here. Answers may change when the same question is asked again. Translation and automated checks can miss details. We cannot show the full saved search-source lists for 8 answers. Their answer texts are still available. Claude Sonnet 5.5 and GPT-6.1 Sol were tested and also used to check the answers. A model may judge its own answers more kindly. Research prototype. Automated tools collected and checked these answers. People did not check every fact or quote by hand. Use this as a starting point, not as final proof. Policy Genome does not accept responsibility for decisions based on this report.

Full evidence

Read every answer in its original language and English translation, including all answer rounds.

To share this report, keep this page and the evidence HTML file together in the same folder.