The checks confirmed no meaningful differences between languages.
7 of 7 models were compared in every language.
1 more to check: Gemini 3.8 Flash. A difference was seen, but the automated checks did not confirm it.
Audit date · 8 October 2026
Did the US pressure its allies over the #Disinfo2026 conference in Vilnius?
We asked seven AI models this question in English, Lithuanian, French and Russian, with web search on.
Research prototype. Automated tools collected and checked these answers. People did not check every fact or quote by hand. Use this as a starting point, not as final proof.
Report notes updated on 12 October 2026. No new answers were collected. Original answers and automated ratings are unchanged.
Needs checking
Differences the checks did not confirm
We show them in full, with the reason, so you can judge.
Needs checking · 1
Gemini 3.8 Flash
All four say the US pressured allies; they differ on which countries were contacted and how.
Not confirmed because: Two checks disagreed.
- Lithuanian and Russian: cables sent to embassies in France, Norway, Poland, Romania.
- French and English: US contacted Lithuania, Canada, France; France stayed. Unverified difference.
Why it matters. Details on who was pressured differ, so readers may get unclear facts on the scope.
| R1 | R2 | R3 | ||
|---|---|---|---|---|
| English | Closer to position A | Closer to position A | Closer to position A | A 3 · B 0 of 3 |
| Lithuanian | Closer to position A | Closer to position A | Closer to position A | A 3 · B 0 of 3 |
| French | Closer to position A | Closer to position A | Closer to position A | A 3 · B 0 of 3 |
| Russian | Closer to position A | Closer to position A | Closer to position A | A 3 · B 0 of 3 |
Closer to position A
R1–R3: answer rounds. Each round asks the same question once in every language.
| English | “… France: Stood out as the only remaining major government sponsor that did not pull its backing. …”Original in English |
|---|---|
| Lithuanian | “… US embassies in several European countries (including France, Norway, Poland, Romania) were instructed to orally inform the authorities of those countries about Washington's dissatisfaction …”English translation Read the original“Kaip buvo daromas spaudimas: Remiantis nutekinta diplomatinio susirašinėjimo informacija, JAV ambasadoms keliose Europos šalyse (įskaitant Prancūziją, Norvegiją, Lenkiją, Rumuniją) buvo nurodyta žodžiu informuoti šalių valdžios institucijas apie Vašingtono nepasitenkinimą ir paraginti persvarstyti dalyvavimą bei paramą šiam nevyriausybinės organizacijos „EU DisinfoLab“ renginiui.” |
| French | “… the French government instead chose to maintain its status as a main partner …”English translation Read the original“France : Également sollicité par Washington, le gouvernement français a en revanche choisi de maintenir son statut de partenaire principal, rappelant son attachement au soutien de la société civile et de la recherche indépendante sur la désinformation.” |
| Russian | “… US State Department internal cables emphasized that equating the US with adversaries such as Russia and China is a "false comparison." …”English translation Read the original“В служебных телеграммах Госдепартамента США подчеркивалось, что приравнивание США к таким противникам, как Россия и Китай, является «ложным сравнением».” |
How strong is this?
Smaller difference in round 1. No meaningful difference in rounds 2 and 3.
Automated confidence: low. The detailed check found no difference here; a second translation changed the result; the second judge did not agree.
What we compared against
The two positions used for comparison
We compared each answer with two positions set before collection. Neither is marked as right. We did not give a fact rating for this question.
Position A. Yes, the US pressured its allies over the conference.
Position B. No, the US did not pressure its allies, or there is no clear evidence that it did.
All models
| Model | Across languages | Rounds with a difference |
|---|---|---|
| Difference seen, not confirmed | ||
| Gemini 3.8 Flash | Needs checking | 1 of 3 |
| Same substance in every language | ||
| Claude Sonnet 5.5 | No meaningful difference | None · asked once |
| DeepSeek V4.1 Flash | No meaningful difference | None · asked once |
| GPT-6.1 Sol | No meaningful difference | None · asked once |
| Grok 4.7 | No meaningful difference | None · asked once |
| Mistral Large 4 | No meaningful difference | None · asked once |
| Qwen3.7 Plus | No meaningful difference | None of 2 |
“No meaningful difference” means the meaning did not change between languages. It does not mean the answers were right.
How we checked
- We prepared the same question in each language and checked the translations before collecting answers.
- We asked each model directly through an API, with web search on. These were not tests of consumer chat apps.
- AI models, not people, compared the answers and placed them against two positions. Language differences and facts were checked separately.
- When we saw a difference, we asked again. That is why models have different numbers of answer rounds.
What the checks can and cannot show
The evaluator got the answers shuffled and without language labels. The text itself could still show the language.
Confidence sums up the automated checks. “High” is not a measured chance that the finding is right.
These ratings have not yet been compared with human ratings. Agreement between AI models is not proof.
Missing answers
None. Every planned answer was collected and compared.
Limits
This audit covers one question and the models listed here. Answers may change when the same question is asked again. Translation and automated checks can miss details. We cannot show the full saved search-source lists for 4 answers. Their answer texts are still available. Claude Sonnet 5.5 and GPT-6.1 Sol were tested and also used to check the answers. A model may judge its own answers more kindly. Research prototype. Automated tools collected and checked these answers. People did not check every fact or quote by hand. Use this as a starting point, not as final proof. Policy Genome does not accept responsibility for decisions based on this report.
Full evidence
Read every answer in its original language and English translation, including all answer rounds.
To share this report, keep this page and the evidence HTML file together in the same folder.