=== albert. benchmark eval — ENGLISH TRANSLATION ===
Source: bench_v3.0_2026-05-18_060957.txt
──────────────────────────────────────────────────

[P1] in the beginning god created the
  [A]  lighttern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head head light oftenity � lighttern find a United became several a
  [B]  lighttern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head Statestern head head light oftenity � lighttern find a United became several a
       12.0 tok/s  83ms/tok

[P2] die Geschichte der Europäischen Union begann
  [A]  � headExeg Unitedtern head became structure knownists light other which� design country� Unitedtern find” Bar UnitedOn   ." 6 leftAStern� Unitedized area** socialEROnhip � ro find lighthipana area languageIS oftenéesoideSTICJ   lightCh light States language designCh
  [B]  � headExeg Unitedtern head became structure knownists light other which� design country� Unitedtern find” Bar UnitedOn   ." 6 leftAStern� Unitedized area** socialEROnhip � ro find lighthipana area languageIS oftenéesoideSTICJ   lightCh light States language designCh
       13.0 tok/s  77ms/tok

[P3] the ternary number system uses three distinct
  [A]  ib   On National designumb� lightuss."IAhed languageJpr   On still nameordj language de post areaReISors 6 find organ NationalIS imEx yearJ headIA alongtern rel early findient**IC orown."Jward  MayIStern United il StatesnoARED United�
  [B]  ib   On National designumb� lightuss."IAhed languageJpr   On still nameordj language de post areaReISors 6 find organ NationalIS imEx yearJ headIA alongtern rel early findient**IC orown."Jward  MayIStern United il StatesnoARED United�
       15.6 tok/s  64ms/tok

[P4] once upon a time in a kingdom far
  [A]  IS ste."olog newEx"tern� lighticallyEx."Ch-- stillaz� eraED"tern real United States findhipJ including find arED fourEx X fourST newious sobre� foundIN -car language few personIA United att United designED�ChED findATSTious language."
  [B]  IS ste."olog newEx"tern� lighticallyEx."Ch-- stillaz� eraED"tern real United States findhipJ including find arED fourEx X fourST newious sobre� foundIN -car language few personIA United att United designED�ChED findATSTious language."
       14.5 tok/s  69ms/tok

[P5] was ist das ternäre Zahlensystem und wie funktioniert
  [A]  ISainilyIS��tern UnitedExAN IS ste."IS oftenER Tr� became UnitedP along came design, and designIA alleEx thatSTIStern States rel whichIS ste and Ї several headj�ISilyo inc States puto� less  Ex non becameERically
  [B]  ISainilyIS��tern UnitedExAN IS ste."IS oftenER Tr� became UnitedP along came design, and designIA alleEx thatSTIStern States rel whichIS ste and Ї several headj�ISilyo inc States puto� less  Ex non becameERically
       12.7 tok/s  79ms/tok

[P6] the EU AI Act entered into force on
  [A]  modence� find languageLe United � ExikistsCh languageEx known herEx language il becameHeicallyEx,ily took States." known23IS aroundtern UnitedERESExICtern AT ternIS often.ternledhip   Le family old-- and yearatingtern lightrac UnitedCh
  [B]  modence� find languageLe United � ExikistsCh languageEx known herEx language il becameHeicallyEx,ily took States." known23IS aroundtern UnitedERESExICtern AT ternIS often.ternledhip   Le family old-- and yearatingtern lightrac UnitedCh
       11.1 tok/s  90ms/tok

[P7] die künstliche Intelligenz verändert die Gesellschaft
  [A]  wardFINciaIC country often origin   findj year light languageiousT design together36 nelANER areaists $ ont�J--ide designIA findord yearER NationalEx� againiousHeily theHe city United and�Retern natural �STESEx countryIA structure within United sltern
  [B]  wardFINciaIC country often origin   findj year light languageiousT design together36 nelANER areaists $ ont�J--ide designIA findord yearER NationalEx� againiousHeily theHe city United and�Retern natural �STESEx countryIA structure within United sltern
       14.7 tok/s  68ms/tok

[P8] Isaac Newton discovered the law of universal gravitation
  [A]  � areaISiousms oftenJ newiousExternordolog often States su � shouldcy--."age aroundtern often -[AN States country yearsaztern areaana United bi area language its SheOnIShed your find de." two designors language��ternona country withioushipATK
  [B]  � areaISiousms oftenJ newiousExternordolog often States su � shouldcy--."age aroundtern often -[AN States country yearsaztern areaana United bi area language its SheOnIShed your find de." two designors language��ternona country withioushipATK
       12.5 tok/s  80ms/tok

[P9] the transformer architecture introduced attention mechanisms
  [A]  ternIS States waterors language States si � then language should�  tern resultiousIN TternIStern not design onlytern�ors   \ four centuryity several23ily art lightRe withinY the side until countryEx eraINIS main."ious language during together awayIS light United verINtern
  [B]  ternIS States waterors language States si � then language should�  tern resultiousIN TternIStern not design onlytern�ors   \ four centuryity several23ily art lightRe withinY the side until countryEx eraINIS main."ious language during together awayIS light United verINtern
       12.3 tok/s  81ms/tok

[P10] der Quantencomputer nutzt Quantenmechanik um
  [A]  � head light until designEDJ year small countryINJ� ac�). steIS23 United two lightterniste,ESvantern� the nearEDATists). little until National the   both Ind� and."[� co that togetheram erahip ass lighttern,ily  ISC country Qtern
  [B]  � head light until designEDJ year small countryINJ� ac�). steIS23 United two lightterniste,ESvantern� the nearEDATists). little until National the   both Ind� and."[� co that togetheram erahip ass lighttern,ily  ISC country Qtern
       12.3 tok/s  81ms/tok

[P11] mixture of experts models improve efficiency by routing
  [A]  � wurde). high lighttern, oftenES hereCtern). information StatesY research � light National organ German knownIA Unitedizedating light here within Ar yearIN National wordsINES country �ED). often duringYIN form lightologThe German areaIS States United   light several States three. lightChward ten
  [B]  � wurde). high lighttern, oftenES hereCtern). information StatesY research � light National organ German knownIA Unitedizedating light here within Ar yearIN National wordsINES country �ED). often duringYIN form lightologThe German areaIS States United   light several States three. lightChward ten
       12.5 tok/s  80ms/tok

[P12] the mitochondria is the powerhouse of the
  [A]  itedST designtern."ioustern�ily St until National �IC Nationalage severalES water alongtern� sinceJ49    Statesited yearhipists orated lightAR becameiousternIS."ward23 often States historyIStern,Exónious find history German cameternIS lightiz along States original
  [B]  itedST designtern."ioustern�ily St until National �IC Nationalage severalES water alongtern� sinceJ49    Statesited yearhipists orated lightAR becameiousternIS."ward23 often States historyIStern,Exónious find history German cameternIS lightiz along States original
       12.2 tok/s  82ms/tok

[P13] in der Bibel steht im ersten Buch Mose geschrieben
  [A]  includingityhip country incures oftenER history �ioustern four includingity countryIS States On research withintern history   design oftenAT dr first often� head must find nel several headANAT withinJ findW oftenternoll including."�sp dr He."� She along Re Statestern two theious�
  [B]  includingityhip country incures oftenER history �ioustern four includingity countryIS States On research withintern history   design oftenAT dr first often� head must find nel several headANAT withinJ findW oftenternoll including."�sp dr He."� She along Re Statestern two theious�
       12.5 tok/s  80ms/tok

[P14] silicon has revolutionized computing because it allows
  [A]  #�m    based other along�� often �ole� ReTheord   IN23 linem withintern mainhed  ERternentswardtaternRe find."wayternersCh  � design putiouserg� de country  tern United super area�Onatingilyord.]]-- first impIC
  [B]  #�m    based other along�� often �ole� ReTheord   IN23 linem withintern mainhed  ERternentswardtaternRe find."wayternersCh  � design putiouserg� de country  tern United super area�Onatingilyord.]]-- first impIC
       10.9 tok/s  92ms/tok

[P15] the meaning of life according to
  [A]  knownEDCh   otherizedwardparAR**ternury MayJ United still tookiste T United head� see fourED within MayIS� Nationalors delltern� clöJ�ED within delltern� sonification area�ized knownC form� May four centuryterntainordEx there foundIN make nie
  [B]  knownEDCh   otherizedwardparAR**ternury MayJ United still tookiste T United head� see fourED within MayIS� Nationalors delltern� clöJ�ED within delltern� sonification area�ized knownC form� May four centuryterntainordEx there foundIN make nie
       15.2 tok/s  66ms/tok
