q1a: S&P Net Debt / EBITDA (x)

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 20224.843.920.803.9895576.9854.88838109.7044.311043298.4353.847235143.6794.06151328.0724.475829.6472.07191.5684.63107725.2463.15173015.6074.47717856.6293.386612.923
ENI S.P.A. 20220.951.020.381.153247115.6110.979098126.1361.2916816130.6580.51399639.1290.9690019.2860.8256710.0051.85181.3711.05110226.2821.3160516.4970.613867127.2720.686313.29
A2A ENERGIA S.P.A. 20223.473.420.583.92109643.4363.27506674.4713.961166879.6723.03466259.283.17123029.4773.0370514.9152.66181.2944.74126132.8453.3146112.6013.5116486153.4743.047223.512
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 20224.354.740.444.5288664.9054.71519881.3144.9816262169.1714.594765100.2584.4592120.254.4568310.8974.12181.2885.64111926.2854.98116910.784.46584147.4065.276833.679
REDEIA CORPORACION SA 20223.213.630.904.5339583.754.28649877.6713.5518503117.3354.28258435.0063.7980815.6293.164110.1891.36181.4234.28119628.6453.26146113.3453.3214688115.5614.197053.347
EDP, S.A. 20224.063.890.754.1202591.7434.2613000222.8213.531049171.5973.65552986.1913.59171236.264.2995016.8232.31181.534.32107727.895.15250921.9044.3724275185.5533.29333.783
ENGIE 20223.253.501.533.8426300529.0613.0810542208.9095.3123516189.1362.638970175.952.01121319.992.5388314.8417.12181.3484.04131933.2522.94136413.1212.7916262127.9222.246243.743
IBERDROLA SA 20223.914.340.855.39177270.6934.2213457251.0565.2314606134.1744.276803141.4634.93164337.1563.572711.6022.67181.4484.28119128.0544.7139213.1123.515537154.4215.086722.953
NATURGY ENERGY GROUP SA 20222.672.660.522.431404115.0622.49703290.4092.1128467235.0132.49229725.0742.5383314.9342.495399.7812.25181.1853.72117529.933.64174716.8282.55821866.9872.67163.228
TenneT Holding B.V. 202283.8530.2328.7486.4881936.85353.7918570275.978.6640897421.7429.768875165.95423.15144033.23751.371711.2223.12181.07965.26119228.73813.1127611.639.3817202141.7178.58183.482
VEOLIA ENVIRONNEMENT 20223.923.740.623.73117957.1474.5712639222.954.0916516142.7983.964822112.8613.5197723.64.4899615.5342.47181.3573.96187743.2683.4179715.6964.017875157.0332.998453.918
ØRSTED A/S 20222.52.721.304.79199567.3662.0411520187.4931.911284798.8732.79636492.3472.16130722.8113.0859411.7984.86181.3483.75123329.0430.68165915.5932.041146190.391.846863.871
ELECTRICITE DE FRANCE 2022-8.22-43.2160.73-150.33105755.562-31.99431128.3251.3811724104.161-25.12518853.687-19.5591423.922-35.8261610.4210.62181.343-41.13117628.824-157.68200520.174-24.2123316215.651-41.597683.543
ERG S.P.A. 2022not available5.042.454.382152108.684.6115878279.1111.7617733153.2814.35464764.6884.23133030.0073.7661810.4272.23183.1414.23117425.1266.17131112.5654.01954876.1655.77453.242
Acciona SA 2022not available2.820.232.66107457.062.7814482185.0792.41974877.8492.66721471.7793.1101715.9832.6866010.3523.12181.1812.85118331.7573.17145914.162.7920618158.7712.797182.971
Fortum Oyj 20221.846.0311.673.1688234.2651.5910750160.7312.5422520179.9741.59465783.273.98136534.1941.594818.8640.6181.1271.8109327.7537.04174416.891.58998992.44640.817143.971
VERBUND AG 20221.61.240.470.95118173.3581.12716492.2561.041218979.6651.12435753.5311.1698523.6641.1264910.142.63181.3761.28122030.071.18220319.8011.1111167101.0510.987463.211
ITALGAS S.P.A. 2022not available5.130.925.93202467.5795.3311048144.0575.4914845131.423.835871121.2225.83118425.0915.6175110.4493.04181.3095.5114827.6874.57150214.0855.63802081.0125.638203.333
ACEA S.P.A. 2022not available3.550.503.8289244.8773.758391129.3373.1816395166.6193.99370051.1613.4585418.213.7570811.8772.33181.1664.17110226.5713.33125611.6683.741112785.6553.57513.056
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 20224.374.410.754.545384115.2534.168680126.9414.09716288.4664.495615106.2374.53117630.64.3671111.0222.49181.2145.05117426.7575.36138712.8274.381124687.0225.115762.398
HERA S.P.A. 20224.234.011.183.8171660.8672.82611578.3434.517347145.73.73427774.574.31103724.1075.0777712.2462.28181.1416.43111524.7854.31152114.3584.2813101108.7592.597593.046
VINCI 20221.892.190.702.0578120.0532.339687153.9971.9518688206.781.85490561.8481.77109925.8061.975419.2474.23181.2592.04116129.1432.110189.931.9613729110.5761.87803.84
BOUYGUES 20223.261.540.902.35139764.8412.21668287.2590.6217862167.9812.36422558.4750.5574118.8332.215248.6930.61181.4062.58122229.3420.6110449.1142.211034291.1850.688653.484
FERROVIAL SA 2022not available8.282.8210.14121158.40510.4213922204.1059.38548656.7829.455702112.8834.57133332.2087.2678114.523.1181.84612.04124428.7566.6172516.6856.9211591106.05711.198473.858
FailuresMean Absolute Error (ratio)Mean Bias Error (ratio)Root Mean Squared Error (ratio)Time (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro01.133-0.8033.9802113.4188.0697.431.520.060.02
Kimi K2.600.301-0.1990.6883698.44154.1065.081.690.070.02
MiniMax M2.700.6470.3521.7033447.28143.6475.160.690.030.01
Qwen 3.6 Plus00.294-0.2270.5462090.5487.1141.110.830.030.01
GLM 5.100.316-0.1380.507603.3325.146.631.180.050.01
GPT-5.500.314-0.2410.790275.5111.482.234.210.180.03
GPT-5 nano00.636-0.0010.72233.751.410.400.040.000.00
Claude Opus 4.600.414-0.0810.954696.0529.003.764.870.200.03
Claude Haiku 4.501.368-0.8904.238348.9714.543.191.020.040.01
Gemini 3.1 Pro Preview00.250-0.2270.5132738.72114.1141.415.630.230.06
Gemini 3.1 Flash-Lite Preview01.6050.7284.96081.683.400.390.250.010.00

q1b: S&P FFO / Net Debt (x)

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 20220.15670.150.050.1402103267.1240.13612762209.7640.162419495241.670.15019441268.7140.1778104023.9640.140271812.6060.0522191.6680.1542127829.9410.2429153113.9650.166812963103.5910.17799153.664
ENI S.P.A. 20220.65930.670.190.760789587.1240.56115321208.3620.714518214228.8140.88587960237.3650.7081124923.5960.745266911.0920.1564191.5170.6083143436.8250.7759218619.0350.611629271267.1890.78828263.384
A2A ENERGIA S.P.A. 20220.23170.230.050.235473721.1250.269914200224.060.19811336141.1790.3059574285.4050.2425145231.0790.23545267.5610.1785192.940.1733126830.4010.3012145513.4010.160119048158.3280.2496973.029
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 20220.17240.150.030.1823723129.7940.172713846270.3970.146211963100.8840.1606476682.3410.1336100731.060.166471812.3040.0638191.240.1304123026.7570.1521128312.5610.171118587150.6150.13438452.999
REDEIA CORPORACION SA 20220.20630.160.040.188182944.5760.157915338263.5080.18121187264.8740.1603291153.5120.164129826.9280.188168010.1180.0443192.1620.1321118723.8090.2115134111.2670.18021023598.2210.15796692.917
EDP, S.A. 20220.18840.180.080.1486167281.7610.1818491252.4370.102827065200.30.1455504683.7920.231119328.4750.1744107217.1370.12191.2890.1635154336.6820.2163139113.5770.115821013149.0860.39348013.275
ENGIE 20220.24830.330.130.474110956.0440.377616423326.5940.260820462254.0870.38168089101.8840.3342138627.4080.315270311.3470.0702191.8160.2075080114.50.5137204520.8260.283428576277.4940.42358292.994
IBERDROLA SA 20220.19650.190.050.262483854.3620.180428756578.0730.172217164207.1340.17436970122.9040.2096118532.6440.218587414.8830.068191.4280.2252131934.660.2122152414.4280.19428629271.0850.18689764.29
NATURGY ENERGY GROUP SA 20220.28470.270.070.3352129290.510.298113708231.7760.332111222161.5860.29815983150.1770.2102127429.680.297964411.0510.1332191.240.2785137833.3220.165144712.730.304818538148.3980.29816262.852
TenneT Holding B.V. 2022-0.010.050.15-0.0105217652.9750.056727150376.0830.07619811225.647-0.01139140123.781-0.0086106423.5260.0214101216.028-0.1493191.2230.01061287633.8450.4555196117.0240.07629435240.854-0.01417073.401
VEOLIA ENVIRONNEMENT 20220.19720.190.060.2021117980.4440.19119236290.180.213522468155.5480.1949569889.3120.2893146427.7290.1654112517.2580.0451191.4010.16776431130.4980.2164216219.0710.168822205178.8860.23279333.609
ØRSTED A/S 20220.31240.280.200.3409115850.2690.139112982178.1320.334423462434.0640.21348634207.240.0489177330.0690.174167210.6280.0396191.2980.2941118028.7330.3821139813.7190.747919525154.1840.37218513.22
ELECTRICITE DE FRANCE 2022-0.15790.010.18-0.027598656.014-0.015720697315.1440.534924916233.917-0.0854569297.89-0.0302117429.429-0.050170212.977-0.0689191.4820.005910228219.446-0.0706122212.063-0.071126451207.937-0.00958903.824
ERG S.P.A. 2022not available0.150.070.1594104162.3110.168822142432.758-0.010934987336.5580.1688554773.1840.1868133232.4320.189575112.0570.0473191.2950.162126229.340.202162014.0920.18916354122.5540.16547853.132
Acciona SA 2022not available0.270.060.31791529104.3380.207414772203.5570.314122852264.5670.23728415249.4620.3395131328.7590.295373611.7660.1746191.3830.209115529.120.2324133311.7150.289919093152.7210.32188873.4
Fortum Oyj 20220.45560.390.220.533176652.5030.517414470194.7970.18233739404.0760.62136963116.5310.4499117625.3860.533171912.249-0.1472191.3210.4599111228.7920.3936166015.4280.559412088119.6130.24066882.569
VERBUND AG 20220.51740.790.221.0054124555.1830.784711562243.680.6715860208.6250.98967676140.690.784792818.6190.784779112.2840.2324191.3590.6895116139.0481.0051148012.9550.794524318185.0430.9346943.338
ITALGAS S.P.A. 2022not available0.150.020.144284828.1750.148510145142.5070.142622724193.6270.14718927165.1970.144589719.990.144265610.0620.1589193.110.1383122628.880.2213142612.5370.1481091976.3940.15099123.521
ACEA S.P.A. 2022not available0.200.020.2128414686.2760.177313996204.7310.2024307991014.6280.18335601111.6540.182592120.620.211763710.7010.1651193.7370.2011112227.7720.206811869.590.197830303274.050.21086513.236
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 20220.16860.180.080.1604374683.9230.169311639248.2640.1941905170.9560.1881184638.740.4032144337.3030.182175810.2970.0639191.2620.1436108726.9290.1503130411.4050.173524002247.0250.14957993.139
HERA S.P.A. 20220.17330.190.040.1891118348.7530.242217295224.2640.172121351201.8730.211690994.9980.1816112524.8930.198678812.6950.1109191.1630.1394107925.520.2568141713.3150.16941132988.9040.2037983.09
VINCI 20220.42210.370.070.39879150.820.35216924239.2310.419226298469.6980.41595537109.5580.408599426.2120.39816339.6910.1839192.7070.3131136034.6520.3947107210.3430.398219956181.5810.38979363.253
BOUYGUES 20220.24460.640.530.3502246468.6680.3778125117.8820.375419794222.6520.3334549297.1451.370976415.0630.393865310.1710.2021191.3760.2454113626.4341.4638134812.8060.377744358.5821.55158603.674
FERROVIAL SA 2022not available0.070.020.0564146669.5880.100217668277.7440.05519103222.740.08748199106.5940.1034102122.1090.046275612.8970.0796191.5130.0622124530.390.0564155515.060.10291188995.3020.04737613.157
FailuresMean Absolute Error (ratio)Mean Bias Error (ratio)Root Mean Squared Error (ratio)Time (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.2520.1930.3891582.6665.9424.041.430.060.01
Kimi K2.600.5940.4481.5696253.92260.5896.452.270.090.02
MiniMax M2.700.8460.6762.2286459.70269.15184.970.830.030.01
Qwen 3.6 Plus00.2540.1330.3343008.07125.3460.220.920.040.01
GLM 5.100.5500.3841.156636.9726.545.071.190.050.01
GPT-5.500.3620.2610.774289.8612.082.344.270.180.03
GPT-5 nano01.320-1.2603.26140.931.710.700.040.000.00
Claude Opus 4.600.2980.0790.5581706.3071.10128.125.350.220.07
Claude Haiku 4.503.0022.91210.748332.9113.872.761.010.040.01
Gemini 3.1 Pro Preview00.7000.5802.0154007.64166.9867.347.420.310.09
Gemini 3.1 Flash-Lite Preview00.6030.4371.30778.973.290.360.250.010.00

q1c: Leverage Trend (Moody's Adjusted)

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 2022Improving-0.550.69Deteriorating124654.156Deteriorating603885.018Improving16298143.165Deteriorating5670103.644Stable217839.072Deteriorating119915.687Stable161.408Deteriorating155131.261Deteriorating238420.358Stable984070.807Deteriorating10693.776
ENI S.P.A. 2022Improving0.910.30Improving2629174.413Improving13319228.173Improving12540107.44Improving356443.637Improving188952.107Improving155919.246Stable161.213Improving168430.93Improving203716.3Improving643847.67Improving7863.134
A2A ENERGIA S.P.A. 2022Improving-0.820.40Deteriorating170061.116Deteriorating11352175.131Deteriorating21789185.966Deteriorating374759.372Deteriorating134727.661Deteriorating116112.74Stable161.149Deteriorating133025.779Deteriorating259921.247Stable798759.816Deteriorating11913.843
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 2022Improving0.910.30Improving121544.635Improving331650.122Improving8631108.408Improving327969.994Improving146327.729Improving196922.027Stable161.084Improving191433.376Improving236519.099Improving671747.407Improving12574.04
REDEIA CORPORACION SA 2022Improving0.270.65Stable153173.324Stable439882.049Improving13443133.097Stable340358.724Deteriorating130330.924Stable162420.056Stable161.116Improving185034.95Improving172513.68Improving1189489.231Stable8873.101
EDP, S.A. 2022Improving0.270.79Improving250492.317Improving9087112.218Stable1498998.847Stable505379.166Stable177338.219Improving171618.969Stable161.373Improving434891.357Deteriorating311926.384Improving819058.74Deteriorating12574.047
ENGIE 2022Improving-0.270.90Improving227564.878Deteriorating10883128.246Deteriorating1181094.513Deteriorating492060.608Improving182832.995Deteriorating148118.047Stable161.181Stable8876180.435Deteriorating317624.972Improving709152.915Deteriorating8633.269
IBERDROLA SA 2022Stable-0.360.50Deteriorating282065.959Stable11003144.914Stable809679.752Deteriorating478580.087Stable205943.242Stable159316.886Stable1615.758Stable217945.316Deteriorating272420.22Stable1013174.855Deteriorating8073.61
NATURGY ENERGY GROUP SA 2022Improving0.910.30Improving107444.55Improving468464.078Improving662487.995Improving385857.747Improving160130.599Improving154719.143Stable161.24Improving273254.96Improving270322.419Improving405230.555Improving11704.702
TenneT Holding B.V. 2022Deteriorating-0.910.30Deteriorating270784.255Deteriorating16411234.749Deteriorating12769151.027Deteriorating471074.051Deteriorating170328.386Deteriorating153017.297Stable161.093Deteriorating5348124.32Deteriorating236917.234Deteriorating633550.196Deteriorating8613.758
VEOLIA ENVIRONNEMENT 2022Deteriorating-0.270.90Deteriorating2578133.855Stable14133167.043Improving1289885.73Deteriorating6874105.388Deteriorating175637.461Deteriorating196823.695Stable161.331Improving7445151.935Improving246219.88Deteriorating18275125.12Deteriorating8883.346
ØRSTED A/S 2022Improving0.730.65Improving274982.194Improving290542.904Improving16073144.862Improving307638.234Improving162432.763Improving160919.795Deteriorating132510.867Stable203342.741Improving297022.893Improving816570.11Improving9654.586
ELECTRICITE DE FRANCE 2022Deteriorating-0.730.65Deteriorating351557.595Deteriorating11260244.548Deteriorating10747111.594Deteriorating675684.989Deteriorating204038.573Deteriorating179123.397Stable166.322Deteriorating219249.271Improving248819.879Deteriorating488339.241Deteriorating10784.502
ERG S.P.A. 2022NA0.910.30Improving183078.944Improving10706113.982Improving17515219.485Improving462974.29Improving185538.53Improving142716.561Stable161.229Improving280257.106Improving227017.101Improving606642.463Improving11553.932
Acciona SA 2022NA0.450.82Stable2079155.307Improving10594176.585Improving16772155.079Improving436483.547Deteriorating176343.683Improving172721.461Stable161.273Improving179732.981Improving273723.22Improving1227091.274Deteriorating8323.252
Fortum Oyj 2022Improving0.910.30Improving3088108.432Improving9623222.387Improving15454106.729Improving343055.556Improving176232.974Improving156116.778Stable161.161Improving143729.219Improving228818.941Improving755161.466Improving9783.813
VERBUND AG 2022Deteriorating0.090.94Improving178053.206Improving10694150.586Deteriorating22518152.183Deteriorating6160115.646Deteriorating185531.258Improving146515.028Stable161.247Improving224450.314Stable267022.142Improving752456.317Deteriorating8243.505
ITALGAS S.P.A. 2022NA-0.910.30Deteriorating113757.158Deteriorating500282.742Deteriorating13960178.286Deteriorating410773.066Deteriorating159034.421Deteriorating178918.832Stable161.251Deteriorating198550.212Deteriorating210216.319Deteriorating622946.606Deteriorating8483.228
ACEA S.P.A. 2022NA-0.180.40Stable264278.905Stable12687186.603Stable13478121.449Deteriorating438058.331Stable137523.924Stable126113.751Stable1610.169Stable144727.831Stable216315.697Deteriorating18307164.394Stable9063.387
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 2022Improving0.910.30Improving204079.238Improving281746.42Improving18274177.855Improving327936.584Improving133826.54Improving168117.624Stable161.037Improving176534.118Improving189014.205Improving524637.416Improving8463.315
HERA S.P.A. 2022Deteriorating-0.910.30Deteriorating151357.543Deteriorating15076219.009Deteriorating18964233.59Deteriorating5513104.315Deteriorating152331.593Deteriorating154716.412Stable161.204Deteriorating192735.337Deteriorating211914.823Deteriorating642246.618Deteriorating9353.737
VINCI 2022Improving0.910.30Improving218290.575Improving9972133.37Improving20052216.119Improving6064111.582Improving179539.174Improving131014.813Stable161.188Improving255155.046Improving229016.397Improving592942.244Improving8903.497
BOUYGUES 2022Deteriorating-0.910.30Deteriorating3130110.986Deteriorating11728153.578Deteriorating19112198.501Deteriorating5542103.54Deteriorating177130.328Deteriorating124912.83Stable161.033Deteriorating200636.183Deteriorating229616.944Deteriorating654948.055Deteriorating10293.738
FERROVIAL SA 2022NA-0.640.67Deteriorating7962117.36Deteriorating20993281.536Stable16844170.044Deteriorating683890.506Deteriorating189532.57Deteriorating199622.702Stable161.187Improving269959.127Deteriorating356327.24Deteriorating1105680.463Deteriorating8983.645
FailuresMean Absolute ErrorMean Bias ErrorRoot Mean Squared ErrorTime (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.42-0.210.862020.9084.2034.111.520.060.01
Kimi K2.600.53-0.210.973525.99146.9268.751.680.070.02
MiniMax M2.700.37-0.160.833461.72144.2445.550.660.030.00
Qwen 3.6 Plus00.47-0.470.891822.6075.9423.180.800.030.01
GLM 5.100.32-0.320.73824.7334.366.421.260.050.01
GPT-5.500.47-0.260.95433.7818.073.154.920.210.03
GPT-5 nano01.00-0.371.0567.112.803.910.040.000.00
Claude Opus 4.600.53-0.110.971364.1056.8440.355.880.240.06
Claude Haiku 4.500.74-0.211.17467.5919.483.781.140.050.01
Gemini 3.1 Pro Preview00.210.000.561533.9863.9230.124.220.180.05
Gemini 3.1 Flash-Lite Preview00.53-0.530.9788.763.700.440.260.010.00

q2: Suitability

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 2022Strongly Suitable1.910.30Strongly Suitable50037.837Strongly Suitable165127.648Strongly Suitable351129.264Strongly Suitable76915.827Strongly Suitable61218.722Strongly Suitable83014.44Strongly Suitable4504.535Strongly Suitable137934.199Marginally Suitable152317.423Strongly Suitable191918.692Strongly Suitable4512.848
ENI S.P.A. 2022Marginally Suitable1.000.63Not Suitable57658.221Marginally Suitable183527.754Marginally Suitable434635.063Marginally Suitable123327.981Not Suitable59710.837Strongly Suitable65711.951Marginally Suitable5935.93Strongly Suitable122831.384Marginally Suitable167717.533Marginally Suitable522947.055Marginally Suitable4973.03
A2A ENERGIA S.P.A. 2022Strongly Suitable1.820.40Strongly Suitable69818.127Strongly Suitable137821.648Strongly Suitable368238.506Strongly Suitable102225.02Strongly Suitable37311.019Strongly Suitable72512.777Marginally Suitable191.305Strongly Suitable173143.008Marginally Suitable153517.35Strongly Suitable213122.469Strongly Suitable4822.89
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 2022Strongly Suitable2.000.00Strongly Suitable41813.885Strongly Suitable137322.944Strongly Suitable130811.606Strongly Suitable90925.583Strongly Suitable44711.781Strongly Suitable77712.715Strongly Suitable5835.059Strongly Suitable143336.823Strongly Suitable204023.166Strongly Suitable163115.879Strongly Suitable4022.634
REDEIA CORPORACION SA 2022Strongly Suitable1.910.30Strongly Suitable107343.521Strongly Suitable180231.709Strongly Suitable272479.886Strongly Suitable102022.044Strongly Suitable50814.603Marginally Suitable76814.131Strongly Suitable5384.854Strongly Suitable109930.148Strongly Suitable178819.889Strongly Suitable358444.407Strongly Suitable5033.053
EDP, S.A. 2022Strongly Suitable1.820.40Strongly Suitable114879.776Strongly Suitable158129.326Strongly Suitable224053.391Strongly Suitable110946.718Strongly Suitable64418.723Strongly Suitable66713.143Marginally Suitable8268.115Strongly Suitable154841.252Marginally Suitable180720.708Strongly Suitable174918.497Strongly Suitable5243.158
ENGIE 2022Strongly Suitable1.820.40Strongly Suitable100052.268Strongly Suitable193731.559Strongly Suitable364443.643Strongly Suitable94227.1Strongly Suitable60014.431Strongly Suitable76213.231Marginally Suitable3113.195Strongly Suitable124933.338Marginally Suitable195721.234Strongly Suitable182619.466Strongly Suitable5053.076
IBERDROLA SA 2022Strongly Suitable1.820.40Strongly Suitable60715.661Strongly Suitable160135.973Strongly Suitable326441.194Strongly Suitable92433.179Strongly Suitable68916.525Strongly Suitable61112.65Marginally Suitable4834.93Strongly Suitable129432.529Marginally Suitable215322.267Strongly Suitable215821.012Strongly Suitable5463.677
NATURGY ENERGY GROUP SA 2022Marginally Suitable1.820.40Strongly Suitable103454.782Strongly Suitable154823.091Strongly Suitable290320.814Strongly Suitable98218.236Strongly Suitable65721.198Marginally Suitable74313.605Marginally Suitable4754.816Strongly Suitable132134.099Strongly Suitable168417.725Strongly Suitable251527.384Strongly Suitable5743.667
TenneT Holding B.V. 2022Strongly Suitable1.910.30Strongly Suitable101739.406Strongly Suitable130920.606Strongly Suitable723162.797Strongly Suitable83628.775Strongly Suitable52215.075Strongly Suitable68612.338Strongly Suitable3353.395Strongly Suitable130231.385Marginally Suitable146317.401Strongly Suitable237622.256Strongly Suitable3992.878
VEOLIA ENVIRONNEMENT 2022Strongly Suitable1.820.40Strongly Suitable77416.409Strongly Suitable157824.365Strongly Suitable353030.143Strongly Suitable92834.172Strongly Suitable39113.535Strongly Suitable71019.616Marginally Suitable5475.972Strongly Suitable119929.721Marginally Suitable215524.257Strongly Suitable169315.929Strongly Suitable4592.811
ØRSTED A/S 2022Strongly Suitable1.820.40Strongly Suitable120944.006Marginally Suitable166231.482Strongly Suitable304025.95Strongly Suitable92713.48Strongly Suitable62320.706Strongly Suitable69514.094Strongly Suitable5684.899Strongly Suitable159537.789Marginally Suitable201321.492Strongly Suitable211320.086Strongly Suitable4713.481
ELECTRICITE DE FRANCE 2022Strongly Suitable1.730.65Strongly Suitable140169.83Strongly Suitable111021.983Strongly Suitable513250.388Strongly Suitable91614.929Strongly Suitable68716.189Strongly Suitable78814.57Marginally Suitable2543.225Strongly Suitable136337.37Not Suitable189521.876Strongly Suitable164717.294Strongly Suitable4442.864
ERG S.P.A. 2022Marginally Suitable1.450.52Marginally Suitable58042.235Marginally Suitable207043.923Strongly Suitable589188.556Marginally Suitable244891.968Strongly Suitable59916.223Marginally Suitable58611.547Strongly Suitable6736.281Strongly Suitable145635.666Marginally Suitable195321.608Strongly Suitable385341.584Marginally Suitable5343.43
Acciona SA 2022Marginally Suitable1.550.52Strongly Suitable66160.596Marginally Suitable142223.85Strongly Suitable412143.105Strongly Suitable109222.478Marginally Suitable52716.793Marginally Suitable79514.931Marginally Suitable5975.057Strongly Suitable170542.795Marginally Suitable153717.513Strongly Suitable221333.044Strongly Suitable4872.636
Fortum Oyj 2022Not Suitable1.550.52Marginally Suitable101573.165Marginally Suitable182931.99Strongly Suitable340235.483Strongly Suitable108815.251Strongly Suitable53415.232Marginally Suitable71614.128Marginally Suitable5194.45Strongly Suitable142836.238Marginally Suitable173420.468Strongly Suitable183119.13Strongly Suitable4843.044
VERBUND AG 2022Marginally Suitable1.000.89Not Suitable89549.464Marginally Suitable163826.107Strongly Suitable584160.111Not Suitable90920.509Marginally Suitable91221.276Marginally Suitable84515.951Strongly Suitable4404.708Strongly Suitable177944.557Strongly Suitable215222.73Not Suitable189423.126Not Suitable5773.571
ITALGAS S.P.A. 2022Marginally Suitable2.000.00Strongly Suitable76738.037Strongly Suitable126227.765Strongly Suitable758876.463Strongly Suitable113522.199Strongly Suitable40111.394Strongly Suitable74314.426Strongly Suitable3463.805Strongly Suitable122932.174Strongly Suitable209621.659Strongly Suitable285126.855Strongly Suitable4973.192
ACEA S.P.A. 2022Marginally Suitable1.910.30Strongly Suitable96620.505Strongly Suitable129525.891Strongly Suitable272530.429Strongly Suitable117228.658Strongly Suitable49915.575Strongly Suitable65012.224Strongly Suitable5044.412Strongly Suitable120232.127Marginally Suitable165817.722Strongly Suitable181718.649Strongly Suitable5273.035
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 2022Marginally Suitable1.730.47Strongly Suitable84016.305Strongly Suitable129022.154Strongly Suitable293619.941Strongly Suitable92915.304Marginally Suitable74723.242Strongly Suitable76914.503Marginally Suitable2493.19Strongly Suitable129730.802Marginally Suitable175619.918Strongly Suitable218323.0Strongly Suitable5163.058
HERA S.P.A. 2022Marginally Suitable1.910.30Strongly Suitable125941.648Strongly Suitable146734.713Strongly Suitable437155.839Strongly Suitable124036.98Strongly Suitable44511.523Strongly Suitable69813.034Strongly Suitable6245.296Strongly Suitable169540.145Marginally Suitable201221.768Strongly Suitable187117.084Strongly Suitable5353.716
VINCI 2022Not Suitable1.450.69Marginally Suitable86847.925Strongly Suitable121249.727Strongly Suitable344134.666Strongly Suitable104630.4Strongly Suitable55114.417Marginally Suitable62411.362Marginally Suitable5154.659Strongly Suitable131634.344Marginally Suitable157318.298Not Suitable277726.426Strongly Suitable5393.124
BOUYGUES 2022Not Suitable1.000.45Marginally Suitable77943.867Marginally Suitable112918.612Marginally Suitable591668.674Marginally Suitable94722.763Marginally Suitable60719.61Marginally Suitable5329.653Marginally Suitable5765.457Strongly Suitable167739.073Marginally Suitable193121.028Not Suitable288529.696Marginally Suitable4572.655
FERROVIAL SA 2022Not Suitable1.730.47Strongly Suitable52153.178Marginally Suitable180837.56Strongly Suitable493851.184Strongly Suitable112126.291Strongly Suitable58418.755Strongly Suitable59412.784Marginally Suitable5014.528Strongly Suitable126035.729Marginally Suitable208424.054Strongly Suitable307531.692Strongly Suitable5443.209
FailuresMean Absolute ErrorMean Bias ErrorRoot Mean Squared ErrorTime (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.540.380.791030.6542.9418.801.400.060.01
Kimi K2.600.460.380.74692.3828.857.540.880.040.01
MiniMax M2.700.620.620.941087.1045.3019.990.340.010.00
Qwen 3.6 Plus00.580.500.91665.8527.7415.800.530.020.00
GLM 5.100.540.460.89387.3816.143.551.150.050.01
GPT-5.500.460.380.74323.8013.491.894.310.180.03
GPT-5 nano00.620.120.79112.074.671.310.040.000.00
Claude Opus 4.600.710.711.02856.6935.704.315.080.210.03
Claude Haiku 4.500.71-0.120.89489.0920.382.261.070.040.01
Gemini 3.1 Pro Preview00.500.420.82600.7125.038.892.490.100.02
Gemini 3.1 Flash-Lite Preview00.580.500.9174.743.110.330.240.010.00

q3: Size

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 20220.03750.080.027.5%1497131.8357.5%161128.7117.5%475955.3427.5%187362.40311.25%103621.20611.25%73113.2053.75%182.51411.25%139935.4477.5%156617.2567.5%608755.697.5%6813.493
ENI S.P.A. 20220.0750.060.047.5%79043.5123.75%220738.09711.25%507261.3990%157044.5930%77620.3257.5%78514.47111.25%7517.5627.5%131034.9777.5%178419.9387.5%957278.7933.75%4903.238
A2A ENERGIA S.P.A. 20220.0750.060.030%62034.1267.5%172030.1937.5%452439.1313.75%283852.44611.25%87919.9587.5%58313.2697.5%181.1627.5%164838.937.5%165517.3140%484841.6977.5%5772.99
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 20220.0750.070.027.5%90335.1197.5%283349.2727.5%796886.8757.5%157437.0053.75%90424.2857.5%74814.71211.25%5386.0857.5%158840.1837.5%220024.387.5%601159.3727.5%5233.532
REDEIA CORPORACION SA 20220.0750.020.030%67029.4297.5%157128.1350%920495.2390%150450.0867.5%91022.0663.75%4949.7173.75%181.6750%137435.5813.75%171018.3970%280724.6050%4382.696
EDP, S.A. 20220.0750.100.027.5%79847.17311.25%199431.19811.25%743455.76211.25%240739.1097.5%86019.97311.25%60211.2717.5%181.23811.25%148237.9787.5%194320.35211.25%325532.111.25%5433.669
ENGIE 20220.03750.070.027.5%70047.7197.5%132527.2747.5%606270.2077.5%189344.7417.5%100133.6157.5%79413.9827.5%181.3967.5%148038.6883.75%191119.8083.75%531244.577.5%5573.384
IBERDROLA SA 20220.03750.070.023.75%169780.39311.25%212737.257.5%770061.9793.75%201249.5657.5%82920.067.5%67011.7027.5%8927.86311.25%151439.7757.5%198821.2017.5%477640.4277.5%6974.504
NATURGY ENERGY GROUP SA 20220.03750.050.030%76078.8167.5%219732.2040%11139131.7497.5%175033.7677.5%85819.4527.5%62411.6797.5%6567.413.75%134934.6687.5%201721.593.75%612951.6197.5%5463.106
TenneT Holding B.V. 20220.0750.110.0111.25%86137.45411.25%133024.6211.25%459542.23411.25%265645.45311.25%78416.22311.25%66511.477.5%2723.17711.25%160541.53111.25%205224.04211.25%420433.98511.25%5053.209
VEOLIA ENVIRONNEMENT 20220.03750.100.0211.25%98851.2411.25%202029.24511.25%14523139.46211.25%176532.6127.5%90922.87911.25%64511.2911.25%46726.4611.25%144438.3137.5%135714.8917.5%840468.95511.25%6623.552
ØRSTED A/S 20220.11250.100.053.75%94039.25115%320948.37911.25%956370.40111.25%180330.2830%76517.17111.25%80314.06611.25%6876.9515%148638.0913.75%238523.85611.25%327227.58211.25%4833.208
ELECTRICITE DE FRANCE 20220.0750.130.0311.25%98082.26411.25%145824.34311.25%8759102.62515%319666.93715%83126.0315%89314.46311.25%4093.99415%161841.1347.5%158518.79615%272924.10615%4492.995
ERG S.P.A. 20220.0750.050.047.5%1678111.140%229132.24911.25%12717114.8547.5%191829.0467.5%87228.887.5%65812.4357.5%4735.1253.75%143639.9337.5%174519.5480%204919.7540%5133.371
Acciona SA 20220.03750.050.043.75%80735.66211.25%151024.1930%646245.327.5%375657.0883.75%68717.2787.5%65312.4183.75%181.2137.5%170241.8057.5%240225.4990%787771.2247.5%4662.818
Fortum Oyj 20220.00.060.043.75%101640.2047.5%108823.7717.5%430051.9847.5%123329.00515%74820.137.5%5769.8320%161.527.5%150837.0867.5%164418.8450%429037.1597.5%5193.074
VERBUND AG 20220.03750.020.030%59945.7050%154226.7040%526245.640%119323.4310%79718.1673.75%69712.5497.5%5836.5343.75%143237.2357.5%209623.5250%189317.2520%5507.035
ITALGAS S.P.A. 20220.03750.070.037.5%92441.67111.25%189627.33111.25%529047.3467.5%203138.487.5%67518.8997.5%82113.049FAIL6716.6147.5%160942.2537.5%176719.3360%302928.0517.5%5443.275
ACEA S.P.A. 20220.0750.060.037.5%67442.5077.5%147933.15711.25%738266.3727.5%161532.8067.5%98221.8577.5%59810.4930%161.037.5%150437.9517.5%179618.3240%308132.1487.5%5533.344
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 20220.11250.050.040%69039.3793.75%135324.6467.5%745859.0760%197634.697.5%82922.2587.5%72512.07211.25%5825.7017.5%151736.4670%170319.6480%235519.5537.5%5673.3
HERA S.P.A. 20220.03750.070.040%83940.6987.5%179947.43711.25%803257.9867.5%241641.7657.5%96025.3167.5%69024.88311.25%5795.2937.5%145535.7197.5%176818.9480%379637.1167.5%5873.407
VINCI 20220.00.040.030%126643.3130%122531.2190%401530.6793.75%258747.4357.5%76627.3387.5%66211.9957.5%2323.0523.75%149038.5463.75%130415.1960%207519.9157.5%5163.109
BOUYGUES 20220.00.070.033.75%56630.9467.5%182625.00311.25%1194196.0657.5%110820.6677.5%74823.3457.5%60610.6927.5%5075.14211.25%167543.4567.5%174419.6760%290824.2817.5%6033.234
FERROVIAL SA 20220.00.070.030%92946.9797.5%109435.83211.25%8861123.787.5%145122.41311.25%63315.8447.5%75313.7817.5%4134.2947.5%136536.6067.5%187322.0293.75%439036.75411.25%5613.428
FailuresMean Absolute ErrorMean Bias ErrorRoot Mean Squared ErrorTime (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.033-0.0050.0451256.5452.3625.861.400.060.01
Kimi K2.600.0440.0250.052760.4631.697.630.900.040.01
MiniMax M2.700.0450.0270.0551751.5172.9831.020.440.020.00
Qwen 3.6 Plus00.0440.0160.053965.8340.2412.290.600.030.00
GLM 5.100.0480.0230.062522.5621.774.231.170.050.01
GPT-5.500.0370.0310.047309.5012.902.934.290.180.03
GPT-5 nano10.0330.0230.044123.005.135.110.040.000.00
Claude Opus 4.600.0420.0300.052922.3538.432.445.140.210.03
Claude Haiku 4.500.0340.0160.046482.3920.102.761.070.040.01
Gemini 3.1 Pro Preview00.036-0.0110.048926.7138.6117.473.060.130.03
Gemini 3.1 Flash-Lite Preview00.0450.0230.05482.973.460.840.240.010.00

q4: priority

Ground truth prioritiesGround truth orderLLM dist averageLLM dist std. dev.DeepSeek-V4-ProDistanceOut tokensTimeKimi K2.6DistanceOut tokensTimeMiniMax M2.7DistanceOut tokensTimeQwen 3.6 PlusDistanceOut tokensTimeGLM 5.1DistanceOut tokensTimeGPT-5.5DistanceOut tokensTimeGPT-5 nanoDistanceOut tokensTimeClaude Opus 4.6DistanceOut tokensTimeClaude Haiku 4.5DistanceOut tokensTimeGemini 3.1 Pro PreviewDistanceOut tokensTimeGemini 3.1 Flash-Lite PreviewDistanceOut tokensTime
ELECTRIC - "TERNA - - IBERDROL 202211, 8, 3C,B,A1.820.98A,B,C3112456.978A,C,B2141130.837A,B,C38335143.533B,C,A1129015.608B,A,C2125125.662B,C,A1116219.158A,B,C31716.489A,C,B2123632.826B,C,A1147016.665A,C,B2283425.433C,B,A05413.307
ENI S.P. - TenneT H - REDEIA C 202212, 7, 4C,B,A1.270.65B,C,A168427.403C,A,B1148030.716B,C,A1437149.228B,C,A1136917.692B,A,C269021.989B,C,A1139723.493A,B,C3172.166B,C,A1146040.157B,C,A1148516.536B,C,A1457238.074B,C,A15763.431
VEOLIA E - ELECTRIC - REDEIA C 2022 5, 11, 4C,A,B2.091.14A,C,B193680.943B,A,C3150225.329A,C,B1514679.074A,C,B1129315.674B,A,C371222.018A,B,C278315.972B,A,C3171.762B,A,C3146239.949C,A,B0172618.814B,A,C3389131.315B,A,C35253.213
"TERNA - - A2A ENER - REDEIA C 2022 8, 9, 4C,A,B1.090.70A,C,B167120.122C,A,B0113921.782A,C,B1280935.457A,C,B1119313.323A,C,B188517.033A,C,B159111.294A,B,C2171.357A,B,C2149944.654C,A,B0123313.92B,C,A217433144.376A,C,B15123.207
A2A ENER - ENEL - S - "TERNA - 2022 9, 1, 8B,C,A1.091.04A,C,B372956.106A,B,C2176334.209B,C,A0481266.775B,C,A0130018.074C,B,A183325.915B,C,A0104315.437B,A,C1171.668A,B,C2150842.098C,A,B2213822.889B,C,A0118812.307C,B,A15143.369
EDP, S.A - ELECTRIC - VEOLIA E 2022 2, 11, 5A,C,B1.550.93B,A,C270873.411C,A,B1182034.701B,A,C2547462.884A,B,C1258534.509A,C,B085430.015C,B,A2117118.025B,A,C2172.147C,B,A2142344.845A,C,B0144414.734B,C,A3337531.251B,A,C25313.077
EDP, S.A - A2A ENER - TenneT H 2022 2, 9, 7A,C,B1.000.00C,A,B180646.457C,A,B1163427.196C,A,B1715676.653C,A,B1181024.913C,A,B173220.383C,A,B187914.17C,A,B12803.487C,A,B1134633.811A,B,C1156216.722C,A,B1356030.368C,A,B14953.629
ØRSTED A - ENEL - S - A2A ENER 2022 6, 1, 9B,A,C0.820.60A,B,C163444.66A,B,C1159338.537B,A,C08705245.887A,B,C1161222.4A,B,C185917.819A,B,C1116417.703C,B,A2171.813A,B,C1142133.347A,B,C1176817.43B,A,C0670454.288B,A,C05303.338
REDEIA C - ELECTRIC - "TERNA - 2022 4, 11, 8A,C,B1.550.82C,A,B179952.182C,A,B1201227.8C,A,B1443369.808C,A,B1278333.668C,A,B179027.404C,A,B182014.212C,A,B1171.759B,C,A3108126.647B,A,C2141715.445B,C,A3274626.43B,A,C25223.206
ENEL - S - ELECTRIC - VEOLIA E 2022 1, 11, 5A,C,B0.820.87B,A,C285229.602A,C,B0139232.527B,A,C27214136.586A,C,B0124520.351A,B,C183228.155A,B,C1133324.645A,B,C12613.706A,C,B0175044.179A,C,B0135816.056B,A,C2379433.275A,C,B04973.552
TenneT H - ENI S.P. - ENEL - S 2022 7, 12, 1C,A,B1.180.75B,A,C375253.371A,C,B1137934.049A,C,B1565172.049A,C,B1182325.446A,C,B185925.996C,A,B0130419.014A,B,C2171.968A,C,B1137936.239C,B,A1156316.633A,C,B1612855.888A,C,B16224.02
TenneT H - REDEIA C - ENGIE 2022 7, 4, 10B,A,C1.360.67A,B,C150954.233A,C,B2175830.02A,B,C17488101.265A,B,C1165619.146A,B,C193324.134A,C,B2104516.099A,B,C1171.285A,C,B2134536.031B,A,C0140015.374A,C,B2261426.019A,C,B25663.829
FailuresAverage DistanceTime (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro01.67595.4749.6217.801.180.100.02
Kimi K2.601.25367.7030.644.610.710.060.01
MiniMax M2.701.171139.2094.9357.300.280.020.00
Qwen 3.6 Plus00.83260.8021.736.830.500.040.01
GLM 5.101.25286.5223.884.080.990.080.01
GPT-5.501.08209.2217.443.833.670.310.06
GPT-5 nano01.8339.613.304.220.030.000.00
Claude Opus 4.601.67454.7837.905.694.150.350.06
Claude Haiku 4.500.75201.2216.772.310.840.070.01
Gemini 3.1 Pro Preview01.67509.0242.4234.292.420.200.05
Gemini 3.1 Flash-Lite Preview01.1741.183.430.280.220.020.00