Results for CO Track

Click here to see aggregated results for the CO track or go back to all results.

In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of ivalid answers, number of timeouts, number of out of memory running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.

SE-CO
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 461.339 3076096 326
coquiaas 326 0 0 0 0 0 0 316.436 3055616 326
eqargsolver 290 0 0 0 0 36 0 25385.926 474550272 290
mace4-prover9 326 0 0 0 0 0 0 6577.692 951246848 326
mu-toksia 326 0 0 0 0 0 0 118.654 3055616 326
pyglaf 326 0 0 0 0 0 0 1003.521 410021888 326
taas-dredd 181 0 145 0 0 0 0 110.365 3055616 -544
yonas 326 0 0 0 0 0 0 2863.496 3059712 326

SE-CO detailed results

EE-CO
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 1073.619 94019584 326
coquiaas 324 0 0 0 0 2 0 4072.310 969428992 324
eqargsolver 290 0 0 0 0 36 0 25396.562 474533888 290
mu-toksia 326 0 0 0 0 0 0 926.960 90816512 326
pyglaf 326 0 0 0 0 0 0 1650.462 50774016 326
taas-dredd 224 9 3 0 0 90 0 64831.779 99794944 73.810
yonas 301 0 0 0 0 18 7 180793.654 9999351808 136.829

EE-CO detailed results

DC-CO
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 880.143 3080192 326
coquiaas 326 0 0 0 0 0 0 354.369 3051520 326
eqargsolver 293 0 0 0 0 33 0 23226.084 3059712 293
mace4-prover9 326 0 0 0 0 0 0 7203.730 962494464 326
mu-toksia 326 0 0 0 0 0 0 144.566 3059712 326
pyglaf 326 0 0 0 0 0 0 1011.861 408543232 326
taas-dredd 261 1 50 0 0 14 0 12412.259 38858752 11
yonas 247 0 0 0 0 68 11 52208.594 9919496192 247

DC-CO detailed results

DS-CO
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 458.097 3084288 326
coquiaas 326 0 0 0 0 0 0 316.922 3051520 326
eqargsolver 293 0 0 0 0 33 0 23235.964 3055616 293
mace4-prover9 326 0 0 0 0 0 0 6585.139 951640064 326
mu-toksia 326 0 0 0 0 0 0 119.092 3059712 326
pyglaf 326 0 0 0 0 0 0 994.879 408698880 326
taas-dredd 321 0 5 0 0 0 0 107.806 3055616 296
yonas 326 0 0 0 0 0 0 2858.978 3059712 326

DS-CO detailed results