Results for PR Track

Click here to see aggregated results for the PR track or go back to all results.

In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of invalid answers, number of timeouts, number of out of memory, running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.

SE-PR
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 702.259 3076096 326
coquiaas 325 0 0 0 0 1 0 1619.913 50171904 325
eqargsolver 290 0 0 0 0 36 0 25194.209 3055616 290
mu-toksia 326 0 0 0 0 0 0 219.106 3059712 326
pyglaf 326 0 0 0 0 0 0 1890.444 76054528 326
taas-dredd 132 4 118 0 0 72 0 54205.384 99987456 -458
yonas 187 124 0 0 0 8 7 91028.474 9979367424 187

SE-PR detailed results

EE-PR
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 1123.564 47964160 326
coquiaas 324 0 0 0 0 2 0 3520.687 93622272 324
eqargsolver 290 0 0 0 0 36 0 25236.481 3063808 290
mu-toksia 326 0 0 0 0 0 0 782.133 89145344 326
pyglaf 326 0 0 0 0 0 0 1847.096 82247680 326
taas-dredd 224 9 3 0 0 90 0 64813.649 99782656 89.968
yonas 300 0 0 0 0 19 7 180446.064 9959219200 132.678

EE-PR detailed results

DC-PR
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 886.365 3080192 326
coquiaas 326 0 0 0 0 0 0 349.442 3059712 326
eqargsolver 293 0 0 0 0 33 0 23230.547 3063808 293
mu-toksia 326 0 0 0 0 0 0 143.485 3059712 326
pyglaf 312 0 14 0 0 0 0 947.174 408961024 242
taas-dredd 261 1 50 0 0 14 0 12328.940 40054784 11
yonas 250 0 0 0 0 67 9 52346.274 9761161216 250

DC-PR detailed results

DS-PR
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 321 0 5 0 0 0 0 1634.422 92950528 296
coquiaas 326 0 0 0 0 0 0 1111.877 55918592 326
eqargsolver 293 0 0 0 0 33 0 23226.529 3055616 293
mu-toksia 326 0 0 0 0 0 0 260.691 3055616 326
pyglaf 293 0 33 0 0 0 0 971.985 409571328 128
taas-dredd 246 1 65 0 0 14 0 12342.103 40525824 -79
yonas 272 53 1 0 0 0 0 39759.847 991281152 267

DS-PR detailed results