Results for PR-D Track

Click here to see aggregated results for the PR-D track or go back to all results.

In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of invalid answers, number of timeouts, number of out of memory, running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.

SE-PR-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 320 0 0 0 0 6 0 7990.630 98557952 320
mu-toksia 326 0 0 0 0 0 0 1128.106 51191808 326
pyglaf 256 0 70 0 0 0 0 1118.985 50429952 -94

SE-PR-D detailed results

EE-PR-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 315 0 0 2 0 9 0 11016.949 89923584 315
mu-toksia 324 0 0 0 0 2 0 3840.326 80859136 324
pyglaf 222 0 102 0 0 2 0 4005.905 85041152 -288

EE-PR-D detailed results

DC-PR-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 326 0 0 0 0 0 0 552.116 3055616 326
mu-toksia 326 0 0 0 0 0 0 976.361 408641536 326
pyglaf 313 0 13 0 0 0 0 1002.714 409681920 248

DC-PR-D detailed results

DS-PR-D
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
coquiaas 323 0 0 0 0 3 0 5563.113 93229056 323
mu-toksia 326 0 0 0 0 0 0 1066.520 409702400 326
pyglaf 176 0 150 0 0 0 0 1091.149 409477120 -574

DS-PR-D detailed results