Results for ST Track

Click here to see aggregated results for the ST track or go back to all results.

In the tables below we provide an overview of the solvers' performance for each problem. The column Solver, #Corr, #Cra, #Inc, #Fail, #Inv, #TO, #OOM, Time, Memory, Score corresponds to: name of the solver, number of correct answers, number of crashes, number of incorrect answers, number of failures, number of invalid answers, number of timeouts, number of out of memory, running time (total), used memory (max) and final score, respectively. In detail, #Cra refers to the number of times the solver crashed due to memory issues, #Fail are all those runs that did not produce an answer (e.g., because of timeouts), #Inc refers to syntactically correct, but wrong, answers, and #Inv is the number of syntactically incorrect answers.

SE-ST
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 483.428 3076096 326
coquiaas 325 0 0 1 0 0 0 455.268 59961344 325
eqargsolver 290 0 0 0 0 36 0 25229.625 3059712 290
mu-toksia 326 0 0 0 0 0 0 183.732 3059712 326
pyglaf 326 0 0 0 0 0 0 1099.759 85348352 326
taas-dredd 134 4 118 0 0 70 0 53159.302 99676160 -456
yonas 182 129 0 0 0 6 9 91254.762 9995333632 182

SE-ST detailed results

EE-ST
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 656.705 86528000 326
coquiaas 326 0 0 0 0 0 0 942.472 65941504 326
eqargsolver 290 0 0 0 0 36 0 25223.141 3059712 290
mu-toksia 326 0 0 0 0 0 0 483.222 78954496 326
pyglaf 326 0 0 0 0 0 0 1579.806 98836480 326
taas-dredd 249 4 3 0 0 70 0 52902.185 99622912 114.968
yonas 303 0 0 0 0 15 8 180159.470 9953787904 148.669

EE-ST detailed results

DC-ST
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 474.731 3076096 326
coquiaas 326 0 0 0 0 0 0 222.065 3051520 326
eqargsolver 290 0 0 0 0 36 0 25217.356 3055616 290
mu-toksia 326 0 0 0 0 0 0 134.863 3059712 326
pyglaf 326 0 0 0 0 0 0 1062.365 85270528 326
taas-dredd 251 1 61 0 0 13 0 12495.412 59154432 -54
yonas 173 0 0 0 0 142 11 98543.376 9904291840 173

DC-ST detailed results

DS-ST
Solver #Corr #Cra #Inc #Fail #Inv #TO #OOM Time Memory Score
aspartix19 326 0 0 0 0 0 0 496.833 3080192 326
coquiaas 326 0 0 0 0 0 0 358.952 43679744 326
eqargsolver 290 0 0 0 0 36 0 25225.550 3059712 290
mu-toksia 326 0 0 0 0 0 0 197.775 3059712 326
pyglaf 326 0 0 0 0 0 0 1121.879 85712896 326
taas-dredd 157 4 96 0 0 69 0 51939.673 98570240 -323
yonas 257 56 12 0 1 0 0 41237.477 9834078208 197

DS-ST detailed results