Solver Statistics - David Holland

From Sokoban Wiki

(Difference between revisions)
Jump to: navigation, search
(total statistic for Holland)
Line 1: Line 1:
-
This is a summary of running what I called the Holland collection (81 levels total) using these solvers:<br>
+
= Summary of the Holland level set =
-
:*BoxSearch v5.1 beta2 <br>
+
Each solver is tested separately to ensure that they don't compete for system resources. <br><br>
-
:*JSoko 1.35 <br>
+
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), <br>
-
:*Takaken v7.2<br>
+
this summary disregards all timing associated with solving the levels and solution statistics. <br><br>
-
:*YASS v2.95<br>
+
These tests are mainly for gauging solvability, not timing nor how good the solution is. <br><br>
-
<br>
+
-
The Holland collection is a collection of level sets by David Holland (81 levels total).<br>
+
-
It consists of these level sets (and in this order):<br>
+
-
:* dh1 (10 levels)<br>
+
-
:* dh2 (10 levels)<br>
+
-
:* bagatelle (20 levels)<br>
+
-
:* cantrip (20 levels)<br>
+
-
:* maelstrom (21 levels)<br>
+
-
<br>
+
-
Note:  the maelstrom set contains a level, which is a variant of "Maelstrom Collection #9" (level #70 in the Holland collection), by Aymeric Du Peloux.<br>
+
-
<br>
+
-
Each solver is tested separately to ensure that they don't compete for system resources.
+
-
<br><br>
+
-
For copyrights, credits and redistribution of these statistics, please read the [[Solvers#Disclaimer | disclaimer]].<br>
+
All solvers combined solved 65 of 81 levels.
-
<br>
+
-
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), this summary disregards all timing associated with solving the levels and solution statistics.
+
-
These tests are mainly for gauging solvability, not timing nor how good the solution is.
+
-
 
+
-
<div class="note-2 margin">
+
-
 
+
-
;Not all Sokoban solvers are created equal:
+
-
:*BoxSearch:  (level size limit: none)
+
-
:*JSoko:  (level size limit: width=40, height=40)
+
-
:*Takaken:  (level size limit: width=50, height=50, Boxes=64)
+
-
:*YASS:  (level size limit:  width=50, height=50)
+
-
 
+
-
 
+
-
;Test machine info:
+
-
:*Machine: ThinkPad T61P
+
-
:*CPU:  x86 Family 6 Model 15 Stepping 11 Genuine Intel
+
-
:*Physical RAM: 2 GB
+
-
:*OS Name & Version:  Microsoft Windows XP Professional v5.12600 Service Pack 2 Build 2600.
+
-
*<b>NOTE:</b> The JSoko results are tested on a Samsung Aura Dillen Core 2 Duo T9300 (2,5 GHz) with 3 GiB RAM, OS: Vista Home (Service Pack 1), JRE: 1.6.02_12
+
-
 
+
-
 
+
-
;Test settings:
+
-
:*BoxSearch is set with max memory limit of 1500 MB and 600 seconds.  (using quick mode)
+
-
:*JSoko is set with 1500 MB memory and 600 second limit. (any solution method)
+
-
:*Takaken is set with 1500 MB memory and 600 second limit.
+
-
:*YASS is set with 1500 MB memory and 600 second limit.
+
-
 
+
-
 
+
-
;Further tests:
+
-
:*[[SolverStatistics-yass-Holland | YASS: 57 ]]
+
-
</div>
+
-
 
+
-
 
+
-
 
+
-
The following table shows the levels where each of the solvers failed:
+
-
======================================================================
+
-
+
-
          BoxSearch        JSoko          Takaken          YASS   
+
-
============== ============== ============== ==============
+
-
        4            4            4     
+
-
        5            5     
+
-
        6            6            6     
+
-
        8            8            8            8     
+
-
      11          11          11     
+
-
      12          12     
+
-
      16          16          16          16     
+
-
      17          17          17     
+
-
      18          18          18          18     
+
-
      20          20          20          20     
+
-
      23          23          23     
+
-
      25          25          25     
+
-
      29          29     
+
-
      31          31          31     
+
-
      33     
+
-
      37          37          37     
+
-
      62          62          62          62     
+
-
      63     
+
-
      64          64          64          64     
+
-
      67          67          67     
+
-
      68          68          68          68     
+
-
      71          71          71          71     
+
-
      73          73          73          73     
+
-
      75          75          75          75     
+
-
      76          76          76          76     
+
-
      78          78          78          78     
+
-
      80          80          80          80     
+
-
      81          81          81          81     
+
-
============== ============== ============== ==============
+
-
Total:     25     26     17     23
+
-
+
-
Total (unique level count): 28
+
-
+
-
+
-
+
-
All solvers failed on these levels:
+
-
===================================================================================
+
-
      8      16      18      20      62      64      68      71      73      75
+
-
      76      78      80      81
+
-
===================================================================================
+
-
Total count: 14
+
-
+
-
+
-
"BoxSearch" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      4      5      6      11      12      17      23      29      31      37
+
-
      67
+
-
===================================================================================
+
-
Total count: 11
+
-
+
-
+
-
"JSoko" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      4      5      6      11      23      25      29      31      33      37
+
-
      63      67
+
-
===================================================================================
+
-
Total count: 12
+
-
+
-
+
-
"Takaken" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      17      25      31
+
-
===================================================================================
+
-
Total count: 3
+
-
+
-
+
-
"YASS" failed on these levels where at least one solver solved:
+
-
===================================================================================
+
-
      4      6      11      12      17      23      25      37      67
+
-
===================================================================================
+
-
Total count: 9
+
-
+
-
+
-
"BoxSearch" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
      25
+
-
===================================================================================
+
-
Total count: 1
+
-
+
-
+
-
"JSoko" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
      17
+
-
===================================================================================
+
-
Total count: 1
+
-
+
-
+
-
"Takaken" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
      4      6      11      23      37      67
+
-
===================================================================================
+
-
Total count: 6
+
-
+
-
+
-
"YASS" solved these levels where all other solvers failed:
+
-
===================================================================================
+
-
      31
+
-
===================================================================================
+
-
Total count: 1
+
-
+
-
+
-
"BoxSearch" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"JSoko" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
      33      63
+
-
===================================================================================
+
-
Total count: 2
+
-
+
-
+
-
"Takaken" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
"YASS" failed on these levels where all other solvers solved:
+
-
===================================================================================
+
-
+
-
===================================================================================
+
-
Total count: 0
+
-
+
-
+
-
<!-- STAT --><div class="box margin-2"><div style="width:500px;">
+
-
BoxSearch solved 56 of 81 levels.
+
<div class="box-progress">
<div class="box-progress">
-
<div class="small" style="width: 69.1%;">BoxSearch 69.1%</div>
+
  <div class="small" style="width: 80%;">All solvers 80%</div>
</div>
</div>
-
JSoko solved 55 of 81 levels.
 
-
<div class="box-progress">
 
-
<div class="small" style="width: 67.9%;">JSoko 67.9%</div>
 
-
</div>
 
-
Takaken solved 64 of 81 levels.
+
{| class="soko-table"
-
<div class="box-progress">
+
|-
-
<div class="small" style="width: 79.0%;">Takaken 79.0%</div>
+
-
</div>
+
-
 
+
-
YASS solved 58 of 81 levels.
+
-
<div class="box-progress">
+
-
<div class="small" style="width: 71.6%;">YASS 71.6%</div>
+
-
</div>
+
-
 
+
-
All solvers combined solved 67 of 81 levels.
+
-
<div class="box-progress">
+
-
<div class="small" style="width: 82.7%;background:rgb(125,190,255);">All solvers 82.7%</div>
+
-
</div>
+
-
</div></div><!--/STAT -->
+
<!-- -------------------------------------------------------------------------------------------- -->
 +
! colspan="9" | Solver Statistics  &nbsp;&nbsp;&nbsp;&nbsp;    Set: Holland
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | LevelNo
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 1 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 2 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 3 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 4 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 5 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 6 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 7 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 8 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 9 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 10 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 11 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 12 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{y}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 13 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 14 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 15 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 16 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 17 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{y}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 18 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 19 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 20 &nbsp;&nbsp; || {{n}} || {{n}} || {{y}} ||  {{n}} || {{y}} || no || no || no
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | LevelNo
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 21 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 22 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 23 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 24 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 25 &nbsp;&nbsp; || {{y}} || {{n}} || {{n}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 26 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 27 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 28 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 29 &nbsp;&nbsp; || {{n}} || {{y}} || {{y}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 30 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 31 &nbsp;&nbsp; || {{n}} || {{n}} || {{y}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 32 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 33 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 34 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 35 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 36 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 37 &nbsp;&nbsp; || {{n}} || {{y}} || {{y}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 38 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 39 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 40 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | LevelNo
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 41 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 42 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 43 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 44 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 45 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 46 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 47 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 48 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 49 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 50 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 51 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 52 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 53 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 54 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 55 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 56 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 57 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 58 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 59 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 60 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- bgcolor="#f1efe5" align="center"
 +
| width=" 65"              | LevelNo
 +
| width=" 65"              | BoxSearch
 +
| width=" 65"              | Takaken
 +
| width=" 65"              | YASS
 +
| width=" 80"              | JSoko
 +
| width=" 80"              | Sokolution
 +
| width=" 80"              | Solved by only one
 +
| width=" 80"              | Solved by all
 +
| width=" 80"              | Solved by none
 +
<!-- -------------------------------------------------------------------------------------------- -->
 +
|- align="center"
 +
| align="right" | 61 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 62 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 63 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{n}} || {{y}} || no || no || no
 +
|- align="center"
 +
| align="right" | 64 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 65 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 66 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 67 &nbsp;&nbsp; || {{n}} || {{y}} || {{n}} ||  {{n}} || {{n}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 68 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{y}} || yes || no || no
 +
|- align="center"
 +
| align="right" | 69 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 70 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 71 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 72 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 73 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 74 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 75 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 76 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 77 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 78 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 79 &nbsp;&nbsp; || {{y}} || {{y}} || {{y}} ||  {{y}} || {{y}} || no || yes || no
 +
|- align="center"
 +
| align="right" | 80 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- align="center"
 +
| align="right" | 81 &nbsp;&nbsp; || {{n}} || {{n}} || {{n}} ||  {{n}} || {{n}} || no || no || yes
 +
|- bgcolor="#f1efe5" align="center"
 +
| align="right" | Total &nbsp;&nbsp; || 56 || 65 || 59 || 55 || 65 || 6 || 53 || 11
 +
|}

Revision as of 20:53, 7 March 2019

Summary of the Holland level set

Each solver is tested separately to ensure that they don't compete for system resources.

Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not),
this summary disregards all timing associated with solving the levels and solution statistics.

These tests are mainly for gauging solvability, not timing nor how good the solution is.

All solvers combined solved 65 of 81 levels.

All solvers 80%


Solver Statistics      Set: Holland
LevelNo BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
1    yes yes yes yes yes no yes no
2    yes yes yes yes yes no yes no
3    yes yes yes yes yes no yes no
4    no yes no no no yes no no
5    no yes no no yes no no no
6    no yes no no yes no no no
7    yes yes yes yes yes no yes no
8    no no no no no no no yes
9    yes yes yes yes yes no yes no
10    yes yes yes yes yes no yes no
11    no yes no no no yes no no
12    no yes no yes yes no no no
13    yes yes yes yes yes no yes no
14    yes yes yes yes yes no yes no
15    yes yes yes yes yes no yes no
16    no no no no no no no yes
17    no no no yes yes no no no
18    no no no no no no no yes
19    yes yes yes yes yes no yes no
20    no no yes no yes no no no
LevelNo BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
21    yes yes yes yes yes no yes no
22    yes yes yes yes yes no yes no
23    no yes no no yes no no no
24    yes yes yes yes yes no yes no
25    yes no no no no yes no no
26    yes yes yes yes yes no yes no
27    yes yes yes yes yes no yes no
28    yes yes yes yes yes no yes no
29    no yes yes no yes no no no
30    yes yes yes yes yes no yes no
31    no no yes no no yes no no
32    yes yes yes yes yes no yes no
33    yes yes yes no yes no no no
34    yes yes yes yes yes no yes no
35    yes yes yes yes yes no yes no
36    yes yes yes yes yes no yes no
37    no yes yes no yes no no no
38    yes yes yes yes yes no yes no
39    yes yes yes yes yes no yes no
40    yes yes yes yes yes no yes no
LevelNo BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
41    yes yes yes yes yes no yes no
42    yes yes yes yes yes no yes no
43    yes yes yes yes yes no yes no
44    yes yes yes yes yes no yes no
45    yes yes yes yes yes no yes no
46    yes yes yes yes yes no yes no
47    yes yes yes yes yes no yes no
48    yes yes yes yes yes no yes no
49    yes yes yes yes yes no yes no
50    yes yes yes yes yes no yes no
51    yes yes yes yes yes no yes no
52    yes yes yes yes yes no yes no
53    yes yes yes yes yes no yes no
54    yes yes yes yes yes no yes no
55    yes yes yes yes yes no yes no
56    yes yes yes yes yes no yes no
57    yes yes yes yes yes no yes no
58    yes yes yes yes yes no yes no
59    yes yes yes yes yes no yes no
60    yes yes yes yes yes no yes no
LevelNo BoxSearch Takaken YASS JSoko Sokolution Solved by only one Solved by all Solved by none
61    yes yes yes yes yes no yes no
62    no yes no no yes no no no
63    yes yes yes no yes no no no
64    no no no no no no no yes
65    yes yes yes yes yes no yes no
66    yes yes yes yes yes no yes no
67    no yes no no no yes no no
68    no no no no yes yes no no
69    yes yes yes yes yes no yes no
70    yes yes yes yes yes no yes no
71    no no no no no no no yes
72    yes yes yes yes yes no yes no
73    no no no no no no no yes
74    yes yes yes yes yes no yes no
75    no no no no no no no yes
76    no no no no no no no yes
77    yes yes yes yes yes no yes no
78    no no no no no no no yes
79    yes yes yes yes yes no yes no
80    no no no no no no no yes
81    no no no no no no no yes
Total    56 65 59 55 65 6 53 11
Retrieved from "http://sokobano.de/wiki/index.php?title=Solver_Statistics_-_David_Holland"
Personal tools