Solver Statistics - Lee J Haywood
From Sokoban Wiki
This is a summary of running the SokHard Collection (163 levels total) using these solvers:
• BoxSearch v5.1 beta2
• JSoko 1.35
• Takaken v7.2
• YASS v2.97
Each solver is tested separately to ensure that they don't compete for system resources.
For copyrights, credits and redistribution of these statistics, please read the disclaimer.
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), this summary disregards all timing associated with solving the levels and solution statistics.
These tests are mainly for gauging solvability, not timing nor how good the solution is.
Not all Sokoban solvers are created equal:
- BoxSearch: (level size limit: none)
- JSoko: (level size limit: width=40, height=40)
- Takaken: (level size limit: width=50, height=50, Boxes=64)
- YASS: (level size limit: width=50, height=50)
Test machine info:
- Machine: ThinkPad T42P
- CPU: x86 Family 6 Model 13 Stepping 6 Genuine Intel
- Physical RAM: 2 GB
- OS Name & Version: Microsoft Windows XP Professional v5.12600 Service Pack 2 Build 2600.
- NOTE: The JSoko results are tested on a Samsung Aura Dillen Core 2 Duo T9300 (2,5 GHz) with 3 GiB RAM, OS: Vista Home (Service Pack 1), JRE: 1.6.02_12
Initial tests:
- BoxSearch is set with max memory limit of 1500 MB and 600 seconds. (using quick mode)
- JSoko is set with 1500 MB memory and 600 second limit. (any solution method)
- Takaken is set with 1000 MB memory and 600 second limit.
- YASS is set with 1500 MB memory and 600 second limit.
Further tests:
- (none)
The following table shows the levels where each of the solvers failed:
======================================================================
BoxSearch JSoko Takaken YASS
============== ============== ============== ==============
17
29
35
39
52
64
70
72
74
78
79
80
81
84
85
89
92
96
97
98
100
101
103
105
106
111
112
113
114
116
117
118
119
121
122
125
126
127
129
130
132
133
134
135
137
139
140
141
142
143
144
146
147
149
151
152
153
154
156
159
160
162
============== ============== ============== ==============
Total: 0 62 0 0
Total (unique level count): 62
All solvers failed on these levels:
===================================================================================
===================================================================================
Total count: 0
"BoxSearch" failed on these levels where at least one solver solved:
===================================================================================
===================================================================================
Total count: 0
"JSoko" failed on these levels where at least one solver solved:
===================================================================================
17 29 35 39 52 64 70 72 74 78
79 80 81 84 85 89 92 96 97 98
100 101 103 105 106 111 112 113 114 116
117 118 119 121 122 125 126 127 129 130
132 133 134 135 137 139 140 141 142 143
144 146 147 149 151 152 153 154 156 159
160 162
===================================================================================
Total count: 62
"Takaken" failed on these levels where at least one solver solved:
===================================================================================
===================================================================================
Total count: 0
"YASS" failed on these levels where at least one solver solved:
===================================================================================
===================================================================================
Total count: 0
"BoxSearch" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"JSoko" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"Takaken" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"YASS" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"BoxSearch" failed on these levels where all other solvers solved:
===================================================================================
===================================================================================
Total count: 0
"JSoko" failed on these levels where all other solvers solved:
===================================================================================
17 29 35 39 52 64 70 72 74 78
79 80 81 84 85 89 92 96 97 98
100 101 103 105 106 111 112 113 114 116
117 118 119 121 122 125 126 127 129 130
132 133 134 135 137 139 140 141 142 143
144 146 147 149 151 152 153 154 156 159
160 162
===================================================================================
Total count: 62
"Takaken" failed on these levels where all other solvers solved:
===================================================================================
===================================================================================
Total count: 0
"YASS" failed on these levels where all other solvers solved:
===================================================================================
===================================================================================
Total count: 0
BoxSearch solved 163 of 163 levels.
BoxSearch 100%
JSoko solved 101 of 163 levels.
JSoko 62.0%
Takaken solved 163 of 163 levels.
Takaken 100%
YASS solved 163 of 163 levels.
YASS 100%
All solvers combined solved 163 of 163 levels.
All solvers 100%
