Solver Statistics - Aymeric du Peloux
From Sokoban Wiki
This is a summary of running what I called the Aymeric collection (282 levels total) using these solvers:
• BoxSearch v5.1 beta2
• Takaken v7.0
• YASS v2.66
The Aymeric collection is a collection of level sets by Aymeric Du Peloux (282 levels total).
It consists of these level sets (and in this order):
• COSMONOTES ( 20 levels)
• COSMOPOLY ( 22 levels)
• LOMA (100 levels) -- Note: this is a collection by many authors.
• MICROCOSMOS ( 40 levels)
• MINICOSMOS ( 40 levels)
• NABOKOSMOS ( 40 levels)
• PICOKOSMOS ( 20 levels)
For copyrights, credits and redistribution of these statistics, please read the disclaimer.
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), this summary disregards all timing associated with solving the levels and solution statistics.
These tests are mainly for gauging solvability, not timing nor how good the solution is.
Not all Sokoban solvers are created equal:
- BoxSearch v5.1 beta2 allows setting for max time limit and max memory.
- Takaken v7.0 allows setting for max time but lacks max memory option.
- YASS v2.66 allows setting for max time and max memory option.
Test machine info:
- Machine: ThinkPad T42P
- CPU: x86 Family 6 Model 13 Stepping 6 Genuine Intel
- Physical RAM: 2 GB
- OS Name & Version: Microsoft Windows XP Professional v5.12600 Service Pack 2 Build 2600.
Initial tests:
- BoxSearch is set with max memory limit of 1500 MB and 600 seconds. (using quick mode)
- Takaken is set with 600 seconds time limit
- YASS is set with 1000 MB memory and 600 second limit.
Further tests:
- (none so far)
Note: Each solver is tested separately to ensure that they don't compete for system resources.
The following table shows the levels where each of the solvers failed:
======================================================================
BoxSearch Takaken YASS
============== ============== ==============
275
============== ============== ==============
Total: 0 1 0
Total (unique level count): 1
All solvers failed on these levels:
===================================================================================
===================================================================================
Total count: 0
"BoxSearch" failed on these levels where at least one solver solved:
===================================================================================
===================================================================================
Total count: 0
"Takaken" failed on these levels where at least one solver solved:
===================================================================================
275
===================================================================================
Total count: 1
"YASS" failed on these levels where at least one solver solved:
===================================================================================
===================================================================================
Total count: 0
"BoxSearch" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"Takaken" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"YASS" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"BoxSearch" failed on these levels where all other solvers solved:
===================================================================================
===================================================================================
Total count: 0
"Takaken" failed on these levels where all other solvers solved:
===================================================================================
275
===================================================================================
Total count: 1
"YASS" failed on these levels where all other solvers solved:
===================================================================================
===================================================================================
Total count: 0
BoxSearch solved 282 of 282 levels.
Takaken solved 281 of 282 levels.
YASS solved 282 of 282 levels.
All solvers combined solved 282 of 282 levels.
