Solver Statistics - XSokoban - Thinking Rabbit & Various Authors
From Sokoban Wiki
Revision as of 22:55, 28 February 2019 by Matthias Meger (Talk | contribs)
This is a summary of running the XSokoban level set (90 levels) using these solvers:
- BoxSearch v5.1 beta2
- JSoko v1.34
- Takaken v7.2
- YASS v2.113
- BoxSearch v5.1 beta2
Each solver is tested separately to ensure that they don't compete for system resources.
For copyrights, credits and redistribution of these statistics, please read the disclaimer.
Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), this summary disregards all timing associated with solving the levels and solution statistics.
These tests are mainly for gauging solvability, not timing nor how good the solution is.
- Not all Sokoban solvers are created equal
-
- BoxSearch allows setting for max time limit and max memory. (level size limit: none)
- JSoko allows setting for max time (level size limit: width=40, height=40)
- Takaken allows setting for time and max memory option. (level size limit: width=50, height=50, Boxes=64)
- YASS allows setting for max time and max memory option. (level size limit: width=50, height=50)
- Test machine info
-
- Machine: ThinkPad T61P
- CPU: x86 Family 6 Model 15 Stepping 11 Genuine Intel ~2394 Mhz
- Physical RAM: 2 GB
- OS Name & Version: Microsoft Windows XP Professional v5.12600 Service Pack 2 Build 2600.
- NOTE: The JSoko results are tested on a Samsung Aura Dillen Core 2 Duo T9300 (2,5 GHz) with 3 GiB RAM, OS: Vista Home (Service Pack 1), JRE: 1.6.02_12
- Test settings
-
- BoxSearch is set with max memory limit of 1500 MB and 600 seconds. (using quick mode)
- JSoko is set with max memory limit of 1500 MB and 600 seconds. (using any solution method)
- Takaken is set with 1500 MB memory and 600 second limit
- YASS is set with 1500 MB memory and 600 second limit
The following table shows the levels where each of the solvers failed:
======================================================================
BoxSearch JSoko Takaken YASS
============== ============== ============== ==============
11
12
13
14 14 14
15 15
16 16
18 18 18
19
20
23 23 23
24 24
25
27
28 28
29 29 29 29
30 30
31 31 31
32 32
33
34
35 35
36
37
39 39
40
41 41 41
42
44
45
48 48 48
50 50 50
52 52 52
55
57
61
66 66 66
69 69 69
71 71
72 72
73
74 74
75
76
77 77 77
85 85 85
87
88 88
89 89 89
90 90 90
============== ============== ============== ==============
Total: 48 25 4 15
Total (unique level count): 49
All solvers failed on these levels:
===================================================================================
29
===================================================================================
Total count: 1
"BoxSearch" failed on these levels where at least one solver solved:
===================================================================================
11 12 13 14 15 16 18 19 20 23
24 25 27 28 30 31 32 33 34 35
36 37 39 40 41 42 44 45 48 50
52 57 61 66 69 71 72 73 74 75
76 77 85 87 88 89 90
===================================================================================
Total count: 47
"JSoko" failed on these levels where at least one solver solved:
===================================================================================
14 16 18 23 24 30 31 32 35 41
48 50 52 55 66 69 71 72 74 77
85 88 89 90
===================================================================================
Total count: 24
"Takaken" failed on these levels where at least one solver solved:
===================================================================================
50 66 69
===================================================================================
Total count: 3
"YASS" failed on these levels where at least one solver solved:
===================================================================================
14 15 18 23 28 31 39 41 48 52
77 85 89 90
===================================================================================
Total count: 14
"BoxSearch" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"JSoko" solved these levels where all other solvers failed:
===================================================================================
===================================================================================
Total count: 0
"Takaken" solved these levels where all other solvers failed:
===================================================================================
14 18 23 31 41 48 52 77 85 89
90
===================================================================================
Total count: 11
"YASS" solved these levels where all other solvers failed:
===================================================================================
50 66 69
===================================================================================
Total count: 3
"BoxSearch" failed on these levels where all other solvers solved:
===================================================================================
11 12 13 19 20 25 27 33 34 36
37 40 42 44 45 57 61 73 75 76
87
===================================================================================
Total count: 21
"JSoko" failed on these levels where all other solvers solved:
===================================================================================
55
===================================================================================
Total count: 1
"Takaken" failed on these levels where all other solvers solved:
===================================================================================
===================================================================================
Total count: 0
"YASS" failed on these levels where all other solvers solved:
===================================================================================
===================================================================================
Total count: 0
BoxSearch solved 42 of 90 levels.
BoxSearch 46.7%
JSoko solved 65 of 90 levels.
JSoko 72.2%
Takaken solved 86 of 90 levels.
Takaken 95.6%
YASS solved 75 of 90 levels.
YASS 83.3%
All solvers combined solved 89 of 90 levels.
All solvers 98.9%
