Solver Statistics
From Sokoban Wiki
m (Reverted edits by Matthias Meger (Talk) to last revision by Briandamgaard) |
(→Solver Statistics: huge sven set added (not completed yet)) |
||
Line 748: | Line 748: | ||
| 2872 <!-- JSoko --> | | 2872 <!-- JSoko --> | ||
| '''3390''' <!-- Sokolution --> | | '''3390''' <!-- Sokolution --> | ||
+ | |||
+ | |} | ||
+ | |||
+ | |||
+ | {| class="soko-table" | ||
+ | |- | ||
+ | ! colspan="8" | Sokoban Solver Statistics - Unfinished Results | ||
+ | |||
+ | <!-- Header --> | ||
+ | |- bgcolor="#f1efe5" align="center" | ||
+ | | width="115" align="left" | Collection | ||
+ | | width="160" | Author | ||
+ | | width=" 70" | Levels | ||
+ | | width=" 80" | BoxSearch | ||
+ | | width= "80" | <span class="plainlinks">[http://www.ic-net.or.jp/home/takaken/e/soko/index.html Takaken]</span> | ||
+ | | width=" 80" | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span> | ||
+ | | width=" 80" | [[JSoko Solver | JSoko]] | ||
+ | | width=" 80" | <span class="plainlinks">[http://codeanalysis.fr/sokoban/ Sokolution ]</span> | ||
+ | |||
+ | <!-- -------------------------------------------------------------------------------------------- --> | ||
+ | <!-- Sven. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution" --> | ||
+ | <!-- -------------------------------------------------------------------------------------------- --> | ||
+ | |- align="right" | ||
+ | | align="left" bgcolor="#f1efe5" | [[Solver Statistics - Sven Egevad | Sven ]] | ||
+ | | align="left" | Sven Egevad | ||
+ | | 1911 | ||
+ | | ? | ||
+ | | [[SolverStatistics-takaken-SvenEgevad | 1652 ]] | ||
+ | | [[SolverStatistics-yass-SvenEgevad | ? ]] | ||
+ | | [[SolverStatistics-jsoko-SvenEgevad-Sven | ? ]] | ||
+ | | [[SolverStatistics-sokolutionv3.1-SvenEgevad | '''1712''']] | ||
|} | |} |
Revision as of 16:29, 24 April 2019
Sokoban solvers are programs that solve sokoban levels. There are many programs available that can solve Sokoban levels (see Sokoban solvers).
There are different solver types:
- Solvers which just try to find any solution
- Solvers which try to find push optimal solutions
- Solvers which try to find push optimal solutions with best moves
- Solvers which try to find move optimal solutions
- Solvers which try to find move optimal solutions with best pushes
Usually a solver is designed to just find any solution. If the solution is to be optimized an optimizer program can be used (Optimizers).
To get an impression of what levels are solvable by which solver here are some statistics.
For copyrights, credits and redistribution of these statistics, please read the disclaimer.
Contents |
XSokoban Test Suite
The XSokoban level set is the de facto standard test suite in the academic literature on Sokoban solver programming.
Sokoban Solver Statistics - XSokoban Test Suite - Solved Levels | ||||||||
---|---|---|---|---|---|---|---|---|
Collection | Author | Levels | Junghanns | BoxSearch | Takaken | YASS | JSoko | Sokolution |
XSokoban | Thinking Rabbit, ... | 90 | 54 | 42 | 86 | 84 | 71 | 80 |
Sokoban Solver Statistics - XSokoban Test Suite - Push-optimal Solutions | ||||||
---|---|---|---|---|---|---|
Collection | Author | Levels | Junghanns | Pereira et al. | JSoko | Sokolution |
XSokoban | Thinking Rabbit, ... | 90 | 6 | 28 | 31 | 38 |
Large Test Suite
The large test suite comprises level packs selected for being a challenge for the solvers, but not too difficult. The statistics shows the results for the leading Sokoban solver programs.
Sokoban Solver Statistics - Large Test Suite - Solved Levels | |||||||
---|---|---|---|---|---|---|---|
Collection | Author | Levels | BoxSearch | Takaken | YASS | JSoko | Sokolution |
Aymeric | Aymeric du Peloux | 282 | 282 | 282 | 282 | 282 | 282 |
Grigr2001 | Evgeny Grigoriev | 100 | 93 | 94 | 93 | 92 | 95 |
Grigr2002 | Evgeny Grigoriev | 40 | 37 | 37 | 38 | 34 | 40 |
GrigrSpecial | Evgeny Grigoriev | 40 | 39 | 40 | 40 | 39 | 40 |
Holland | David Holland | 81 | 56 | 65 | 59 | 55 | 65 |
Microban | David W. Skinner | 155 | 155 | 155 | 155 | 155 | 155 |
Microban II | David W. Skinner | 135 | 134 | 134 | 135 | 135 | 132 |
Sasquatch | David W. Skinner | 50 | 22 | 36 | 26 | 28 | 36 |
Sasquatch II | David W. Skinner | 50 | 16 | 33 | 20 | 18 | 32 |
Sasquatch III | David W. Skinner | 50 | 14 | 22 | 13 | 12 | 25 |
Sasquatch IV | David W. Skinner | 50 | 27 | 37 | 30 | 25 | 35 |
Sasquatch V | David W. Skinner | 50 | 30 | 36 | 29 | 25 | 37 |
Sasquatch VI | David W. Skinner | 50 | 30 | 32 | 25 | 26 | 38 |
Sasquatch VII | David W. Skinner | 50 | 30 | 31 | 26 | 25 | 40 |
SokEvo | Lee J Haywood | 107 | 107 | 107 | 107 | 107 | 107 |
SokHard | Lee J Haywood | 163 | 163 | 163 | 163 | 158 | 163 |
Sven | Sven Egevad | 1623 | 1170 | 1384 | 1251 | 1147 | 1432 |
XSokoban | Thinking Rabbit, ... | 90 | 42 | 86 | 84 | 71 | 80 |
Y.M. Auto | Yoshio Murase | 52 | 52 | 52 | 52 | 52 | 52 |
Y.M. Handmade | Yoshio Murase | 54 | 54 | 54 | 52 | 52 | 53 |
Total | 3272 | 2553 | 2880 | 2680 | 2538 | 2939 |
GroupEffort Test Suite
The reason for benchmarking the GroupEffort test suite is to show the limited veracity of the statement made in section "6 Conclusion" of the thesis, where the author writes that the GroupEffort solver "outperforms existing solvers".
The benchmarks show that this was only true for the cherry-picked small test set at the time the thesis was published, never for the presumably more representative large test set.
Sokoban Solver Statistics - GroupEffort Test Suite - Solved Levels | ||||||
---|---|---|---|---|---|---|
Collection | Levels | GroupEffort | Sokolution | Takaken | JSoko | YASS |
Small Set | 200 | 196 (a)(c) | 200 (a) | 192 (b) | 180 (b) | 191 (b) |
Large Set | 2851 | 1566 (a)(c) | 2471 (a) | 2462 (b) | 2165 (b) | 2260 (b) |
Total | 3051 | 1762 | 2671 | 2654 | 2345 | 2471 |
(a): Time limit: 5 minutes (b): Time limit: 10 minutes (c): Best GroupEffort solver configuration
Solver Statistics
The statistics shows the results for the leading Sokoban solvers for various level packs. Please note that the grand totals are simple summations. The number of solved unique levels may differ slightly due to duplicate levels in the level packs.
Sokoban Solver Statistics - Solved Levels | |||||||
---|---|---|---|---|---|---|---|
Collection | Author | Levels | BoxSearch | Takaken | YASS | JSoko | Sokolution |
Aymeric | Aymeric du Peloux | 282 | 282 | 282 | 282 | 282 | 282 |
Grigr2001 | Evgeny Grigoriev | 100 | 93 | 94 | 93 | 92 | 95 |
Grigr2002 | Evgeny Grigoriev | 40 | 37 | 37 | 38 | 34 | 40 |
GrigrSpecial | Evgeny Grigoriev | 40 | 39 | 40 | 40 | 39 | 40 |
Holland | David Holland | 81 | 56 | 65 | 59 | 55 | 65 |
Microban | David W. Skinner | 155 | 155 | 155 | 155 | 155 | 155 |
Microban II | David W. Skinner | 135 | 134 | 134 | 135 | 135 | 132 |
Sasquatch | David W. Skinner | 50 | 22 | 36 | 26 | 28 | 36 |
Sasquatch II | David W. Skinner | 50 | 16 | 33 | 20 | 18 | 32 |
Sasquatch III | David W. Skinner | 50 | 14 | 22 | 13 | 12 | 25 |
Sasquatch IV | David W. Skinner | 50 | 27 | 37 | 30 | 25 | 35 |
Sasquatch V | David W. Skinner | 50 | 30 | 36 | 29 | 25 | 37 |
Sasquatch VI | David W. Skinner | 50 | 30 | 32 | 25 | 26 | 38 |
Sasquatch VII | David W. Skinner | 50 | 30 | 31 | 26 | 25 | 40 |
Sharpen | Sven Egevad | 153 | 34 | 76 | 43 | 46 | 84 |
SokEvo | Lee J Haywood | 107 | 107 | 107 | 107 | 107 | 107 |
SokHard | Lee J Haywood | 163 | 163 | 163 | 163 | 158 | 163 |
Sokoban Perfect | Thinking Rabbit | 306 | 146 | 261 | 188 | 188 | 233 |
Sokoban Revenge | Thinking Rabbit | 306 | 148 | 244 | 194 | 171 | 214 |
Sven | Sven Egevad | 1623 | 1170 | 1384 | 1251 | 1147 | 1432 |
Y.M. Auto | Yoshio Murase | 52 | 52 | 52 | 52 | 52 | 52 |
Y.M. Handmade | Yoshio Murase | 54 | 54 | 54 | 52 | 52 | 53 |
Total | 3947 | 2839 | 3375 | 3021 | 2872 | 3390 |
Sokoban Solver Statistics - Unfinished Results | |||||||
---|---|---|---|---|---|---|---|
Collection | Author | Levels | BoxSearch | Takaken | YASS | JSoko | Sokolution |
Sven | Sven Egevad | 1911 | ? | 1652 | ? | ? | 1712 |
Disclaimer
Sokoban =======
Sokoban (R) Registered Trademark of Falcon Co., Ltd., Japan Sokoban Copyright (C) 1982-2004 by Hiroyuki Imabayashi, Japan Sokoban Copyright (C) 1989, 1990, 2001-2004 by Falcon Co., Ltd., Japan
License =======
Redistribution and use of the Sokoban Solver statistics are permitted provided that the following conditions are met:
* Redistributions may not be sold, nor may they be used in a commercial product or activity. * Redistributions must reproduce the entire content of this disclaimer in the documentation and/or other materials provided with the distribution.
Credits (in no particular order) ================================
CosmoNotes, CosmoPoly, LOMA, MicroCosmos, MiniCosmos, NaboCosmos and PicoCosmos level sets Copyright (C) by Aymeric du Peloux. E-mail: aymeric.du-peloux@gadz.org Web site: unknown
dh1, dh2, bagatelle, cantrip, and maelstrom level sets Copyright (C) by David Holland E-mail: unknown Web site: unknown
Microban, Mas Microban, Sasquatch, Mas Sasquatch, Sasquatch III, Sasquatch IV, Sasquatch V, Sasquatch VI and Sasquatch VII level sets. Copyright (C) by David W. Skinner E-mail: sasquatch@bentonrea.com Web site: unknown
Grigr2001, Grigr2002 and GrigrSpecial level sets Copyright (C) by Evgeny Grigoriev (aka GRIGoRusha) E-mail: grigr@yandex.ru Web site: http://grigr.narod.ru/
Kenyam Set A Copyright (C) 2000-2006 by Kenya Maruyama E-mail: rmckenyam@hotmail.com Web Site: http://www.geocities.jp/rmcsokoban/soko/skrmc_a.htm
SokEvo and SokHard level sets Copyright (C) 2002-2006 by Lee J Haywood E-mail: fruise@gmail.com Web Site: http://leehaywood.org/games/sokoban/
Sven level set Copyright (C) 2007 by Sven Egevad E-mail: sven.egevad@telia.com Web Site: unknown
Sokoban Perfect and Sokoban Revenge level sets Copyright (C) 1989, 1991 by Thinking Rabbit Web Site: https://sokoban.jp/
Y.M. Auto and Y.M. Handmade level sets Copyright (C) Yoshio Murase E-mail: yoshio@asahi.email.ne.jp Web Site: http://www.ne.jp/asahi/ai/yoshio/sokoban/index.html
BoxSearch Copyright (C) 2007 by Ge Yong E-mail: notabdc@hotmail.com Web site: unknown
JSoko Copyright (C) by Matthias Meger E-mail: JSoko@online.de Web site: http://www.sokoban-online.de
Sokoban Automatic Solver (aka Takaken solver) Copyright (C) 2002 - 200X Ken'ichiro Takahashi (aka takaken) E-mail: takaken@ic-net.or.jp Web site: http://www.ic-net.or.jp/home/takaken/e/soko/index.html
YASS - Yet Another Sokoban Solver and Optimizer - For Small Levels Copyright (C) 2007 by Brian Damgaard E-mail: BrianDamgaard@jubii.dk Web site: http://sourceforge.net/projects/sokobanyasc/
Sokoban YASC Copyright (C) 2001-2019 by Brian Damgaard E-mail: BrianDamgaard@jubii.dk Web Site: https://sourceforge.net/projects/sokobanyasc/
YSokoban Copyright (C) 2007 by George Petrov E-mail: YGP@WriteMe.com Web Site: http://ygp.orgfree.com/sokoban.html
XSokoban Copyright (C) by Andrew Myers E-mail: andru@cs.cornell.edu Web Site: http://www.cs.cornell.edu/andru/xsokoban.html
Sokofan Copyright (C) 2005-2007 by Eric Leung E-mail: eleung2@hotpop.com Web Site: unknown
Sokolution Copyright (C) 2016-2019 by Florent DIEDLER E-mail: fdiedler2000@gmail.com Web site: http://codeanalysis.fr/sokoban/
Trademarks ==========
Company names, brand names and product names are trademarks or registered trademarks of their respective holders.
Contact =======
E-mail: sokoban@online.de