Solver Statistics

From Sokoban Wiki

(Difference between revisions)
Jump to: navigation, search
(GroupEffort Test Suite)
Line 23: Line 23:
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - BoxWorld - Various Authors| BoxWorld]] ||align="left"|Various Authors|| 100 || 87 || '''98''' || [[SolverStatistics-yass-BoxWorld | 94 ]]  || [[SolverStatistics-jsoko-VariousAuthors-BoxWorld | 82 ]] || [[SolverStatistics-sokolution-BoxWorld | 94]]
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - BoxWorld - Various Authors| BoxWorld]] ||align="left"|Various Authors|| 100 || 87 || '''98''' || [[SolverStatistics-yass-BoxWorld | 94 ]]  || [[SolverStatistics-jsoko-VariousAuthors-BoxWorld | 82 ]] || [[SolverStatistics-sokolution-BoxWorld | 94]]
|- align="right"
|- align="right"
-
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - Grigr2001 - Evgeny Grigoriev| Grigr2001]] ||align="left"|Evgeny Grigoriev|| 100 || 93 || 94 || [[SolverStatistics-yass-Grigr2001 | 93 ]] || [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2001 | 91 ]] || [[SolverStatistics-sokolution-Grigr2001 | '''95''']]
+
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - Grigr2001 - Evgeny Grigoriev| Grigr2001]] ||align="left"|Evgeny Grigoriev|| 100 || 93 || 94 || [[SolverStatistics-yass-Grigr2001 | 93 ]] || [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2001 | 91 ]] || [[SolverStatistics-sokolution-Grigr2001 | '''96''']]
|- align="right"
|- align="right"
-
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - Grigr2002 - Evgeny Grigoriev| Grigr2002]] ||align="left"|Evgeny Grigoriev|| 40|| 37 || 36 || [[SolverStatistics-yass-Grigr2002 | '''38''' ]] || [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2002 | 34 ]] ||  [[SolverStatistics-sokolution-Grigr2002 | 36]]
+
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - Grigr2002 - Evgeny Grigoriev| Grigr2002]] ||align="left"|Evgeny Grigoriev|| 40|| 37 || 36 || [[SolverStatistics-yass-Grigr2002 | 38 ]] || [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2002 | 34 ]] ||  [[SolverStatistics-sokolution-Grigr2002 | '''39''']]
|- align="right"
|- align="right"
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - GrigrSpecial - Evgeny Grigoriev| GrigrSpecial]] ||align="left"|Evgeny Grigoriev|| 40|| 39 || '''40''' || [[SolverStatistics-yass-GrigrSpecial | '''40''' ]] || [[SolverStatistics-jsoko-EvgenyGrigoriev-GrigrSpecial | 39 ]] ||  [[SolverStatistics-sokolution-GrigrSpecial | '''40''']]
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - GrigrSpecial - Evgeny Grigoriev| GrigrSpecial]] ||align="left"|Evgeny Grigoriev|| 40|| 39 || '''40''' || [[SolverStatistics-yass-GrigrSpecial | '''40''' ]] || [[SolverStatistics-jsoko-EvgenyGrigoriev-GrigrSpecial | 39 ]] ||  [[SolverStatistics-sokolution-GrigrSpecial | '''40''']]
|- align="right"
|- align="right"
-
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - David Holland| Holland]] ||align="left"|David Holland|| 81|| 56 || '''64'''  || [[SolverStatistics-yass-Holland | 59 ]] || [[SolverStatistics-David Holland-Holland | 55 ]] || [[SolverStatistics-sokolution-Holland | 61]]
+
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - David Holland| Holland]] ||align="left"|David Holland|| 81|| 56 || '''64'''  || [[SolverStatistics-yass-Holland | 59 ]] || [[SolverStatistics-David Holland-Holland | 55 ]] || [[SolverStatistics-sokolution-Holland | '''64''']]
|- align="right"
|- align="right"
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - Kenya Maruyama| Kenyam Set A]] ||align="left"|Kenya Maruyama|| 52|| 48 || 50  || [[SolverStatistics-yass-KenyamSetA | '''51''' ]] || [[SolverStatistics-jsoko-KenyaMaruyama-KenyamSetA | 45 ]] || [[SolverStatistics-sokolution-KenyamSetA | 50]]
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - Kenya Maruyama| Kenyam Set A]] ||align="left"|Kenya Maruyama|| 52|| 48 || 50  || [[SolverStatistics-yass-KenyamSetA | '''51''' ]] || [[SolverStatistics-jsoko-KenyaMaruyama-KenyamSetA | 45 ]] || [[SolverStatistics-sokolution-KenyamSetA | 50]]
Line 63: Line 63:
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - Y.M. Handmade - Yoshio Murase| Y.M. Handmade ]] ||align="left"|Yoshio Murase|| 54 || '''54''' || '''54''' || [[SolverStatistics-yass-YoshioMuraseHandmade | 52 ]] || [[SolverStatistics-jsoko-YoshioMurase-Handmade | 52 ]] || [[SolverStatistics-sokolution-YoshioMuraseHandmade | 53 ]]
| align="left" bgcolor="#f1efe5"| [[Solver Statistics - Y.M. Handmade - Yoshio Murase| Y.M. Handmade ]] ||align="left"|Yoshio Murase|| 54 || '''54''' || '''54''' || [[SolverStatistics-yass-YoshioMuraseHandmade | 52 ]] || [[SolverStatistics-jsoko-YoshioMurase-Handmade | 52 ]] || [[SolverStatistics-sokolution-YoshioMuraseHandmade | 53 ]]
|- bgcolor="#f1efe5" align="right"
|- bgcolor="#f1efe5" align="right"
-
| align="left"| Total || || 3424 || 2688 || '''2999''' || 2825 || 2664 || 2938
+
| align="left"| Total || || 3424 || 2688 || '''2999''' || 2825 || 2664 || 2945
|}
|}

Revision as of 12:59, 19 November 2017

Sokoban solvers are programs that solve sokoban levels. There are many programs available that can solve Sokoban levels (see Sokoban solvers).

There are different solver types:

  1. Solvers which just try to find any solution
  2. Solvers which try to find push optimal solutions
  3. Solvers which try to find push optimal solutions with best moves
  4. Solvers which try to find move optimal solutions
  5. Solvers which try to find move optimal solutions with best pushes

Usually a solver is designed to just find any solution. If the solution is to be optimized an optimizer program can be used (Optimizers).

To get an impression of what levels are solvable by which solver here are some statistics.
For copyrights, credits and redistribution of these statistics, please read the disclaimer.

Solver Statistics - Solved Levels
Collection Author Levels BoxSearch Takaken YASS JSoko Sokolution
Aymeric Aymeric du Peloux 282 282 282 282 282 282
BoxWorld Various Authors 100 87 98 94 82 94
Grigr2001 Evgeny Grigoriev 100 93 94 93 91 96
Grigr2002 Evgeny Grigoriev 40 37 36 38 34 39
GrigrSpecial Evgeny Grigoriev 40 39 40 40 39 40
Holland David Holland 81 56 64 59 55 64
Kenyam Set A Kenya Maruyama 52 48 50 51 45 50
Microban David W. Skinner 155 155 155 155 155 155
Microban II David W. Skinner 135 134 134 135 135 131
Sasquatch David W. Skinner 50 22 35 26 28 33
Sasquatch II David W. Skinner 50 16 32 20 18 24
Sasquatch III David W. Skinner 50 14 20 13 12 21
Sasquatch IV David W. Skinner 50 27 36 30 25 32
Sasquatch V David W. Skinner 50 30 36 29 25 33
Sasquatch VI David W. Skinner 50 30 31 25 26 35
Sasquatch VII David W. Skinner 50 30 31 26 25 36
SokEvo Lee J Haywood 107 107 107 107 107 107
SokHard Lee J Haywood 163 163 163 163 158 163
Sven Sven Egevad 1623 1170 1363 1251 1147 1333
XSokoban Thinking Rabbit, ... 90 42 86 84 71 72
Y.M. AutoYoshio Murase 52 52 52 52 52 52
Y.M. Handmade Yoshio Murase 54 54 54 52 52 53
Total 3424 2688 2999 2825 2664 2945


Solver Statistics - Push-optimal Solutions
Collection Author Levels Pereira et al. JSoko
XSokoban Thinking Rabbit, ... 90 28 31
Total 90 28 31

GroupEffort Test Suite

The reason for benchmarking the GroupEffort test suite is to show the limits of the veracity of the statement made in section "6 Conclusion" of the thesis, where the author writes that the GroupEffort solver "outperforms existing solvers".

The benchmarks show that this was only true for the cherry-picked small test set at the time the thesis was published, never for the presumably more representative large test set.

Solver Statistics - GroupEffort Test Suite
Collection Levels GroupEffort Sokolution JSoko YASS
Small Set 200 196 (a) 200 180 191
Large Set 2851 1566 (b) 2471 2260
Total 3051 1762 2671 2471

(a): 196 solutions with the best GroupEffort solver configuration, and a 5 minutes time limit.

(b): 1566 solutions with the best GroupEffort solver configuration, and a 5 minutes time limit.

Disclaimer

Sokoban
=======

Sokoban (R) Registered Trademark of Falcon Co., Ltd., Japan Sokoban Copyright (C) 1982-2004 by Hiroyuki Imabayashi, Japan Sokoban Copyright (C) 1989, 1990, 2001-2004 by Falcon Co., Ltd., Japan
License =======
Redistribution and use of the Sokoban Solver statistics are permitted provided that the following conditions are met:
* Redistributions may not be sold, nor may they be used in a commercial product or activity. * Redistributions must reproduce the entire content of this disclaimer in the documentation and/or other materials provided with the distribution.
Credits (in no particular order) =================================
Sokolution Copyright (C) 2016 by Florent DIEDLER E-mail: fdiedler2000@gmail.com Web site: http://codeanalysis.fr/sokoban/
BoxSearch Copyright (C) 2007 by Ge Yong E-mail: notabdc@hotmail.com Web site: unknown
JSoko Copyright (C) by Matthias Meger E-mail: JSoko@online.de Web site: http://www.sokoban-online.de
Sokoban Automatic Solver (aka Takaken solver) Copyright (C) 2002 - 200X Ken'ichiro Takahashi (aka takaken) E-mail: takaken@ic-net.or.jp Web site: http://www.ic-net.or.jp/home/takaken/e/soko/index.html
YASS - Yet Another Sokoban Solver and Optimizer - For Small Levels Copyright (C) 2007 by Brian Damgaard E-mail: BrianDamgaard@jubii.dk Web site: http://sourceforge.net/projects/sokobanyasc/
CosmoNotes, CosmoPoly, LOMA, MicroCosmos, MiniCosmos, NaboCosmos and PicoCosmos level sets Copyright (C) by Aymeric du Peloux. E-mail: aymeric.du-peloux@gadz.org Web site: unknown
dh1, dh2, bagatelle, cantrip, and maelstrom level sets Copyright (C) by David Holland E-mail: unknown Web site: unknown
Microban, Mas Microban, Sasquatch, Mas Sasquatch, Sasquatch III, Sasquatch IV, Sasquatch V, Sasquatch VI and Sasquatch VII level sets. Copyright (C) by David W. Skinner E-mail: sasquatch@bentonrea.com Web site: unknown
Grigr2001, Grigr2002 and GrigrSpecial level sets Copyright (C) by Evgeny Grigoriev (aka GRIGoRusha) E-mail: grigr@yandex.ru Web site: http://grigr.narod.ru/
Kenyam Set A Copyright (C) 2000-2006 by Kenya Maruyama E-mail: rmckenyam@hotmail.com Web Site: http://www.geocities.jp/rmcsokoban/soko/skrmc_a.htm
SokEvo and SokHard level sets Copyright (C) 2002-2006 by Lee J Haywood E-mail: fruise@gmail.com Web Site: http://leehaywood.org/games/sokoban/
Sven level set Copyright (C) 2007 by Sven Egevad E-mail: sven.egevad@telia.com Web Site: unknown
Y.M. Auto and Y.M. Handmade level sets Copyright (C) Yoshio Murase E-mail: yoshio@asahi.email.ne.jp Web Site: http://www.ne.jp/asahi/ai/yoshio/sokoban/index.html
Box World Copyright (C) 1998 by Jeng-Long Jiang E-mail: unknown Web Site: unknown
Sokofan Copyright (C) 2005-2007 by Eric Leung E-mail: eleung2@hotpop.com Web Site: unknown
Sokoban YASC Copyright (C) 2007 by Brian Damgaard E-mail: BrianDamgaard@jubii.dk Web Site: http://sourceforge.net/projects/sokobanyasc/
YSokoban Copyright (C) 2007 by George Petrov E-mail: YGP@WriteMe.com Web Site: http://ygp.orgfree.com/sokoban.html
XSokoban Copyright (C) by Andrew Myers E-mail: andru@cs.cornell.edu Web Site: http://www.cs.cornell.edu/andru/xsokoban.html
Trademarks ==========
Company names, brand names and product names are trademarks or registered trademarks of their respective holders.
Contact =======
E-mail: sokoban@online.de
Personal tools