Solver Statistics

From Sokoban Wiki

(Difference between revisions)
Jump to: navigation, search
m (→Solver Statistics)
(New Sokolution website)
 
(260 intermediate revisions not shown)
Line 1: Line 1:
-
Sokoban solvers are programs that solve sokoban levels. There are many programs available that can solve Sokoban levels (see [[Links#Sokoban Solvers |Sokoban solvers]]).
+
A Sokoban solver program is a program that <u>''tries to''</u> solve Sokoban levels. There are several solver programs available. (See [[Links#Sokoban Solvers |Sokoban solvers]].)
-
There are different solver types:
+
Solver programs may have different objectives:
-
# Solvers which just try to find any solution
+
# Find any solution
-
# Solvers which try to find push optimal solutions
+
# Find push optimal solutions
-
# Solvers which try to find push optimal solutions with best moves
+
# Find push optimal solutions with best moves
-
# Solvers which try to find move optimal solutions
+
# Find move optimal solutions
-
# Solvers which try to find move optimal solutions with best pushes
+
# Find move optimal solutions with best pushes
-
Usually a solver is designed to just find any solution. If the solution is to be optimized an optimizer program can be used ([[Links#Sokoban Solvers |Optimizers]]).
+
Given the computational complexity of these tasks, a solver program is usually designed for just finding any solution. If a solution is to be optimized, an optimizer program can be used. (See [[Links#Sokoban Solvers |Optimizers]].)
-
To get an impression of what levels are solvable by which solver here are some statistics.<br />  
+
The statistics presented here provide a picture of what the best freely available Sokoban solvers can do.<br />  
For copyrights, credits and redistribution of these statistics, please read the disclaimer.
For copyrights, credits and redistribution of these statistics, please read the disclaimer.
-
== XSokoban Test Suite ==
 
-
The XSokoban level set is the de facto standard test suite in the academic literature on Sokoban solver programming.
+
== General benchmarking information ==
-
{| class="soko-table"
+
For practical reasons, almost all tests have been performed with a 10 minutes time limit. The tests are, however, not a 10 minutes contest but a showcase for what the solvers can do, so other time limits are entirely feasible.
-
|-
+
-
! colspan="9" | Sokoban Solver Statistics - XSokoban Test Suite - Solved Levels
+
-
<!-- Header -->
+
The hardware used for the tests is a standard PC with a modern operating system (64bit).
-
|- bgcolor="#f1efe5" align="center"
+
-
| width="115" align="left" |      Collection
+
-
| width="160"  |                Author
+
-
| width=" 70"  |                Levels
+
-
| width= "80"  | <span class="plainlinks">[https://www.researchgate.net/publication/2305703_Pushing_the_Limits_New_Developments_in_Single-Agent_Search Junghanns]</span>
+
-
| width=" 80"  |                BoxSearch
+
-
| width= "80"  | <span class="plainlinks">[http://www.ic-net.or.jp/home/takaken/e/soko/index.html                Takaken]</span>
+
-
| width=" 80"  | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span>
+
-
| width=" 80"  | [[JSoko Solver    | JSoko]]
+
-
| width=" 80"  | <span class="plainlinks">[http://codeanalysis.fr/sokoban/ Sokolution ]</span>
+
-
<!-- ---------------------------------------------------------------------------------------------- -->
+
Tests are performed with default solver settings.
-
<!-- XSokoban. "Collection, author, levels, Junghanns, BoxSearch, Takaken, YASS, JSoko, Sokolution" -->
+
-
<!-- ---------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5" | [[Solver Statistics - XSokoban - Thinking Rabbit & Various Authors| XSokoban ]]
+
-
| align="left"                                                | Thinking Rabbit, ...
+
-
|                                                                  90
+
-
| <span class="plainlinks">[https://webdocs.cs.ualberta.ca/~games/Sokoban/program.html 54]</span>
+
-
|                                                                  42
+
-
| [[SolverStatistics-takaken-ThinkingRabbit-XSokoban          | '''86''' ]]
+
-
| [[SolverStatistics-yass-ThinkingRabbit-XSokoban            |    84    ]]
+
-
| [[SolverStatistics-jsoko-ThinkingRabbit-XSokoban            |    71    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-ThinkingRabbit-XSokoban  |    80    ]]
+
-
|}
+
{| class="soko-table feature-list"
-
 
+
!Solver                                                                    || Version || Author                        || Architecture || CPU usage || Source code available || More info
-
{| class="soko-table"
+
|-
|-
-
 
+
|<span class="plainlinks">[https://festival-solver.site/ Festival]</span>                                   || 3.1    || Yaron Shoham || 64bit        || 8 threads    || <span class="plainlinks">[https://festival-solver.site/ Festival 3.1]</span>                || <span class="plainlinks">[https://festival-solver.site/ Website with papers about the solver]</span>  
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
! colspan="7" | Sokoban Solver Statistics - XSokoban Test Suite - Push-optimal Solutions
+
-
|- bgcolor="#f1efe5" align="center"
+
-
| width="115" align="left" | Collection
+
-
| width="160"              | Author
+
-
| width=" 70"              | Levels
+
-
| width=" 80"              | <span class="plainlinks">[https://www.researchgate.net/publication/2305703_Pushing_the_Limits_New_Developments_in_Single-Agent_Search Junghanns]</span>
+
-
| width=" 80"              | <span class="plainlinks">[http://www.ijcai.org/Abstract/16/100 Pereira et al.]</span>
+
-
| width=" 80"              | <span class="plainlinks">[http://sourceforge.net/projects/jsokoapplet/ JSoko]</span>
+
-
| width=" 80"              | <span class="plainlinks">[http://codeanalysis.fr/sokoban/ Sokolution ]</span>
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5" | XSokoban
+
-
| align="left"                  | Thinking Rabbit, ...
+
-
|               90
+
-
|                <span class="plainlinks">[https://webdocs.cs.ualberta.ca/~games/Sokoban/program.html 6 ]</span>
+
-
|               [[SolverStatistics-Pereira-ThinkingRabbit-XSokoban-Push-Optimal | 28 ]]
+
-
|               <span class="plainlinks">[https://www.sokoban-online.de/jsoko/solver-statistics/ 31 ]</span>
+
-
|                [[SolverStatistics-Sokolutionv3.01-ThinkingRabbit-XSokoban-Push-Optimal | '''38''' ]]
+
-
 
+
-
|}
+
-
 
+
-
== Large Test Suite ==
+
-
 
+
-
The large test suite comprises level packs selected for being a challenge for the solvers, but not too difficult. The statistics shows the results for the leading Sokoban solver programs.
+
-
 
+
-
{| class="soko-table"
+
|-
|-
-
! colspan="8" | Sokoban Solver Statistics - Large Test Suite - Solved Levels
+
|<span class="plainlinks">[http://sokolution.infinityfreeapp.com/ Sokolution]</span>                         || 6.33 || Florent Diedler               || 64bit        || all threads || no                   || <span class="plainlinks">[[Sokoban solver "scribbles" by Florent Diedler about the Sokolution solver | Sokoban solver "scribbles" by Florent Diedler]]</span>  
-
 
+
-
<!-- Header -->
+
-
|- bgcolor="#f1efe5" align="center"
+
-
| width="115" align="left" |      Collection
+
-
| width="160"  |                Author
+
-
| width=" 70"  |                Levels
+
-
| width=" 80"  |                BoxSearch
+
-
| width= "80"  | <span class="plainlinks">[http://www.ic-net.or.jp/home/takaken/e/soko/index.html                Takaken]</span>
+
-
| width=" 80"  | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span>
+
-
| width=" 80"  | [[JSoko Solver    | JSoko]]
+
-
| width=" 80"  | <span class="plainlinks">[http://codeanalysis.fr/sokoban/ Sokolution ]</span>
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Aymeric du Peloux. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution" -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"          | [[Solver Statistics - Aymeric | Aymeric]]
+
-
| align="left"                            | Aymeric du Peloux
+
-
|                                              282
+
-
|                                            '''282'''
+
-
| [[SolverStatistics-takaken-Aymeric      | '''282''' ]]
+
-
| [[SolverStatistics-yass-Aymeric          | '''282''' ]]
+
-
| [[SolverStatistics-jsoko-AymericduPeloux | '''282''' ]]
+
-
| [[SolverStatistics-sokolution-Aymeric    | '''282''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Grigr2001. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Grigr2001 - Evgeny Grigoriev| Grigr2001]]
+
-
| align="left"                                      | Evgeny Grigoriev
+
-
|                                                        100
+
-
|                                                        93
+
-
| [[SolverStatistics-takaken-Grigr2001              |    94    ]]
+
-
| [[SolverStatistics-yass-Grigr2001                  |    93    ]]
+
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2001 |    92    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Grigr2001      | '''95''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Grigr2002. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Grigr2002 - Evgeny Grigoriev| Grigr2002]]
+
-
| align="left"                                      | Evgeny Grigoriev
+
-
|                                                        40
+
-
|                                                        37
+
-
| [[SolverStatistics-takaken-Grigr2002              |    37    ]]
+
-
| [[SolverStatistics-yass-Grigr2002                  |    38    ]]
+
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2002 |    34    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Grigr2002      | '''40''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- GrigrSpecial. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                        | [[Solver Statistics - GrigrSpecial - Evgeny Grigoriev| GrigrSpecial]]
+
-
| align="left"                                          | Evgeny Grigoriev
+
-
|                                                            40
+
-
|                                                            39
+
-
| [[SolverStatistics-takaken-GrigrSpecial              | '''40''' ]]
+
-
| [[SolverStatistics-yass-GrigrSpecial                  | '''40''' ]]
+
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-GrigrSpecial |    39    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-GrigrSpecial      | '''40''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Holland. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"            | [[Solver Statistics - David Holland| Holland]]
+
-
| align="left"                              | David Holland
+
-
|                                                81
+
-
|                                                56
+
-
| [[SolverStatistics-takaken-Holland        | '''65''' ]]
+
-
| [[SolverStatistics-yass-Holland            |    59    ]]
+
-
| [[SolverStatistics-David Holland-Holland  |    55    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Holland | '''65''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Microban. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                  | [[Solver Statistics - Microban - David W. Skinner| Microban]]
+
-
| align="left"                                    | David W. Skinner
+
-
|                                                      155
+
-
|                                                  '''155'''
+
-
| [[SolverStatistics-takaken-Microban            | '''155''' ]]
+
-
| [[SolverStatistics-yass-Microban               | '''155''' ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-Microban | '''155''' ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Microban    | '''155''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Microban II. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Microban II - David W. Skinner| Microban II]]
+
-
| align="left"                                      | David W. Skinner
+
-
|                                                        135
+
-
|                                                        134
+
-
| [[SolverStatistics-takaken-Microban-II            |    134    ]]
+
-
| [[SolverStatistics-yass-Microban-II                | '''135''' ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-MasMicroban | '''135''' ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Microban-II    |    132    ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Sasquatch. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                   | [[Solver Statistics - Sasquatch - David W. Skinner| Sasquatch]]
+
-
| align="left"                                    | David W. Skinner
+
-
|                                                      50
+
-
|                                                      22
+
-
| [[SolverStatistics-takaken-Sasquatch            | '''36''' ]]
+
-
| [[SolverStatistics-yass-Sasquatch                |    26    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-Sasquatch |    28    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch    | '''36''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Sasquatch II. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                      | [[Solver Statistics - Sasquatch II - David W. Skinner| Sasquatch II]]
+
-
| align="left"                                        | David W. Skinner
+
-
|                                                          50
+
-
|                                                          16
+
-
| [[SolverStatistics-takaken-Sasquatch-II            | '''33''' ]]
+
-
| [[SolverStatistics-yass-Sasquatch-II                |    20    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-MasSasquatch |    18    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-II    |    32    ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Sasquatch III. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                      | [[Solver Statistics - Sasquatch III - David W. Skinner| Sasquatch III]]
+
-
| align="left"                                       | David W. Skinner
+
-
|                                                          50
+
-
|                                                          14
+
-
| [[SolverStatistics-takaken-Sasquatch-III            |    22    ]]
+
-
| [[SolverStatistics-yass-Sasquatch-III              |    13    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchIII |    12    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-III    | '''25''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Sasquatch IV. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch IV - David W. Skinner| Sasquatch IV]]
+
-
| align="left"                                      | David W. Skinner
+
-
|                                                        50
+
-
|                                                        27
+
-
| [[SolverStatistics-takaken-Sasquatch-IV            | '''37''' ]]
+
-
| [[SolverStatistics-yass-Sasquatch-IV              |    30    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchIV |    25    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-IV    |    35    ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Sasquatch V. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch V - David W. Skinner| Sasquatch V]]
+
-
| align="left"                                      | David W. Skinner
+
-
|                                                        50
+
-
|                                                        30
+
-
| [[SolverStatistics-takaken-Sasquatch-V            |    36    ]]
+
-
| [[SolverStatistics-yass-Sasquatch-V              |    29    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchV |    25    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-V    | '''37''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Sasquatch VI. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch VI - David W. Skinner| Sasquatch VI]]
+
-
| align="left"                                      | David W. Skinner
+
-
|                                                        50
+
-
|                                                        30
+
-
| [[SolverStatistics-takaken-Sasquatch-VI            |    32    ]]
+
-
| [[SolverStatistics-yass-Sasquatch-VI              |    25    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchVI |    26    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-VI    | '''38''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Sasquatch VII. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                      | [[Solver Statistics - Sasquatch VII - David W. Skinner| Sasquatch VII]]
+
-
| align="left"                                        | David W. Skinner
+
-
|                                                          50
+
-
|                                                          30
+
-
| [[SolverStatistics-takaken-Sasquatch-VII            |    31    ]]
+
-
| [[SolverStatistics-yass-Sasquatch-VII              |    26    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchVII |    25    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-VII    | '''40''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- SokEvo. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"            -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"      | [[Solver Statistics - SokEvo - Lee J Haywood | SokEvo]]
+
-
| align="left"                        | Lee J Haywood
+
-
|                                          107
+
-
|                                        '''107'''
+
-
| [[SolverStatistics-takaken-SokEvo    | '''107''' ]]
+
-
| [[SolverStatistics-yass-SokEvo      | '''107''' ]]
+
-
|                                        '''107'''
+
-
| [[SolverStatistics-sokolution-SokEvo | '''107''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- SokHard. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"              | [[Solver Statistics - Lee J Haywood | SokHard ]]
+
-
| align="left"                                | Lee J Haywood
+
-
|                                                  163
+
-
|                                                '''163'''
+
-
| [[SolverStatistics-takaken-SokHard          | '''163''' ]]
+
-
| [[SolverStatistics-yass-SokHard              | '''163''' ]]
+
-
| [[SolverStatistics-jsoko-LeeJHaywood-SokHard |    158    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-SokHard  | '''163''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Sven. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"              -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"              | [[Solver Statistics - Sven Egevad | Sven ]]
+
-
| align="left"                                | Sven Egevad
+
-
|                                                  1623
+
-
|                                                  1170
+
-
| [[SolverStatistics-takaken-SvenEgevad        |    1384  ]]
+
-
| [[SolverStatistics-yass-SvenEgevad          |    1251  ]]
+
-
| [[SolverStatistics-jsoko-SvenEgevad-Sven    |    1180  ]]
+
-
| [[SolverStatistics-sokolutionv3.1-SvenEgevad | '''1432''']]
+
-
 
+
-
<!-- ---------------------------------------------------------------------------------------------- -->
+
-
<!-- XSokoban. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"            -->
+
-
<!-- ---------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5" | [[Solver Statistics - XSokoban - Thinking Rabbit & Various Authors| XSokoban ]]
+
-
| align="left"                                                | Thinking Rabbit, ...
+
-
|                                                                  90
+
-
|                                                                  42
+
-
| [[SolverStatistics-takaken-ThinkingRabbit-XSokoban          | '''86''' ]]
+
-
| [[SolverStatistics-yass-ThinkingRabbit-XSokoban            |    84    ]]
+
-
| [[SolverStatistics-jsoko-ThinkingRabbit-XSokoban            |    71    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-ThinkingRabbit-XSokoban  |    80    ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Y.M. Auto. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                              | [[Solver Statistics - Y.M. Auto - Yoshio Murase| Y.M. Auto ]]
+
-
| align="left"                                                | Yoshio Murase
+
-
|                                                                  52
+
-
|                                                                '''52'''
+
-
| [[SolverStatistics-takaken-YoshioMuraseAutogenerated        | '''52''' ]]
+
-
| [[SolverStatistics-yass-YoshioMuraseAutogenerated            | '''52''' ]]
+
-
|                                                                '''52'''
+
-
| [[SolverStatistics-sokolutionv3.01-YoshioMuraseAutogenerated | '''52''' ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Y.M. Handmade. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                          | [[Solver Statistics - Y.M. Handmade - Yoshio Murase| Y.M. Handmade ]]
+
-
| align="left"                                            | Yoshio Murase
+
-
|                                                              54
+
-
|                                                          '''54'''
+
-
| [[SolverStatistics-takaken-YoshioMuraseHandmade        | '''54''' ]]
+
-
| [[SolverStatistics-yass-YoshioMuraseHandmade            |    52    ]]
+
-
| [[SolverStatistics-jsoko-YoshioMurase-Handmade          |    52    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-YoshioMuraseHandmade |    53    ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------------------- -->
+
-
<!-- Total solved levels by solver. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution" -->
+
-
<!-- -------------------------------------------------------------------------------------------------------- -->
+
-
|- bgcolor="#f1efe5" align="right"
+
-
| align="left" | Total
+
-
|
+
-
|    3272      <!-- Total levels -->
+
-
|    2553      <!-- BoxSearch    -->
+
-
|    2880      <!-- Takaken      -->
+
-
|    2680      <!-- YASS        -->
+
-
|    2571      <!-- JSoko        -->
+
-
| '''2939'''  <!-- Sokolution  -->
+
-
 
+
-
|}
+
-
 
+
-
== GroupEffort Test Suite ==
+
-
 
+
-
The reason for benchmarking the GroupEffort test suite is to show the limited veracity of the statement made in section "6 Conclusion" of the thesis, where the author writes that the GroupEffort solver "outperforms existing solvers".
+
-
 
+
-
The benchmarks show that this was only true for the cherry-picked small test set at the time the thesis was published, never for the presumably more representative large test set.
+
-
 
+
-
{| class="soko-table"
+
|-
|-
-
! colspan="7" | Sokoban Solver Statistics - GroupEffort Test Suite - Solved Levels
+
|<span class="plainlinks">[https://computerpuzzle.net/english/sokoban/ver740/index.html Takaken]</span>     || 7.4    || Ken'ichiro Takahashi (takaken) || 64bit        || 2 threads || no                  || <span class="plainlinks">[https://computerpuzzle.net/puzzle/sokoban/ver731/index.html Description of the used algorithms]</span>
-
 
+
|-
-
<!-- -------------------------------------------------------------------------------------------- -->
+
|<span class="plainlinks">[https://festival-solver.site/curry/ Curry]</span>                                || 0.3    || Yaron Shoham                  || 64bit        || 1 thread  || <span class="plainlinks">[https://festival-solver.site/curry/ Curry 0.3] || <span class="plainlinks">[https://festival-solver.site/curry/ Website with paper about the solver]</span>
-
<!-- The header                                                                                  -->
+
|-
-
<!-- -------------------------------------------------------------------------------------------- -->
+
|<span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/files/sokobanyasc/ YASS]</span>     || 2.151  || Brian Damgaard                || 32bit        || 1 thread  || <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/files/sokobanyasc/ YASS 2.151]</span>  || <span class="plainlinks">[[Sokoban solver "scribbles" by Brian Damgaard about the YASS solver | Sokoban solver "scribbles" by Brian Damgaard]]</span>  
-
|- bgcolor="#f1efe5" align="center"                <!-- standard format of all rows -->
+
|-
-
| width = "115" align="left" | Collection
+
|<span class="plainlinks">[https://www.sokoban-online.de/ JSoko]</span>                                    || 2.04    || Matthias Meger                || 64bit        || 1 thread  || <span class="plainlinks">[https://sourceforge.net/projects/jsokoapplet/files/JSoko/Version%202.03/ JSoko 2.04]</span>  || [[Solver | Solver information]]
-
| width =  "80" |                                                         Levels
+
|-
-
| width = "80" | [https://baldur.iti.kit.edu/theses/SokobanPortfolio.pdf GroupEffort]
+
|<span class="plainlinks">[https://webdocs.cs.ualberta.ca/~games/Sokoban/program.html Rolling Stone]</span> || 1.0    || Andreas Junghanns              || 32bit        || 1 thread  || <span class="plainlinks">[https://webdocs.cs.ualberta.ca/~games/Sokoban/Src/ RS] || <span class="plainlinks">[https://scholar.google.com/scholar?hl=de&as_sdt=0%2C5&q=rolling+stone+sokoban&btnG= Rolling Stone papers]</span>  
-
| width = "80" | [http://codeanalysis.fr/sokoban/                       Sokolution]  
+
-
| width = "80" | [http://www.ic-net.or.jp/home/takaken/e/soko/index.html Takaken]  
+
-
| width = "80" | [https://sourceforge.net/projects/jsokoapplet/         JSoko]
+
-
| width = "80" | [https://sourceforge.net/projects/sokobanyasc/         YASS]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Small Set                                                                                    -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5" | [[SolverStatistics-GroupEffort-Small-Set | Small Set]]
+
-
| 200
+
-
| 196 (a)(c)
+
-
| [[SolverStatistics-Sokolution-GroupEffort-Small-Set | '''200''' (a) ]]
+
-
| [[SolverStatistics-Takaken-GroupEffort-Small-Set    |    192 (b)    ]]
+
-
| [[SolverStatistics-JSoko-GroupEffort-Small-Set      |    180 (b)    ]]
+
-
| [[SolverStatistics-YASS-GroupEffort-Small-Set      |   191 (b)    ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Large Set                                                                                    -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"| [[SolverStatistics-GroupEffort-Large-Set | Large Set]]
+
-
| 2851
+
-
| 1566 (a)(c)
+
-
| [[SolverStatistics-Sokolution-GroupEffort-Large-Set | '''2471''' (a) ]]
+
-
| [[SolverStatistics-Takaken-GroupEffort-Large-Set    |   2462 (b)    ]]
+
-
| [[SolverStatistics-JSoko-GroupEffort-Large-Set      |    2165 (b)    ]]
+
-
| [[SolverStatistics-YASS-GroupEffort-Large-Set      |   2260 (b)    ]]
+
-
 
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
<!-- Total                                                                                        -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right" bgcolor="#f1efe5" align="right"
+
-
| align="left"| Total
+
-
|   3051      <!-- Total levels -->
+
-
|   1762      <!-- Group Effort -->
+
-
| '''2671'''  <!-- Sokolution  -->
+
-
|   2654      <!-- Takaken      -->
+
-
|   2345      <!-- JSoko        -->
+
-
|    2471      <!-- YASS        -->  
+
-
 
+
|}
|}
-
(a): Time limit: 5 minutes &nbsp;&nbsp;&nbsp;  (b): Time limit: 10 minutes &nbsp;&nbsp;&nbsp;  (c): Best GroupEffort solver configuration
+
Contact: SokobanoWiki@gmail.com
-
 
+
-
Sokoban solvers are programs that solve sokoban levels. There are many programs available that can solve Sokoban levels (see [[Links#Sokoban Solvers |Sokoban solvers]]).
+
-
 
+
-
There are different solver types:
+
-
# Solvers which just try to find any solution
+
-
# Solvers which try to find push optimal solutions
+
-
# Solvers which try to find push optimal solutions with best moves
+
-
# Solvers which try to find move optimal solutions
+
-
# Solvers which try to find move optimal solutions with best pushes
+
-
 
+
-
Usually a solver is designed to just find any solution. If the solution is to be optimized an optimizer program can be used ([[Links#Sokoban Solvers |Optimizers]]).
+
-
 
+
-
To get an impression of what levels are solvable by which solver here are some statistics.<br />
+
-
For copyrights, credits and redistribution of these statistics, please read the disclaimer.
+
== XSokoban Test Suite ==
== XSokoban Test Suite ==
Line 451: Line 48:
{| class="soko-table"
{| class="soko-table"
|-
|-
-
! colspan="9" | Sokoban Solver Statistics - XSokoban Test Suite - Solved Levels
+
! colspan="11" | Sokoban Solver Statistics - XSokoban Test Suite - Solved Levels
<!-- Header -->
<!-- Header -->
Line 458: Line 55:
| width="160"  |                Author
| width="160"  |                Author
| width=" 70"  |                Levels
| width=" 70"  |                Levels
-
| width= "80"  | <span class="plainlinks">[https://www.researchgate.net/publication/2305703_Pushing_the_Limits_New_Developments_in_Single-Agent_Search Junghanns]</span>
+
| width= "90"  | <span class="plainlinks">[https://www.researchgate.net/publication/2305703_Pushing_the_Limits_New_Developments_in_Single-Agent_Search Rolling Stone]</span>
-
| width=" 80"  |                BoxSearch
+
| width= "80"  | <span class="plainlinks">[https://computerpuzzle.net/english/sokoban/ver740/index.html                Takaken]</span>
-
| width= "80"  | <span class="plainlinks">[http://www.ic-net.or.jp/home/takaken/e/soko/index.html                Takaken]</span>
+
| width=" 80"  | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span>
| width=" 80"  | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span>
| width=" 80"  | [[JSoko Solver    | JSoko]]
| width=" 80"  | [[JSoko Solver    | JSoko]]
-
| width=" 80"  | <span class="plainlinks">[http://codeanalysis.fr/sokoban/ Sokolution ]</span>
+
| width=" 80"  | <span class="plainlinks">[http://sokolution.infinityfreeapp.com/ Sokolution ]</span>
 +
| width=" 80"  | <span class="plainlinks">[https://festival-solver.site/curry/ Curry ]</span>
 +
| width=" 80"  | <span class="plainlinks">[https://festival-solver.site/ Festival ]</span>
-
<!-- ---------------------------------------------------------------------------------------------- -->
+
<!-- -------------------------------------------------------------------------------------------------------- -->
-
<!-- XSokoban. "Collection, author, levels, Junghanns, BoxSearch, Takaken, YASS, JSoko, Sokolution" -->
+
<!-- XSokoban. "Collection, author, levels, Rolling Stone, Takaken, YASS, JSoko, Sokolution, Festival" -->
-
<!-- ---------------------------------------------------------------------------------------------- -->
+
<!-- -------------------------------------------------------------------------------------------------------- -->
|- align="right"
|- align="right"
-
| align="left" bgcolor="#f1efe5" | [[Solver Statistics - XSokoban - Thinking Rabbit & Various Authors| XSokoban ]]
+
| align="left" bgcolor="#f1efe5" | <span class="plainlinks">[https://sokoban-solver-statistics.sourceforge.io/statistics/XSokoban/ XSokoban]</span>
| align="left"                                                | Thinking Rabbit, ...
| align="left"                                                | Thinking Rabbit, ...
|                                                                  90
|                                                                  90
-
| <span class="plainlinks">[https://webdocs.cs.ualberta.ca/~games/Sokoban/program.html 54]</span>
+
| <span class="plainlinks">[https://webdocs.cs.ualberta.ca/~games/Sokoban/program.html 59*]</span>
-
|                                                                 42
+
| <span class="plainlinks">[https://sokoban-solver-statistics.sourceforge.io/statistics/XSokoban/Takaken%20-%20XSokoban.html '''90''']</span>
-
| [[SolverStatistics-takaken-ThinkingRabbit-XSokoban         | '''86''' ]]
+
| <span class="plainlinks">[https://sokoban-solver-statistics.sourceforge.io/statistics/XSokoban/YASS%20-%20XSokoban.html 89]</span>
-
| [[SolverStatistics-yass-ThinkingRabbit-XSokoban             |    84    ]]
+
| [[SolverStatistics-jsoko-ThinkingRabbit-XSokoban            |    67   ]]
-
| [[SolverStatistics-jsoko-ThinkingRabbit-XSokoban            |    71   ]]
+
| <span class="plainlinks">[https://sokoban-solver-statistics.sourceforge.io/statistics/XSokoban/Sokolution%20-%20XSokoban.html '''90''']</span>
-
| [[SolverStatistics-sokolutionv3.01-ThinkingRabbit-XSokoban |   80    ]]
+
| <span class="plainlinks">[https://sokoban-solver-statistics.sourceforge.io/statistics/XSokoban/Curry%20-%20XSokoban.html '''90''']</span>
 +
| <span class="plainlinks">[https://sokoban-solver-statistics.sourceforge.io/statistics/XSokoban/Festival%20-%20XSokoban.html '''90''']</span>
|}
|}
 +
 +
*) 59 solved puzzles according to paper [https://sokoban.dk/wp-content/uploads/2016/02/Single-Agent.pdf Sokoban Enhancing general single-agent search methods using domain knowledge]
{| class="soko-table"
{| class="soko-table"
Line 490: Line 91:
| width="160"              | Author
| width="160"              | Author
| width=" 70"              | Levels
| width=" 70"              | Levels
-
| width=" 80"              | <span class="plainlinks">[https://www.researchgate.net/publication/2305703_Pushing_the_Limits_New_Developments_in_Single-Agent_Search Junghanns]</span>
+
| width=" 80"              | <span class="plainlinks">[https://www.researchgate.net/publication/2305703_Pushing_the_Limits_New_Developments_in_Single-Agent_Search Rolling Stone]</span>
| width=" 80"              | <span class="plainlinks">[http://www.ijcai.org/Abstract/16/100 Pereira et al.]</span>
| width=" 80"              | <span class="plainlinks">[http://www.ijcai.org/Abstract/16/100 Pereira et al.]</span>
| width=" 80"              | <span class="plainlinks">[http://sourceforge.net/projects/jsokoapplet/ JSoko]</span>  
| width=" 80"              | <span class="plainlinks">[http://sourceforge.net/projects/jsokoapplet/ JSoko]</span>  
-
| width=" 80"              | <span class="plainlinks">[http://codeanalysis.fr/sokoban/ Sokolution ]</span>
+
| width=" 80"              | <span class="plainlinks">[http://sokolution.infinityfreeapp.com/ Sokolution ]</span>
<!-- -------------------------------------------------------------------------------------------- -->
<!-- -------------------------------------------------------------------------------------------- -->
Line 503: Line 104:
|                [[SolverStatistics-Pereira-ThinkingRabbit-XSokoban-Push-Optimal | 28 ]]
|                [[SolverStatistics-Pereira-ThinkingRabbit-XSokoban-Push-Optimal | 28 ]]
|                <span class="plainlinks">[https://www.sokoban-online.de/jsoko/solver-statistics/ 31 ]</span>
|                <span class="plainlinks">[https://www.sokoban-online.de/jsoko/solver-statistics/ 31 ]</span>
-
|                [[SolverStatistics-Sokolutionv3.01-ThinkingRabbit-XSokoban-Push-Optimal | '''38''' ]]
+
|                [[SolverStatistics-Sokolutionv4.0-ThinkingRabbit-XSokoban-Push-Optimal | '''59''' ]]
|}
|}
 +
 +
The statistic shows that Sokolution is by far the best solver when searching for push optimal solutions.
== Large Test Suite ==
== Large Test Suite ==
-
The large test suite comprises level packs selected for being a challenge for the solvers, but not too difficult. The statistics shows the results for the leading Sokoban solver programs.
+
The large test suite comprises level packs selected for being a challenge for the solvers, but not too difficult. The statistics shows the results for the leading Sokoban solver programs.
 +
 
 +
This test suite is not subject to change, as it is intended to be a "Large Standard Test Suite" for Sokoban solver programs.  
{| class="soko-table"
{| class="soko-table"
|-
|-
-
! colspan="8" | Sokoban Solver Statistics - Large Test Suite - Solved Levels
+
! colspan="6" | Sokoban Solver Statistics - Large Test Suite - Solved levels
<!-- Header -->
<!-- Header -->
|- bgcolor="#f1efe5" align="center"
|- bgcolor="#f1efe5" align="center"
-
| width="115" align="left" |     Collection
+
| width="115" align="left" |  
-
| width="160"  |                 Author
+
| width=" 70"  | Levels
-
| width=" 70"  |                 Levels
+
| width= "80"  | <span class="plainlinks">[https://festival-solver.site/ Festival ]</span>
-
| width=" 80"  |                 BoxSearch
+
| width=" 80"  | <span class="plainlinks">[http://sokolution.infinityfreeapp.com/ Sokolution]</span>
-
| width= "80"  | <span class="plainlinks">[http://www.ic-net.or.jp/home/takaken/e/soko/index.html                 Takaken]</span>
+
| width=" 80"  | <span class="plainlinks">[https://computerpuzzle.net/english/sokoban/ver740/index.html Takaken]</span>
| width=" 80"  | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span>
| width=" 80"  | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span>
-
| width=" 80"  | [[JSoko Solver    | JSoko]]
 
-
| width=" 80"  | <span class="plainlinks">[http://codeanalysis.fr/sokoban/ Sokolution ]</span>
 
-
<!-- -------------------------------------------------------------------------------------------- -->
+
|- bgcolor="#f1efe5" align="right"
-
<!-- Aymeric du Peloux. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution" -->
+
| align="left" | Total levels
-
<!-- -------------------------------------------------------------------------------------------- -->
+
|   3272      <!-- Total levels -->
-
|- align="right"
+
| '''3205'''   <!-- Festival    -->
-
| align="left" bgcolor="#f1efe5"          | [[Solver Statistics - Aymeric | Aymeric]]
+
|   3172      <!-- Sokolution  -->
-
| align="left"                             | Aymeric du Peloux
+
|   2953      <!-- Takaken      -->
-
|                                               282
+
|   2891      <!-- YASS        -->
-
|                                           '''282'''
+
-
| [[SolverStatistics-takaken-Aymeric      | '''282''' ]]
+
-
| [[SolverStatistics-yass-Aymeric          | '''282''' ]]
+
-
| [[SolverStatistics-jsoko-AymericduPeloux | '''282''' ]]
+
-
| [[SolverStatistics-sokolution-Aymeric    | '''282''' ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
|}
-
<!-- Grigr2001. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Grigr2001 - Evgeny Grigoriev| Grigr2001]]
+
-
| align="left"                                      | Evgeny Grigoriev
+
-
|                                                        100
+
-
|                                                        93
+
-
| [[SolverStatistics-takaken-Grigr2001              |    94    ]]
+
-
| [[SolverStatistics-yass-Grigr2001                  |    93    ]]
+
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2001 |    92    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Grigr2001      | '''95''' ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
'''[https://sokoban-solver-statistics.sourceforge.io/statistics/LargeTestSuite/ Click here to see the detailed results for the Large Test Suite].'''
-
<!-- Grigr2002. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Grigr2002 - Evgeny Grigoriev| Grigr2002]]
+
-
| align="left"                                      | Evgeny Grigoriev
+
-
|                                                        40
+
-
|                                                        37
+
-
| [[SolverStatistics-takaken-Grigr2002              |    37    ]]
+
-
| [[SolverStatistics-yass-Grigr2002                  |    38    ]]
+
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2002 |    34    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Grigr2002      | '''40''' ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
Download the entire test suite [https://sourceforge.net/projects/sokoban-solver-statistics/files/Large%20Test%20Suite.zip/download here] or the individual level sets from [http://sokobano.de/de/levels.php www.sokobano.de].
-
<!-- GrigrSpecial. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                        | [[Solver Statistics - GrigrSpecial - Evgeny Grigoriev| GrigrSpecial]]
+
-
| align="left"                                          | Evgeny Grigoriev
+
-
|                                                            40
+
-
|                                                            39
+
-
| [[SolverStatistics-takaken-GrigrSpecial              | '''40''' ]]
+
-
| [[SolverStatistics-yass-GrigrSpecial                  | '''40''' ]]
+
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-GrigrSpecial |    39    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-GrigrSpecial      | '''40''' ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
== Open Test Suite ==
-
<!-- Holland. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"            | [[Solver Statistics - David Holland| Holland]]
+
-
| align="left"                              | David Holland
+
-
|                                                81
+
-
|                                                56
+
-
| [[SolverStatistics-takaken-Holland        | '''65''' ]]
+
-
| [[SolverStatistics-yass-Holland            |    59    ]]
+
-
| [[SolverStatistics-David Holland-Holland  |    55    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Holland | '''65''' ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
The statistics shows the results for the leading Sokoban solvers for various level collections. Please note that the grand totals are simple summations. The number of solved unique levels may differ slightly due to duplicate levels in the level packs.
-
<!-- Microban. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                  | [[Solver Statistics - Microban - David W. Skinner| Microban]]
+
-
| align="left"                                    | David W. Skinner
+
-
|                                                      155
+
-
|                                                  '''155'''
+
-
| [[SolverStatistics-takaken-Microban            | '''155''' ]]
+
-
| [[SolverStatistics-yass-Microban                | '''155''' ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-Microban | '''155''' ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Microban    | '''155''' ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
This test suite may be changed by adding new level collections from time to time.  
-
<!-- Microban II. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Microban II - David W. Skinner| Microban II]]
+
-
| align="left"                                      | David W. Skinner
+
-
|                                                        135
+
-
|                                                        134
+
-
| [[SolverStatistics-takaken-Microban-II            |    134    ]]
+
-
| [[SolverStatistics-yass-Microban-II                | '''135''' ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-MasMicroban | '''135''' ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Microban-II    |    132    ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
{| class="soko-table"
-
<!-- Sasquatch. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
+
|-
-
<!-- -------------------------------------------------------------------------------------------- -->
+
! colspan="6" | Sokoban Solver Statistics - Open Test Suite - Solved levels
-
|- align="right"
+
-
| align="left" bgcolor="#f1efe5"                  | [[Solver Statistics - Sasquatch - David W. Skinner| Sasquatch]]
+
-
| align="left"                                    | David W. Skinner
+
-
|                                                      50
+
-
|                                                      22
+
-
| [[SolverStatistics-takaken-Sasquatch            | '''36''' ]]
+
-
| [[SolverStatistics-yass-Sasquatch                |    26    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-Sasquatch |    28    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch    | '''36''' ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
+
<!-- Header -->
-
<!-- Sasquatch II. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"     -->
+
|- bgcolor="#f1efe5" align="center"
-
<!-- -------------------------------------------------------------------------------------------- -->
+
| width="115" align="left" |  
-
|- align="right"
+
| width=" 70"   | Levels
-
| align="left" bgcolor="#f1efe5"                     | [[Solver Statistics - Sasquatch II - David W. Skinner| Sasquatch II]]
+
| width= "80"  | <span class="plainlinks">[https://festival-solver.site/ Festival]</span>
-
| align="left"                                       | David W. Skinner
+
| width=" 80"  | <span class="plainlinks">[http://sokolution.infinityfreeapp.com/ Sokolution]</span>
-
|                                                         50
+
| width=" 80"  | <span class="plainlinks">[https://computerpuzzle.net/english/sokoban/ver740/index.html Takaken]</span>
-
|                                                          16
+
| width=" 80"  | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span>
-
| [[SolverStatistics-takaken-Sasquatch-II            | '''33''' ]]
+
-
| [[SolverStatistics-yass-Sasquatch-II                |   20    ]]
+
-
| [[SolverStatistics-jsoko-DavidWSkinner-MasSasquatch |    18    ]]
+
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-II    |    32    ]]
+
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch III. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                      | [[Solver Statistics - Sasquatch III - David W. Skinner| Sasquatch III]]
 
-
| align="left"                                        | David W. Skinner
 
-
|                                                          50
 
-
|                                                          14
 
-
| [[SolverStatistics-takaken-Sasquatch-III            |    22    ]]
 
-
| [[SolverStatistics-yass-Sasquatch-III              |    13    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchIII |    12    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-III    | '''25''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch IV. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch IV - David W. Skinner| Sasquatch IV]]
 
-
| align="left"                                      | David W. Skinner
 
-
|                                                        50
 
-
|                                                        27
 
-
| [[SolverStatistics-takaken-Sasquatch-IV            | '''37''' ]]
 
-
| [[SolverStatistics-yass-Sasquatch-IV              |    30    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchIV |    25    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-IV    |    35    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch V. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch V - David W. Skinner| Sasquatch V]]
 
-
| align="left"                                      | David W. Skinner
 
-
|                                                        50
 
-
|                                                        30
 
-
| [[SolverStatistics-takaken-Sasquatch-V            |    36    ]]
 
-
| [[SolverStatistics-yass-Sasquatch-V              |    29    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchV |    25    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-V    | '''37''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch VI. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch VI - David W. Skinner| Sasquatch VI]]
 
-
| align="left"                                      | David W. Skinner
 
-
|                                                        50
 
-
|                                                        30
 
-
| [[SolverStatistics-takaken-Sasquatch-VI            |    32    ]]
 
-
| [[SolverStatistics-yass-Sasquatch-VI              |    25    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchVI |    26    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-VI    | '''38''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch VII. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                      | [[Solver Statistics - Sasquatch VII - David W. Skinner| Sasquatch VII]]
 
-
| align="left"                                        | David W. Skinner
 
-
|                                                          50
 
-
|                                                          30
 
-
| [[SolverStatistics-takaken-Sasquatch-VII            |    31    ]]
 
-
| [[SolverStatistics-yass-Sasquatch-VII              |    26    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchVII |    25    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-VII    | '''40''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- SokEvo. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"            -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"      | [[Solver Statistics - SokEvo - Lee J Haywood | SokEvo]]
 
-
| align="left"                        | Lee J Haywood
 
-
|                                          107
 
-
|                                        '''107'''
 
-
| [[SolverStatistics-takaken-SokEvo    | '''107''' ]]
 
-
| [[SolverStatistics-yass-SokEvo      | '''107''' ]]
 
-
|                                        '''107'''
 
-
| [[SolverStatistics-sokolution-SokEvo | '''107''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- SokHard. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"              | [[Solver Statistics - Lee J Haywood | SokHard ]]
 
-
| align="left"                                | Lee J Haywood
 
-
|                                                  163
 
-
|                                                '''163'''
 
-
| [[SolverStatistics-takaken-SokHard          | '''163''' ]]
 
-
| [[SolverStatistics-yass-SokHard              | '''163''' ]]
 
-
| [[SolverStatistics-jsoko-LeeJHaywood-SokHard |    158    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-SokHard  | '''163''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sven. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"              -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"              | [[Solver Statistics - Sven Egevad | Sven ]]
 
-
| align="left"                                | Sven Egevad
 
-
|                                                  1623
 
-
|                                                  1170
 
-
| [[SolverStatistics-takaken-SvenEgevad        |    1384  ]]
 
-
| [[SolverStatistics-yass-SvenEgevad          |    1251  ]]
 
-
| [[SolverStatistics-jsoko-SvenEgevad-Sven    |    1180  ]]
 
-
| [[SolverStatistics-sokolutionv3.1-SvenEgevad | '''1432''']]
 
-
 
-
<!-- ---------------------------------------------------------------------------------------------- -->
 
-
<!-- XSokoban. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"            -->
 
-
<!-- ---------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5" | [[Solver Statistics - XSokoban - Thinking Rabbit & Various Authors| XSokoban ]]
 
-
| align="left"                                                | Thinking Rabbit, ...
 
-
|                                                                  90
 
-
|                                                                  42
 
-
| [[SolverStatistics-takaken-ThinkingRabbit-XSokoban          | '''86''' ]]
 
-
| [[SolverStatistics-yass-ThinkingRabbit-XSokoban            |    84    ]]
 
-
| [[SolverStatistics-jsoko-ThinkingRabbit-XSokoban            |    71    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-ThinkingRabbit-XSokoban  |    80    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Y.M. Auto. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                              | [[Solver Statistics - Y.M. Auto - Yoshio Murase| Y.M. Auto ]]
 
-
| align="left"                                                | Yoshio Murase
 
-
|                                                                  52
 
-
|                                                                '''52'''
 
-
| [[SolverStatistics-takaken-YoshioMuraseAutogenerated        | '''52''' ]]
 
-
| [[SolverStatistics-yass-YoshioMuraseAutogenerated            | '''52''' ]]
 
-
|                                                                '''52'''
 
-
| [[SolverStatistics-sokolutionv3.01-YoshioMuraseAutogenerated | '''52''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Y.M. Handmade. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                          | [[Solver Statistics - Y.M. Handmade - Yoshio Murase| Y.M. Handmade ]]
 
-
| align="left"                                            | Yoshio Murase
 
-
|                                                              54
 
-
|                                                          '''54'''
 
-
| [[SolverStatistics-takaken-YoshioMuraseHandmade        | '''54''' ]]
 
-
| [[SolverStatistics-yass-YoshioMuraseHandmade            |    52    ]]
 
-
| [[SolverStatistics-jsoko-YoshioMurase-Handmade          |    52    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-YoshioMuraseHandmade |    53    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------------------- -->
 
-
<!-- Total solved levels by solver. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution" -->
 
-
<!-- -------------------------------------------------------------------------------------------------------- -->
 
|- bgcolor="#f1efe5" align="right"
|- bgcolor="#f1efe5" align="right"
-
| align="left" | Total
+
| align="left" | Total levels
-
|
+
|   10773     <!-- Total levels -->
-
|    3272     <!-- Total levels -->
+
| '''9950'''  <!-- Festival    -->
-
|   2553      <!-- BoxSearch    -->
+
|    9694     <!-- Sokolution  -->
-
|    2880     <!-- Takaken      -->
+
|    8919     <!-- Takaken      -->
-
|    2680     <!-- YASS        -->
+
|    8485     <!-- YASS        -->
-
|    2571     <!-- JSoko        -->
+
-
| '''2939'''  <!-- Sokolution  -->
+
|}
|}
 +
 +
'''[https://sokoban-solver-statistics.sourceforge.io/statistics/OpenTestSuite/ Click here to see the detailed results for the Open Test Suite].'''
== GroupEffort Test Suite ==
== GroupEffort Test Suite ==
-
The reason for benchmarking the GroupEffort test suite is to show the limited veracity of the statement made in section "6 Conclusion" of the thesis, where the author writes that the GroupEffort solver "outperforms existing solvers".  
+
The only reason for benchmarking the GroupEffort test suite is to demonstrate the limited veracity of the statement made in section "6 Conclusion" of the thesis, where the author writes that the GroupEffort solver "outperforms existing solvers".  
The benchmarks show that this was only true for the cherry-picked small test set at the time the thesis was published, never for the presumably more representative large test set.  
The benchmarks show that this was only true for the cherry-picked small test set at the time the thesis was published, never for the presumably more representative large test set.  
Line 809: Line 182:
{| class="soko-table"
{| class="soko-table"
|-
|-
-
! colspan="7" | Sokoban Solver Statistics - GroupEffort Test Suite - Solved Levels
+
! colspan="8" | Sokoban Solver Statistics - GroupEffort Test Suite - Solved Levels
<!-- -------------------------------------------------------------------------------------------- -->
<!-- -------------------------------------------------------------------------------------------- -->
Line 817: Line 190:
| width = "115" align="left" | Collection
| width = "115" align="left" | Collection
| width =  "80" |                                                        Levels
| width =  "80" |                                                        Levels
-
| width =  "80" | [https://baldur.iti.kit.edu/theses/SokobanPortfolio.pdf GroupEffort]
+
| width =  "80" | <span class="plainlinks">[https://baldur.iti.kit.edu/theses/SokobanPortfolio.pdf GroupEffort]</span>
-
| width =  "80" | [http://codeanalysis.fr/sokoban/                       Sokolution]  
+
| width =  "80" | <span class="plainlinks">[https://festival-solver.site/                         Festival]</span>
-
| width =  "80" | [http://www.ic-net.or.jp/home/takaken/e/soko/index.html Takaken]  
+
| width =  "80" | <span class="plainlinks">[http://sokolution.infinityfreeapp.com/                  Sokolution]</span>
-
| width =  "80" | [https://sourceforge.net/projects/jsokoapplet/          JSoko]
+
| width =  "80" | <span class="plainlinks">[http://www.ic-net.or.jp/home/takaken/e/soko/index.html Takaken]</span>
-
| width =  "80" | [https://sourceforge.net/projects/sokobanyasc/          YASS]
+
| width =  "80" | <span class="plainlinks">[https://sourceforge.net/projects/jsokoapplet/          JSoko]</span>
 +
| width =  "80" | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/          YASS]</span>
<!-- -------------------------------------------------------------------------------------------- -->
<!-- -------------------------------------------------------------------------------------------- -->
Line 830: Line 204:
| 200
| 200
| 196 (a)(c)  
| 196 (a)(c)  
 +
| [[SolverStatistics-Festival-GroupEffort-Small-Set  | '''200''' (b) ]]
| [[SolverStatistics-Sokolution-GroupEffort-Small-Set | '''200''' (a) ]]
| [[SolverStatistics-Sokolution-GroupEffort-Small-Set | '''200''' (a) ]]
| [[SolverStatistics-Takaken-GroupEffort-Small-Set    |    192 (b)    ]]  
| [[SolverStatistics-Takaken-GroupEffort-Small-Set    |    192 (b)    ]]  
Line 842: Line 217:
| 2851
| 2851
| 1566 (a)(c)
| 1566 (a)(c)
-
| [[SolverStatistics-Sokolution-GroupEffort-Large-Set | '''2471''' (a) ]]
+
| [[SolverStatistics-Festival-GroupEffort-Large-Set   | '''2766''' (b) ]]
 +
| [[SolverStatistics-Sokolution-GroupEffort-Large-Set |    2471 (a)   ]]
| [[SolverStatistics-Takaken-GroupEffort-Large-Set    |    2462 (b)    ]]
| [[SolverStatistics-Takaken-GroupEffort-Large-Set    |    2462 (b)    ]]
| [[SolverStatistics-JSoko-GroupEffort-Large-Set      |    2165 (b)    ]]  
| [[SolverStatistics-JSoko-GroupEffort-Large-Set      |    2165 (b)    ]]  
Line 854: Line 230:
|    3051      <!-- Total levels -->
|    3051      <!-- Total levels -->
|    1762      <!-- Group Effort -->
|    1762      <!-- Group Effort -->
-
| '''2671'''  <!-- Sokolution  -->
+
| '''2966'''  <!-- Festival    -->
 +
|    2671      <!-- Sokolution  -->
|    2654      <!-- Takaken      -->
|    2654      <!-- Takaken      -->
|    2345      <!-- JSoko        -->
|    2345      <!-- JSoko        -->
|    2471      <!-- YASS        -->  
|    2471      <!-- YASS        -->  
-
 
|}
|}
(a): Time limit: 5 minutes &nbsp;&nbsp;&nbsp;  (b): Time limit: 10 minutes &nbsp;&nbsp;&nbsp;  (c): Best GroupEffort solver configuration
(a): Time limit: 5 minutes &nbsp;&nbsp;&nbsp;  (b): Time limit: 10 minutes &nbsp;&nbsp;&nbsp;  (c): Best GroupEffort solver configuration
-
 
-
== Solver Statistics ==
 
-
 
-
The statistics shows the results for the leading Sokoban solvers for various level packs. Please note that the grand totals are simple summations. The number of solved unique levels may differ slightly due to duplicate levels in the level packs.
 
-
 
-
{| class="soko-table"
 
-
|-
 
-
! colspan="8" | Sokoban Solver Statistics - Solved Levels
 
-
 
-
<!-- Header -->
 
-
|- bgcolor="#f1efe5" align="center"
 
-
| width="115" align="left" |      Collection
 
-
| width="160"  |                Author
 
-
| width=" 70"  |                Levels
 
-
| width=" 80"  |                BoxSearch
 
-
| width= "80"  | <span class="plainlinks">[http://www.ic-net.or.jp/home/takaken/e/soko/index.html                Takaken]</span>
 
-
| width=" 80"  | <span class="plainlinks">[https://sourceforge.net/projects/sokobanyasc/ YASS]</span>
 
-
| width=" 80"  | [[JSoko Solver    | JSoko]]
 
-
| width=" 80"  | <span class="plainlinks">[http://codeanalysis.fr/sokoban/ Sokolution ]</span>
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Aymeric du Peloux. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution" -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"          | [[Solver Statistics - Aymeric | Aymeric]]
 
-
| align="left"                            | Aymeric du Peloux
 
-
|                                              282
 
-
|                                            '''282'''
 
-
| [[SolverStatistics-takaken-Aymeric      | '''282''' ]]
 
-
| [[SolverStatistics-yass-Aymeric          | '''282''' ]]
 
-
| [[SolverStatistics-jsoko-AymericduPeloux | '''282''' ]]
 
-
| [[SolverStatistics-sokolution-Aymeric    | '''282''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Grigr2001. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Grigr2001 - Evgeny Grigoriev| Grigr2001]]
 
-
| align="left"                                      | Evgeny Grigoriev
 
-
|                                                        100
 
-
|                                                        93
 
-
| [[SolverStatistics-takaken-Grigr2001              |    94    ]]
 
-
| [[SolverStatistics-yass-Grigr2001                  |    93    ]]
 
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2001 |    92    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Grigr2001      | '''95''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Grigr2002. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Grigr2002 - Evgeny Grigoriev| Grigr2002]]
 
-
| align="left"                                      | Evgeny Grigoriev
 
-
|                                                        40
 
-
|                                                        37
 
-
| [[SolverStatistics-takaken-Grigr2002              |    37    ]]
 
-
| [[SolverStatistics-yass-Grigr2002                  |    38    ]]
 
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-Grigr2002 |    34    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Grigr2002      | '''40''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- GrigrSpecial. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                        | [[Solver Statistics - GrigrSpecial - Evgeny Grigoriev| GrigrSpecial]]
 
-
| align="left"                                          | Evgeny Grigoriev
 
-
|                                                            40
 
-
|                                                            39
 
-
| [[SolverStatistics-takaken-GrigrSpecial              | '''40''' ]]
 
-
| [[SolverStatistics-yass-GrigrSpecial                  | '''40''' ]]
 
-
| [[SolverStatistics-jsoko-EvgenyGrigoriev-GrigrSpecial |    39    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-GrigrSpecial      | '''40''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Holland. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"            | [[Solver Statistics - David Holland| Holland]]
 
-
| align="left"                              | David Holland
 
-
|                                                81
 
-
|                                                56
 
-
| [[SolverStatistics-takaken-Holland        | '''65''' ]]
 
-
| [[SolverStatistics-yass-Holland            |    59    ]]
 
-
| [[SolverStatistics-David Holland-Holland  |    55    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Holland | '''65''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Microban. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                  | [[Solver Statistics - Microban - David W. Skinner| Microban]]
 
-
| align="left"                                    | David W. Skinner
 
-
|                                                      155
 
-
|                                                  '''155'''
 
-
| [[SolverStatistics-takaken-Microban            | '''155''' ]]
 
-
| [[SolverStatistics-yass-Microban                | '''155''' ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-Microban | '''155''' ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Microban    | '''155''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Microban II. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Microban II - David W. Skinner| Microban II]]
 
-
| align="left"                                      | David W. Skinner
 
-
|                                                        135
 
-
|                                                        134
 
-
| [[SolverStatistics-takaken-Microban-II            |    134    ]]
 
-
| [[SolverStatistics-yass-Microban-II                | '''135''' ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-MasMicroban | '''135''' ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Microban-II    |    132    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                  | [[Solver Statistics - Sasquatch - David W. Skinner| Sasquatch]]
 
-
| align="left"                                    | David W. Skinner
 
-
|                                                      50
 
-
|                                                      22
 
-
| [[SolverStatistics-takaken-Sasquatch            | '''36''' ]]
 
-
| [[SolverStatistics-yass-Sasquatch                |    26    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-Sasquatch |    28    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch    | '''36''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch II. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                      | [[Solver Statistics - Sasquatch II - David W. Skinner| Sasquatch II]]
 
-
| align="left"                                        | David W. Skinner
 
-
|                                                          50
 
-
|                                                          16
 
-
| [[SolverStatistics-takaken-Sasquatch-II            | '''33''' ]]
 
-
| [[SolverStatistics-yass-Sasquatch-II                |    20    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-MasSasquatch |    18    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-II    |    32    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch III. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                      | [[Solver Statistics - Sasquatch III - David W. Skinner| Sasquatch III]]
 
-
| align="left"                                        | David W. Skinner
 
-
|                                                          50
 
-
|                                                          14
 
-
| [[SolverStatistics-takaken-Sasquatch-III            |    22    ]]
 
-
| [[SolverStatistics-yass-Sasquatch-III              |    13    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchIII |    12    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-III    | '''25''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch IV. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch IV - David W. Skinner| Sasquatch IV]]
 
-
| align="left"                                      | David W. Skinner
 
-
|                                                        50
 
-
|                                                        27
 
-
| [[SolverStatistics-takaken-Sasquatch-IV            | '''37''' ]]
 
-
| [[SolverStatistics-yass-Sasquatch-IV              |    30    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchIV |    25    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-IV    |    35    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch V. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch V - David W. Skinner| Sasquatch V]]
 
-
| align="left"                                      | David W. Skinner
 
-
|                                                        50
 
-
|                                                        30
 
-
| [[SolverStatistics-takaken-Sasquatch-V            |    36    ]]
 
-
| [[SolverStatistics-yass-Sasquatch-V              |    29    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchV |    25    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-V    | '''37''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch VI. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"      -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                    | [[Solver Statistics - Sasquatch VI - David W. Skinner| Sasquatch VI]]
 
-
| align="left"                                      | David W. Skinner
 
-
|                                                        50
 
-
|                                                        30
 
-
| [[SolverStatistics-takaken-Sasquatch-VI            |    32    ]]
 
-
| [[SolverStatistics-yass-Sasquatch-VI              |    25    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchVI |    26    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-VI    | '''38''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sasquatch VII. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                      | [[Solver Statistics - Sasquatch VII - David W. Skinner| Sasquatch VII]]
 
-
| align="left"                                        | David W. Skinner
 
-
|                                                          50
 
-
|                                                          30
 
-
| [[SolverStatistics-takaken-Sasquatch-VII            |    31    ]]
 
-
| [[SolverStatistics-yass-Sasquatch-VII              |    26    ]]
 
-
| [[SolverStatistics-jsoko-DavidWSkinner-SasquatchVII |    25    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-Sasquatch-VII    | '''40''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sven Sharpen. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"              -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"              | [[Solver Statistics - Sven Egevad - Sharpen| Sharpen ]]
 
-
| align="left"                                        | Sven Egevad
 
-
|                                                          153
 
-
| [[SolverStatistics-BoxSearch-SvenEgevad-Sharpen      |    34    ]]
 
-
| [[SolverStatistics-takaken-SvenEgevad-Sharpen        |    76    ]]
 
-
| [[SolverStatistics-yass-SvenEgevad-Sharpen          |    43    ]]
 
-
| [[SolverStatistics-jsoko-SvenEgevad-Sharpen          |    46    ]]
 
-
| [[SolverStatistics-sokolutionv3.1-SvenEgevad-Sharpen | '''84''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- SokEvo. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"            -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"      | [[Solver Statistics - SokEvo - Lee J Haywood | SokEvo]]
 
-
| align="left"                        | Lee J Haywood
 
-
|                                          107
 
-
|                                        '''107'''
 
-
| [[SolverStatistics-takaken-SokEvo    | '''107''' ]]
 
-
| [[SolverStatistics-yass-SokEvo      | '''107''' ]]
 
-
|                                        '''107'''
 
-
| [[SolverStatistics-sokolution-SokEvo | '''107''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- SokHard. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"          -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"              | [[Solver Statistics - Lee J Haywood | SokHard ]]
 
-
| align="left"                                | Lee J Haywood
 
-
|                                                  163
 
-
|                                                '''163'''
 
-
| [[SolverStatistics-takaken-SokHard          | '''163''' ]]
 
-
| [[SolverStatistics-yass-SokHard              | '''163''' ]]
 
-
| [[SolverStatistics-jsoko-LeeJHaywood-SokHard |    158    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-SokHard  | '''163''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sokoban Perfect "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                            | [[Solver Statistics - Perfect - Thinking Rabbit | Sokoban Perfect ]]
 
-
| align="left"                                              | Thinking Rabbit
 
-
|                                                                306
 
-
| [[SolverStatistics-BoxSearch-ThinkingRabbit-Perfect      |    146    ]]
 
-
| [[SolverStatistics-takaken-ThinkingRabbit-Perfect        | '''261''' ]]
 
-
| [[SolverStatistics-yass-ThinkingRabbit-Perfect            |    188    ]]
 
-
| [[SolverStatistics-jsoko-ThinkingRabbit-Perfect          |    188    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-ThinkingRabbit-Perfect |    233    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sokoban Revenge "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                            | [[Solver Statistics - Revenge - Thinking Rabbit | Sokoban Revenge ]]
 
-
| align="left"                                              | Thinking Rabbit
 
-
|                                                                306
 
-
| [[SolverStatistics-BoxSearch-ThinkingRabbit-Revenge      |    148    ]]
 
-
| [[SolverStatistics-takaken-ThinkingRabbit-Revenge        | '''244''' ]]
 
-
| [[SolverStatistics-yass-ThinkingRabbit-Revenge            |    194    ]]
 
-
| [[SolverStatistics-jsoko-ThinkingRabbit-Revenge          |    171    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-ThinkingRabbit-Revenge |    214    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Sven. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"              -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"              | [[Solver Statistics - Sven Egevad | Sven ]]
 
-
| align="left"                                | Sven Egevad
 
-
|                                                  1623
 
-
|                                                  1170
 
-
| [[SolverStatistics-takaken-SvenEgevad        |    1384  ]]
 
-
| [[SolverStatistics-yass-SvenEgevad          |    1251  ]]
 
-
| [[SolverStatistics-jsoko-SvenEgevad-Sven    |    1180  ]]
 
-
| [[SolverStatistics-sokolutionv3.1-SvenEgevad | '''1432''']]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Y.M. Auto. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"        -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                              | [[Solver Statistics - Y.M. Auto - Yoshio Murase| Y.M. Auto ]]
 
-
| align="left"                                                | Yoshio Murase
 
-
|                                                                  52
 
-
|                                                                '''52'''
 
-
| [[SolverStatistics-takaken-YoshioMuraseAutogenerated        | '''52''' ]]
 
-
| [[SolverStatistics-yass-YoshioMuraseAutogenerated            | '''52''' ]]
 
-
|                                                                '''52'''
 
-
| [[SolverStatistics-sokolutionv3.01-YoshioMuraseAutogenerated | '''52''' ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
<!-- Y.M. Handmade. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution"    -->
 
-
<!-- -------------------------------------------------------------------------------------------- -->
 
-
|- align="right"
 
-
| align="left" bgcolor="#f1efe5"                          | [[Solver Statistics - Y.M. Handmade - Yoshio Murase| Y.M. Handmade ]]
 
-
| align="left"                                            | Yoshio Murase
 
-
|                                                              54
 
-
|                                                          '''54'''
 
-
| [[SolverStatistics-takaken-YoshioMuraseHandmade        | '''54''' ]]
 
-
| [[SolverStatistics-yass-YoshioMuraseHandmade            |    52    ]]
 
-
| [[SolverStatistics-jsoko-YoshioMurase-Handmade          |    52    ]]
 
-
| [[SolverStatistics-sokolutionv3.01-YoshioMuraseHandmade |    53    ]]
 
-
 
-
<!-- -------------------------------------------------------------------------------------------------------- -->
 
-
<!-- Total solved levels by solver. "Collection, author, levels, BoxSearch, Takaken, YASS, JSoko, Sokolution" -->
 
-
<!-- -------------------------------------------------------------------------------------------------------- -->
 
-
|- bgcolor="#f1efe5" align="right"
 
-
| align="left" | Total
 
-
|
 
-
|    3947      <!-- Total levels -->
 
-
|    2839      <!-- BoxSearch    -->
 
-
|    3375      <!-- Takaken      -->
 
-
|    3021      <!-- YASS        -->
 
-
|    2905      <!-- JSoko        -->
 
-
| '''3390'''  <!-- Sokolution  -->
 
-
 
-
|}
 
== Disclaimer ==
== Disclaimer ==
Line 1,226: Line 282:
  E-mail: grigr@yandex.ru
  E-mail: grigr@yandex.ru
  Web site: http://grigr.narod.ru/
  Web site: http://grigr.narod.ru/
-
<br>
 
-
Kenyam Set A
 
-
Copyright (C) 2000-2006 by Kenya Maruyama
 
-
E-mail: rmckenyam@hotmail.com
 
-
Web Site: http://www.geocities.jp/rmcsokoban/soko/skrmc_a.htm
 
  <br>
  <br>
  SokEvo and SokHard level sets
  SokEvo and SokHard level sets
Line 1,250: Line 301:
  E-mail: yoshio@asahi.email.ne.jp
  E-mail: yoshio@asahi.email.ne.jp
  Web Site: http://www.ne.jp/asahi/ai/yoshio/sokoban/index.html
  Web Site: http://www.ne.jp/asahi/ai/yoshio/sokoban/index.html
-
<br>
 
-
BoxSearch
 
-
Copyright (C) 2007 by Ge Yong
 
-
E-mail: notabdc@hotmail.com
 
-
Web site: unknown 
 
  <br>
  <br>
  JSoko
  JSoko
  Copyright (C) by Matthias Meger
  Copyright (C) by Matthias Meger
-
  E-mail: JSoko@online.de
+
  E-mail: JSoko@mail.de
-
  Web site: http://www.sokoban-online.de
+
  Web site: https://www.sokoban-online.de
  <br>
  <br>
  Sokoban Automatic Solver (aka Takaken solver)
  Sokoban Automatic Solver (aka Takaken solver)
  Copyright (C) 2002 - 200X Ken'ichiro Takahashi (aka takaken)
  Copyright (C) 2002 - 200X Ken'ichiro Takahashi (aka takaken)
  E-mail: takaken@ic-net.or.jp
  E-mail: takaken@ic-net.or.jp
-
  Web site: http://www.ic-net.or.jp/home/takaken/e/soko/index.html  
+
  Web site: https://computerpuzzle.net/english/sokoban/ver740/index.html  
  <br>
  <br>
  YASS - Yet Another Sokoban Solver and Optimizer - For Small Levels
  YASS - Yet Another Sokoban Solver and Optimizer - For Small Levels
  Copyright (C) 2007 by Brian Damgaard
  Copyright (C) 2007 by Brian Damgaard
-
E-mail: BrianDamgaard@jubii.dk
+
  Web site: https://sourceforge.net/projects/sokobanyasc/
-
  Web site: http://sourceforge.net/projects/sokobanyasc/
+
  <br>
  <br>
  Sokoban YASC  
  Sokoban YASC  
-
  Copyright (C) 2001-2019 by Brian Damgaard
+
  Copyright (C) 2001-2020 by Brian Damgaard
-
E-mail: BrianDamgaard@jubii.dk
+
  Web Site: https://sourceforge.net/projects/sokobanyasc/
  Web Site: https://sourceforge.net/projects/sokobanyasc/
  <br>
  <br>
Line 1,294: Line 338:
  Copyright (C) 2016-2019 by Florent DIEDLER
  Copyright (C) 2016-2019 by Florent DIEDLER
  E-mail: fdiedler2000@gmail.com
  E-mail: fdiedler2000@gmail.com
-
  Web site: http://codeanalysis.fr/sokoban/  
+
  Web site: http://sokolution.infinityfreeapp.com/
  <br>
  <br>
-
  Trademarks
+
  Festival
-
  ==========
+
  Copyright (C) 2020 by Yaron Shoham
-
<br>
+
  Web site: https://festival-solver.site/
-
Company names, brand names and product names are trademarks
+
-
or registered trademarks of their respective holders.
+
-
<br>
+
-
Contact
+
-
=======
+
-
<br>
+
-
E-mail: sokoban@online.de
+
-
 
+
-
== Disclaimer ==
+
-
 
+
-
Sokoban
+
-
=======
+
-
<br>
+
-
Sokoban (R) Registered Trademark of Falcon Co., Ltd., Japan
+
-
Sokoban Copyright (C) 1982-2004 by Hiroyuki Imabayashi, Japan
+
-
Sokoban Copyright (C) 1989, 1990, 2001-2004 by Falcon Co., Ltd., Japan
+
-
<br>
+
-
License
+
-
=======
+
-
<br>
+
-
Redistribution and use of the Sokoban Solver statistics are permitted
+
-
provided that the following conditions are met:
+
-
<br>
+
-
* Redistributions may not be sold, nor may they be used in a commercial product or activity.
+
-
* Redistributions must reproduce the entire content of this disclaimer in the documentation
+
-
  and/or other materials provided with the distribution.
+
-
<br>
+
-
Credits (in no particular order)
+
-
================================
+
-
<br>
+
-
CosmoNotes, CosmoPoly, LOMA, MicroCosmos, MiniCosmos,
+
-
NaboCosmos and PicoCosmos level sets
+
-
Copyright (C) by Aymeric du Peloux.
+
-
E-mail: aymeric.du-peloux@gadz.org
+
-
  Web site: unknown
+
-
<br>
+
-
dh1, dh2, bagatelle, cantrip, and maelstrom level sets
+
-
Copyright (C) by David Holland
+
-
E-mail: unknown
+
-
Web site: unknown
+
-
<br>
+
-
Microban, Mas Microban, Sasquatch, Mas Sasquatch, Sasquatch III,
+
-
Sasquatch IV, Sasquatch V, Sasquatch VI and Sasquatch VII level sets.
+
-
Copyright (C) by David W. Skinner
+
-
E-mail: sasquatch@bentonrea.com
+
-
Web site: unknown
+
-
<br>
+
-
Grigr2001, Grigr2002 and GrigrSpecial level sets
+
-
Copyright (C) by Evgeny Grigoriev  (aka GRIGoRusha)
+
-
E-mail: grigr@yandex.ru
+
-
Web site: http://grigr.narod.ru/
+
-
<br>
+
-
Kenyam Set A
+
-
Copyright (C) 2000-2006 by Kenya Maruyama
+
-
E-mail: rmckenyam@hotmail.com
+
-
Web Site: http://www.geocities.jp/rmcsokoban/soko/skrmc_a.htm
+
-
<br>
+
-
SokEvo and SokHard level sets
+
-
Copyright (C) 2002-2006 by Lee J Haywood
+
-
E-mail: fruise@gmail.com
+
-
Web Site: http://leehaywood.org/games/sokoban/
+
-
<br>
+
-
Sven level set
+
-
Copyright (C) 2007 by Sven Egevad
+
-
E-mail: sven.egevad@telia.com
+
-
Web Site: unknown
+
-
<br>
+
-
Sokoban Perfect and Sokoban Revenge level sets
+
-
Copyright (C) 1989, 1991 by Thinking Rabbit
+
-
Web Site: https://sokoban.jp/
+
-
<br>
+
-
Y.M. Auto and Y.M. Handmade level sets
+
-
Copyright (C) Yoshio Murase
+
-
E-mail: yoshio@asahi.email.ne.jp
+
-
Web Site: http://www.ne.jp/asahi/ai/yoshio/sokoban/index.html
+
-
<br>
+
-
BoxSearch
+
-
Copyright (C) 2007 by Ge Yong
+
-
E-mail: notabdc@hotmail.com
+
-
Web site: unknown 
+
-
<br>
+
-
JSoko
+
-
Copyright (C) by Matthias Meger
+
-
E-mail: JSoko@online.de
+
-
Web site: http://www.sokoban-online.de
+
-
<br>
+
-
Sokoban Automatic Solver (aka Takaken solver)
+
-
Copyright (C) 2002 - 200X Ken'ichiro Takahashi (aka takaken)
+
-
E-mail: takaken@ic-net.or.jp
+
-
Web site: http://www.ic-net.or.jp/home/takaken/e/soko/index.html
+
-
<br>
+
-
YASS - Yet Another Sokoban Solver and Optimizer - For Small Levels
+
-
Copyright (C) 2007 by Brian Damgaard
+
-
E-mail: BrianDamgaard@jubii.dk
+
-
Web site: http://sourceforge.net/projects/sokobanyasc/
+
-
<br>
+
-
Sokoban YASC
+
-
Copyright (C) 2001-2019 by Brian Damgaard
+
-
E-mail: BrianDamgaard@jubii.dk
+
-
Web Site: https://sourceforge.net/projects/sokobanyasc/
+
-
<br>
+
-
YSokoban
+
-
Copyright (C) 2007 by George Petrov
+
-
E-mail: YGP@WriteMe.com
+
-
Web Site:  http://ygp.orgfree.com/sokoban.html
+
-
<br>
+
-
XSokoban
+
-
Copyright (C) by Andrew Myers
+
-
E-mail: andru@cs.cornell.edu
+
-
Web Site: http://www.cs.cornell.edu/andru/xsokoban.html
+
-
<br>
+
-
Sokofan
+
-
Copyright (C) 2005-2007 by Eric Leung
+
-
E-mail: eleung2@hotpop.com
+
-
Web Site: unknown
+
-
<br>
+
-
Sokolution
+
-
Copyright (C) 2016-2019 by Florent DIEDLER
+
-
E-mail: fdiedler2000@gmail.com
+
-
Web site: http://codeanalysis.fr/sokoban/  
+
  <br>
  <br>
  Trademarks
  Trademarks
Line 1,429: Line 353:
  =======
  =======
  <br>
  <br>
-
  E-mail: sokoban@online.de
+
  E-mail: sokobanowiki@gmail.com

Current revision as of 18:40, 8 October 2024

A Sokoban solver program is a program that tries to solve Sokoban levels. There are several solver programs available. (See Sokoban solvers.)

Solver programs may have different objectives:

  1. Find any solution
  2. Find push optimal solutions
  3. Find push optimal solutions with best moves
  4. Find move optimal solutions
  5. Find move optimal solutions with best pushes

Given the computational complexity of these tasks, a solver program is usually designed for just finding any solution. If a solution is to be optimized, an optimizer program can be used. (See Optimizers.)

The statistics presented here provide a picture of what the best freely available Sokoban solvers can do.
For copyrights, credits and redistribution of these statistics, please read the disclaimer.


Contents

General benchmarking information

For practical reasons, almost all tests have been performed with a 10 minutes time limit. The tests are, however, not a 10 minutes contest but a showcase for what the solvers can do, so other time limits are entirely feasible.

The hardware used for the tests is a standard PC with a modern operating system (64bit).

Tests are performed with default solver settings.

Solver Version Author Architecture CPU usage Source code available More info
Festival 3.1 Yaron Shoham 64bit 8 threads Festival 3.1 Website with papers about the solver
Sokolution 6.33 Florent Diedler 64bit all threads no Sokoban solver "scribbles" by Florent Diedler
Takaken 7.4 Ken'ichiro Takahashi (takaken) 64bit 2 threads no Description of the used algorithms
Curry 0.3 Yaron Shoham 64bit 1 thread Curry 0.3 Website with paper about the solver
YASS 2.151 Brian Damgaard 32bit 1 thread YASS 2.151 Sokoban solver "scribbles" by Brian Damgaard
JSoko 2.04 Matthias Meger 64bit 1 thread JSoko 2.04 Solver information
Rolling Stone 1.0 Andreas Junghanns 32bit 1 thread RS Rolling Stone papers

Contact: SokobanoWiki@gmail.com

XSokoban Test Suite

The XSokoban level set is the de facto standard test suite in the academic literature on Sokoban solver programming.

Sokoban Solver Statistics - XSokoban Test Suite - Solved Levels
Collection Author Levels Rolling Stone Takaken YASS JSoko Sokolution Curry Festival
XSokoban Thinking Rabbit, ... 90 59* 90 89 67 90 90 90
Sokoban Solver Statistics - XSokoban Test Suite - Push-optimal Solutions
Collection Author Levels Rolling Stone Pereira et al. JSoko Sokolution
XSokoban Thinking Rabbit, ... 90 6 28 31 59

The statistic shows that Sokolution is by far the best solver when searching for push optimal solutions.

Large Test Suite

The large test suite comprises level packs selected for being a challenge for the solvers, but not too difficult. The statistics shows the results for the leading Sokoban solver programs.

This test suite is not subject to change, as it is intended to be a "Large Standard Test Suite" for Sokoban solver programs.

Sokoban Solver Statistics - Large Test Suite - Solved levels
Levels Festival Sokolution Takaken YASS
Total levels 3272 3205 3172 2953 2891

Click here to see the detailed results for the Large Test Suite.

Download the entire test suite here or the individual level sets from www.sokobano.de.

Open Test Suite

The statistics shows the results for the leading Sokoban solvers for various level collections. Please note that the grand totals are simple summations. The number of solved unique levels may differ slightly due to duplicate levels in the level packs.

This test suite may be changed by adding new level collections from time to time.

Sokoban Solver Statistics - Open Test Suite - Solved levels
Levels Festival Sokolution Takaken YASS
Total levels 10773 9950 9694 8919 8485

Click here to see the detailed results for the Open Test Suite.

GroupEffort Test Suite

The only reason for benchmarking the GroupEffort test suite is to demonstrate the limited veracity of the statement made in section "6 Conclusion" of the thesis, where the author writes that the GroupEffort solver "outperforms existing solvers".

The benchmarks show that this was only true for the cherry-picked small test set at the time the thesis was published, never for the presumably more representative large test set.

Sokoban Solver Statistics - GroupEffort Test Suite - Solved Levels
Collection Levels GroupEffort Festival Sokolution Takaken JSoko YASS
Small Set 200 196 (a)(c) 200 (b) 200 (a) 192 (b) 180 (b) 191 (b)
Large Set 2851 1566 (a)(c) 2766 (b) 2471 (a) 2462 (b) 2165 (b) 2260 (b)
Total 3051 1762 2966 2671 2654 2345 2471

(a): Time limit: 5 minutes     (b): Time limit: 10 minutes     (c): Best GroupEffort solver configuration

Disclaimer 

Sokoban
=======


Sokoban (R) Registered Trademark of Falcon Co., Ltd., Japan
Sokoban Copyright (C) 1982-2004 by Hiroyuki Imabayashi, Japan
Sokoban Copyright (C) 1989, 1990, 2001-2004 by Falcon Co., Ltd., Japan


License
=======


Redistribution and use of the Sokoban Solver statistics are permitted
provided that the following conditions are met: 


* Redistributions may not be sold, nor may they be used in a commercial product or activity.
* Redistributions must reproduce the entire content of this disclaimer in the documentation
  and/or other materials provided with the distribution.


Credits (in no particular order)
================================


CosmoNotes, CosmoPoly, LOMA, MicroCosmos, MiniCosmos,
NaboCosmos and PicoCosmos level sets
Copyright (C) by Aymeric du Peloux.
E-mail: aymeric.du-peloux@gadz.org
Web site: unknown


dh1, dh2, bagatelle, cantrip, and maelstrom level sets
Copyright (C) by David Holland
E-mail: unknown
Web site: unknown


Microban, Mas Microban, Sasquatch, Mas Sasquatch, Sasquatch III,
Sasquatch IV, Sasquatch V, Sasquatch VI and Sasquatch VII level sets.
Copyright (C) by David W. Skinner
E-mail: sasquatch@bentonrea.com
Web site: unknown


Grigr2001, Grigr2002 and GrigrSpecial level sets
Copyright (C) by Evgeny Grigoriev  (aka GRIGoRusha)
E-mail: grigr@yandex.ru
Web site: http://grigr.narod.ru/


SokEvo and SokHard level sets
Copyright (C) 2002-2006 by Lee J Haywood
E-mail: fruise@gmail.com
Web Site: http://leehaywood.org/games/sokoban/


Sven level set
Copyright (C) 2007 by Sven Egevad
E-mail: sven.egevad@telia.com
Web Site: unknown


Sokoban Perfect and Sokoban Revenge level sets
Copyright (C) 1989, 1991 by Thinking Rabbit
Web Site: https://sokoban.jp/


Y.M. Auto and Y.M. Handmade level sets
Copyright (C) Yoshio Murase 
E-mail: yoshio@asahi.email.ne.jp
Web Site: http://www.ne.jp/asahi/ai/yoshio/sokoban/index.html


JSoko
Copyright (C) by Matthias Meger
E-mail: JSoko@mail.de
Web site: https://www.sokoban-online.de


Sokoban Automatic Solver (aka Takaken solver)
Copyright (C) 2002 - 200X Ken'ichiro Takahashi (aka takaken)
E-mail: takaken@ic-net.or.jp
Web site: https://computerpuzzle.net/english/sokoban/ver740/index.html 


YASS - Yet Another Sokoban Solver and Optimizer - For Small Levels
Copyright (C) 2007 by Brian Damgaard
Web site: https://sourceforge.net/projects/sokobanyasc/


Sokoban YASC 
Copyright (C) 2001-2020 by Brian Damgaard
Web Site: https://sourceforge.net/projects/sokobanyasc/


YSokoban
Copyright (C) 2007 by George Petrov
E-mail: YGP@WriteMe.com
Web Site:  http://ygp.orgfree.com/sokoban.html


XSokoban
Copyright (C) by Andrew Myers
E-mail: andru@cs.cornell.edu
Web Site: http://www.cs.cornell.edu/andru/xsokoban.html


Sokofan
Copyright (C) 2005-2007 by Eric Leung
E-mail: eleung2@hotpop.com
Web Site: unknown


Sokolution
Copyright (C) 2016-2019 by Florent DIEDLER
E-mail: fdiedler2000@gmail.com
Web site: http://sokolution.infinityfreeapp.com/


Festival
Copyright (C) 2020 by Yaron Shoham
Web site: https://festival-solver.site/


Trademarks
========== 


Company names, brand names and product names are trademarks
or registered trademarks of their respective holders.


Contact
=======


E-mail: sokobanowiki@gmail.com

Retrieved from "http://sokobano.de/wiki/index.php?title=Solver_Statistics"
Personal tools