Solver Statistics - Lee J Haywood

From Sokoban Wiki

Jump to: navigation, search

This is a summary of running the SokHard Collection (163 levels total) using these solvers:
• BoxSearch v5.1 beta2
• JSoko 1.35
• Takaken v7.2
• YASS v2.97

Each solver is tested separately to ensure that they don't compete for system resources.

For copyrights, credits and redistribution of these statistics, please read the disclaimer.

Though some people might be interested in how long it takes to solve a given level and/or how good the solution is (optimal or not), this summary disregards all timing associated with solving the levels and solution statistics. These tests are mainly for gauging solvability, not timing nor how good the solution is.

Not all Sokoban solvers are created equal:

  • BoxSearch: (level size limit: none)
  • JSoko: (level size limit: width=40, height=40)
  • Takaken: (level size limit: width=50, height=50, Boxes=64)
  • YASS: (level size limit: width=50, height=50)


Test machine info:

  • Machine: ThinkPad T42P
  • CPU: x86 Family 6 Model 13 Stepping 6 Genuine Intel
  • Physical RAM: 2 GB
  • OS Name & Version: Microsoft Windows XP Professional v5.12600 Service Pack 2 Build 2600.
  • NOTE: The JSoko results are tested on a Samsung Aura Dillen Core 2 Duo T9300 (2,5 GHz) with 3 GiB RAM, OS: Vista Home (Service Pack 1), JRE: 1.6.02_12

Initial tests:

  • BoxSearch is set with max memory limit of 1500 MB and 600 seconds. (using quick mode)
  • JSoko is set with 1500 MB memory and 600 second limit. (any solution method)
  • Takaken is set with 1000 MB memory and 600 second limit.
  • YASS is set with 1500 MB memory and 600 second limit.


Further tests:


The following table shows the levels where each of the solvers failed:
======================================================================

         BoxSearch         JSoko          Takaken           YASS     
	==============	==============	==============	==============
 		 	     17       		 		
 		 	     29       		 		
 		 	     35       		 		
 		 	     39       		 		
 		 	     52       		 		
 		 	     64       		 		
 		 	     70       		 		
 		 	     72       		 		
 		 	     74       		 		
 		 	     78       		 		
 		 	     79       		 		
 		 	     80       		 		
 		 	     81       		 		
 		 	     84       		 		
 		 	     85       		 		
 		 	     89       		 		
 		 	     92       		 		
 		 	     96       		 		
 		 	     97       		 		
 		 	     98       		 		
 		 	    100       		 		
 		 	    101       		 		
 		 	    103       		 		
 		 	    105       		 		
 		 	    106       		 		
 		 	    111       		 		
 		 	    112       		 		
 		 	    113       		 		
 		 	    114       		 		
 		 	    116       		 		
 		 	    117       		 		
 		 	    118       		 		
 		 	    119       		 		
 		 	    121       		 		
 		 	    122       		 		
 		 	    125       		 		
 		 	    126       		 		
 		 	    127       		 		
 		 	    129       		 		
 		 	    130       		 		
 		 	    132       		 		
 		 	    133       		 		
 		 	    134       		 		
 		 	    135       		 		
 		 	    137       		 		
 		 	    139       		 		
 		 	    140       		 		
 		 	    141       		 		
 		 	    142       		 		
 		 	    143       		 		
 		 	    144       		 		
 		 	    146       		 		
 		 	    147       		 		
 		 	    149       		 		
 		 	    151       		 		
 		 	    152       		 		
 		 	    153       		 		
 		 	    154       		 		
 		 	    156       		 		
 		 	    159       		 		
 		 	    160       		 		
 		 	    162       		 		
	==============	==============	==============	==============
Total:	      0		     62		      0		      0	

Total (unique level count): 62



All solvers failed on these levels: 
===================================================================================

===================================================================================
Total count: 0


"BoxSearch" failed on these levels where at least one solver solved: 
===================================================================================

===================================================================================
Total count: 0


"JSoko" failed on these levels where at least one solver solved: 
===================================================================================
     17      29      35      39      52      64      70      72      74      78 
     79      80      81      84      85      89      92      96      97      98 
    100     101     103     105     106     111     112     113     114     116 
    117     118     119     121     122     125     126     127     129     130 
    132     133     134     135     137     139     140     141     142     143 
    144     146     147     149     151     152     153     154     156     159 
    160     162 
===================================================================================
Total count: 62


"Takaken" failed on these levels where at least one solver solved: 
===================================================================================

===================================================================================
Total count: 0


"YASS" failed on these levels where at least one solver solved: 
===================================================================================

===================================================================================
Total count: 0


"BoxSearch" solved these levels where all other solvers failed: 
===================================================================================

===================================================================================
Total count: 0


"JSoko" solved these levels where all other solvers failed: 
===================================================================================

===================================================================================
Total count: 0


"Takaken" solved these levels where all other solvers failed: 
===================================================================================

===================================================================================
Total count: 0


"YASS" solved these levels where all other solvers failed: 
===================================================================================

===================================================================================
Total count: 0


"BoxSearch" failed on these levels where all other solvers solved: 
===================================================================================

===================================================================================
Total count: 0


"JSoko" failed on these levels where all other solvers solved: 
===================================================================================
     17      29      35      39      52      64      70      72      74      78 
     79      80      81      84      85      89      92      96      97      98 
    100     101     103     105     106     111     112     113     114     116 
    117     118     119     121     122     125     126     127     129     130 
    132     133     134     135     137     139     140     141     142     143 
    144     146     147     149     151     152     153     154     156     159 
    160     162 
===================================================================================
Total count: 62


"Takaken" failed on these levels where all other solvers solved: 
===================================================================================

===================================================================================
Total count: 0


"YASS" failed on these levels where all other solvers solved: 
===================================================================================

===================================================================================
Total count: 0


BoxSearch solved 163 of 163 levels.

BoxSearch 100%

JSoko solved 101 of 163 levels.

JSoko 62.0%

Takaken solved 163 of 163 levels.

Takaken 100%

YASS solved 163 of 163 levels.

YASS 100%

All solvers combined solved 163 of 163 levels.

All solvers 100%
Personal tools