<br><br><div class="gmail_quote">On Wed, May 26, 2010 at 11:09 PM, Juan Jose Garcia-Ripoll <span dir="ltr"><<a href="mailto:juanjose.garciaripoll@googlemail.com" target="_blank">juanjose.garciaripoll@googlemail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I have stripped down and reimplemented the type propagator. Right now it is kind of stable and implements forward type propagation for most forms. You will see, however, some harmless notes such as the following one.<div>
<div>
;;; Note:</div><div>;;; Refusing to propagate FUNCTION</div><div><br></div><div>The result is that some benchmarks are now dominated by stupid statements in them (ASSERT) (SBCL first column, ECL tonight second, ECL 10.4.1 last) </div>
<div><br></div><div><div>1D-ARRAYS [ 0.03] 1.00 2.67</div><div>2D-ARRAYS [ 0.24] 3.04 7.17</div><div>3D-ARRAYS [ 0.68] 2.19 11.78</div></div></div></blockquote>
<div><br></div><div>Ok, so this is how it looks now on a newer version that implements type propagation, fixes type propagation for arrays and takes a different, more efficient approach to the problem of unboxing temporaries.</div>
<div><br></div><div>1D-ARRAYS [ 0.03] 1.67 2.67</div><div>2D-ARRAYS [ 0.24] 0.75 7.17</div>
<div>3D-ARRAYS [ 0.68] 0.68 11.78</div><div><br></div></div>1D-ARRAYS is dominated by an assertion and in particular by the call to SEARCH, a function which I have not optimized. If I change the test as shown below, with more iterations, no call to SEARCH and yet fully executed (not optimized away), then the comparison is more fair: ECL performs equally well or better than SBCL (remember that numbers are relative to the reference)<div>
<br></div><div><div>1D-ARRAYS [ 0.10] 1.00</div><div>2D-ARRAYS [ 0.20] 0.85</div><div>3D-ARRAYS [ 0.67] 0.70</div><div><br></div><div>The full list of benchmarks is shown below. Not all changes are as dramatic as these ones because type propagation has only been implemented for certain functions --arithmetics, arrays, and functions with a single type proclamation that does not depend on the arguments.</div>
<div><br></div><div><div>(defun bench-1d-arrays (&optional (size 100000) (runs 500))</div><div> (declare (fixnum size)</div><div> (fixnum runs))</div><div> (let ((ones (make-array size :element-type '(integer 0 1000) :initial-element 1))</div>
<div> (twos (make-array size :element-type '(integer 0 1000) :initial-element 2))</div><div> (threes (make-array size :element-type '(integer 0 2000))))</div><div> (dotimes (runs runs)</div><div>
(dotimes (pos size)</div>
<div> (setf (aref threes pos) (+ (aref ones pos) (aref twos pos))))</div><div> (assert (= 3 (aref threes runs))))</div><div> (values)))</div><div><br></div></div>
<div><font class="Apple-style-span" face="'courier new', monospace">Benchmark Reference ECLx ECLo </font></div><div><font class="Apple-style-span" face="'courier new', monospace">-------------------------------------------------------------------------------------</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">COMPILER [ 0.97] 0.85 0.80</font></div><div><font class="Apple-style-span" face="'courier new', monospace">LOAD-FASL [ 0.15] 0.60 0.53</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">SUM-PERMUTATIONS [ 0.95] -1.00 -1.00</font></div><div><font class="Apple-style-span" face="'courier new', monospace">WALK-LIST/SEQ [ 0.01] 6.00 6.00</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">WALK-LIST/MESS [ 0.02] 2.50 2.50</font></div><div><font class="Apple-style-span" face="'courier new', monospace">BOYER [ 2.03] 1.83 1.81</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">BROWSE [ 0.17] 1.59 1.76</font></div><div><font class="Apple-style-span" face="'courier new', monospace">DDERIV [ 0.11] 5.64 5.64</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">DERIV [ 0.13] 5.23 5.08</font></div><div><font class="Apple-style-span" face="'courier new', monospace">DESTRUCTIVE [ 0.13] 2.85 2.92</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">DIV2-TEST-1 [ 0.17] 5.53 6.18</font></div><div><font class="Apple-style-span" face="'courier new', monospace">DIV2-TEST-2 [ 0.25] 4.44 4.64</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">FFT [ 0.03] 1.67 18.00</font></div><div><font class="Apple-style-span" face="'courier new', monospace">FRPOLY/FIXNUM [ 0.15] 3.07 2.87</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">FRPOLY/BIGNUM [ 0.12] 1.92 1.92</font></div><div><font class="Apple-style-span" face="'courier new', monospace">FRPOLY/FLOAT [ 0.22] 2.27 2.45</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">PUZZLE [ 0.15] 7.80 11.00</font></div><div><font class="Apple-style-span" face="'courier new', monospace">TAK [ 0.12] 1.67 6.83</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">CTAK [ 0.24] 2.46 3.79</font></div><div><font class="Apple-style-span" face="'courier new', monospace">TRTAK [ 0.12] 1.67 6.83</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">TAKL [ 0.25] 1.36 0.84</font></div><div><font class="Apple-style-span" face="'courier new', monospace">STAK [ 0.28] 1.25 1.50</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">FPRINT/UGLY [ 0.54] 1.69 1.59</font></div><div><font class="Apple-style-span" face="'courier new', monospace">FPRINT/PRETTY [ 1.29] 18.62 25.75</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">TRAVERSE [ 0.74] 1.89 2.05</font></div><div><font class="Apple-style-span" face="'courier new', monospace">TRIANGLE [ 0.37] 3.11 5.41</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">RICHARDS [ 0.36] 5.86 6.00</font></div><div><font class="Apple-style-span" face="'courier new', monospace">FACTORIAL [ 0.08] 1.00 1.13</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">FIB [ 0.14] 2.43 2.43</font></div><div><font class="Apple-style-span" face="'courier new', monospace">FIB-RATIO [ 0.03] 1.67 1.67</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">ACKERMANN [ 0.46] 2.11 2.07</font></div><div><font class="Apple-style-span" face="'courier new', monospace">MANDELBROT/COMPLEX [ 0.18] 1.94 2.06</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">MANDELBROT/DFLOAT [ 0.01] 4.00 47.00</font></div><div><font class="Apple-style-span" face="'courier new', monospace">MRG32K3A [ 0.49] 2.45 2.41</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">CRC40 [ 0.28] 14.61 19.54</font></div><div><font class="Apple-style-span" face="'courier new', monospace">BIGNUM/ELEM-100-1000 [ 0.07] 0.43 0.29</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">BIGNUM/ELEM-1000-100 [ 0.08] 0.38 0.25</font></div><div><font class="Apple-style-span" face="'courier new', monospace">BIGNUM/ELEM-10000-1 [ 0.05] 0.60 0.60</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">BIGNUM/PARI-100-10 [ 0.00] -1.00 -1.00</font></div><div><font class="Apple-style-span" face="'courier new', monospace">BIGNUM/PARI-200-5 [ 0.03] 0.00 0.00</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">PI-DECIMAL/SMALL [ 0.35] 4.40 4.40</font></div><div><font class="Apple-style-span" face="'courier new', monospace">PI-DECIMAL/BIG [ 0.18] 6.06 6.06</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">PI-ATAN [ 0.40] 0.50 0.55</font></div><div><font class="Apple-style-span" face="'courier new', monospace">PI-RATIOS [ 0.75] 0.61 0.63</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">HASH-STRINGS [ 0.11] 2.45 3.09</font></div><div><font class="Apple-style-span" face="'courier new', monospace">HASH-INTEGERS [ 0.20] 2.25 2.35</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">SLURP-LINES [ 0.60] 2.85 2.80</font></div><div><font class="Apple-style-span" face="'courier new', monospace">BOEHM-GC [ 0.58] 4.97 5.07</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">DEFLATE-FILE [ 0.14] 2.71 3.71</font></div><div><font class="Apple-style-span" face="'courier new', monospace">1D-ARRAYS [ 0.10] 1.00 23.90</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">2D-ARRAYS [ 0.20] 0.85 8.65</font></div><div><font class="Apple-style-span" face="'courier new', monospace">3D-ARRAYS [ 0.67] 0.70 11.91</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">BITVECTORS [ 0.19] 10.53 10.47</font></div><div><font class="Apple-style-span" face="'courier new', monospace">BENCH-STRINGS [ 0.20] 17.60 12.85</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">fill-strings/adjustable [ 4.81] 0.07 1.05</font></div><div><font class="Apple-style-span" face="'courier new', monospace">STRING-CONCAT [ 1.57] 1.53 1.69</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">SEARCH-SEQUENCE [ 0.15] 5.07 8.53</font></div><div><font class="Apple-style-span" face="'courier new', monospace">CLOS/defclass [ 0.56] 0.30 0.48</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">CLOS/defmethod [ 2.65] 0.04 0.06</font></div><div><font class="Apple-style-span" face="'courier new', monospace">CLOS/instantiate [ 3.96] 4.37 4.52</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">CLOS/simple-instantiate [ 0.13] 153.77 158.54</font></div><div><font class="Apple-style-span" face="'courier new', monospace">CLOS/methodcalls [ 0.54] 3.87 3.15</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">CLOS/method+after [ 1.68] 1.13 1.02</font></div><div><font class="Apple-style-span" face="'courier new', monospace">CLOS/complex-methods [ 1.21] 1.21 0.97</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">EQL-SPECIALIZED-FIB [ 0.13] 8.85 8.92</font></div><div><font class="Apple-style-span" face="'courier new', monospace">Reference time in first column is in seconds; other columns are relative</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">Reference implementation: SBCL 1.0.29.11.debian</font></div><div><font class="Apple-style-span" face="'courier new', monospace">Impl ECLx : ECLx 10.4.2</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">Impl ECLo : ECLo 10.4.1</font></div><div><font class="Apple-style-span" face="'courier new', monospace">=== Test machine ===</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace"> Machine-type: X86-64</font></div><div><font class="Apple-style-span" face="'courier new', monospace"> Machine-version: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz</font></div>
<div><br></div>-- <br>Instituto de Física Fundamental, CSIC<br>c/ Serrano, 113b, Madrid 28006 (Spain) <br><a href="http://tream.dreamhosters.com" target="_blank">http://tream.dreamhosters.com</a><br>
</div>