[Gsll-devel] unit test, failed assertions

Mon Jan 5 23:00:23 UTC 2015

That's pretty much a normal number of failures, though the execution error
shouldn't happen. The decision on whether to use GSLL is up to you, you
have to evaluate the failures and decide whether they're relevant to your
intended application. Note that most of them are slight numerical
imprecision. The tests aren't perfectly crafted, so they may not actually
be problems at all.

Liam

On Mon, Dec 29, 2014 at 12:05 PM, DJ Penton <djp at arqux.com> wrote:

> I am not sure what to think about assertion failures for gsll. Does this
> mean I should not use gsll? Point me in the direction of the right reading
> material or let me know. I am on Linux Mint 17 64-bit. I ran the tests
> under Clozure version 1.10 64-bit, using slime in gnu emacs 24.3.1. Here is
> what I got:
>
> Unit Test Summary
> | 4007 assertions total
> | 3992 passed
> | 15 failed
> | 1 execution errors
> | 0 missing tests
>
>
> | Failed Form: (MULTIPLE-VALUE-LIST (PASCAL-PDF 5 0.4 12))
> | Expected (0.0056984767089869) but saw (0.005698476708986905)
> |
> | Failed Form: (MULTIPLE-VALUE-LIST (NEGATIVE-BINOMIAL-PDF 5 0.4 12.0))
> | Expected (0.0056984767089869) but saw (0.005698476708986905)
> |
> NEGATIVE-BINOMIAL: 6 assertions passed, 2 failed.
>
> | Failed Form: (MULTIPLE-VALUE-LIST (NONLINEAR-LEAST-SQUARES-EXAMPLE 40
> +LEVENBERG-MARQUARDT+ NIL))
> | Expected ((5.045357801443204 0.10404905892045835 1.0192487061031013))
> | but saw ((5.04535778186662 0.10404905770554014 1.0192487099440282))
> |
> NONLINEAR-LEAST-SQUARES: 0 assertions passed, 1 failed.
>
> | Failed Form: (MULTIPLE-VALUE-LIST (LET ((RNG
> (MAKE-RANDOM-NUMBER-GENERATOR +MT19937+ 0))) (LOOP FOR I FROM 0 TO 10
> COLLECT (SAMPLE RNG :EXPONENTIAL :MU 10.0))))
> | Expected ((0.0025828444588394794 18.145581427987647 12.636598054339759
> 0.5424387252062355 14.624994234158105 7.236607929535993 0.4345362449683603
> 2.95303920904529 6.161052939065796 3.011686333539114 2.7451079819355364))
> | but saw ((82.61578216370394 1.77823538531874 3.3214653339021365
> 29.412645812312775 2.6351843583734817 6.635371453335953 31.57709150859036
> 13.637712930094189 7.766237034468241 13.468928238240315 14.268822088229632))
> |
> EXPONENTIAL: 11 assertions passed, 1 failed.
>
> | Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY
> '(COMPLEX DOUBLE-FLOAT) :DIMENSIONS '3))) (GRID:COPY-TO (SET-ALL V1
> #C(-34.5 8.24)))))
> | Expected (#(#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24)))
> | but saw (#(#C(6.93808738500125E-310 6.93808738500125E-310) #C(0.0 0.0)
> #C(2.2610866479751355E-4 1.9369301518129228E-4)))
> |
> | Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY
> '(COMPLEX SINGLE-FLOAT) :DIMENSIONS '3))) (GRID:COPY-TO (SET-ALL V1
> #C(-34.5S0 8.24S0)))))
> | Expected (#(#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0)))
> | but saw (#(#C(9.860902S-32 4.5816855S-41) #C(9.860902S-32 4.5816855S-41)
> #C(0.0S0 0.0S0)))
> |
> VECTOR-SET-ALL: 10 assertions passed, 2 failed.
>
> | Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-VEGAS-EXAMPLE))
> | Expected (1.3931632739551914 1.4981164744582692E-4)
> | but saw (1.3931632739552706 1.498116474436285E-4)
> |
> | Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-MISER-EXAMPLE))
> | Expected (1.3895297058825096 0.0050106269732269415)
> | but saw (1.3895297058825093 0.005010626973226931)
> |
> | Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-PLAIN-EXAMPLE))
> | Expected (1.4122087033540667 0.013435861456267064)
> | but saw (1.4122087033540713 0.013435861456268945)
> |
> MONTE-CARLO: 0 assertions passed, 3 failed.
>
> | Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY
> '(COMPLEX DOUBLE-FLOAT) :INITIAL-CONTENTS '(#C(-34.5 8.24) #C(3.29 -8.93)
> #C(34.12 -6.15) #C(49.27 -13.49) #C(32.5 42.73) #C(-17.24 43.31) #C(-16.12
> -8.25) #C(21.44 -49.08)))) (SCALAR #C(32.5 42.73))) (GRID:COPY-TO (SCALE
> SCALAR V1))))
> | Expected (#(#C(-1473.3452 -1206.385) #C(488.5039 -149.64329999999998)
> #C(1371.6895 1258.0725999999997) #C(2177.7027 1666.8821)
> #C(-769.6028999999996 2777.45) #C(-2410.9363 670.9098000000001)
> #C(-171.3775 -956.9326) #C(2793.9883999999997 -678.9687999999999)))
> | but saw (#(#C(-34.5 8.24) #C(3.29 -8.93) #C(34.12 -6.15) #C(49.27
> -13.49) #C(32.5 42.73) #C(-17.24 43.31) #C(-16.12 -8.25) #C(21.44 -49.08)))
> |
> | Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY
> '(COMPLEX SINGLE-FLOAT) :INITIAL-CONTENTS '(#C(-34.5S0 8.24S0) #C(3.29S0
> -8.93S0) #C(34.12S0 -6.15S0) #C(49.27S0 -13.49S0) #C(32.5S0 42.73S0)
> #C(-17.24S0 43.31S0) #C(-16.12S0 -8.25S0) #C(21.44S0 -49.08S0)))) (SCALAR
> #C(32.5S0 42.73S0))) (GRID:COPY-TO (SCALE SCALAR V1))))
> | Expected (#(#C(-1473.3452S0 -1206.385S0) #C(488.5039S0 -149.64331S0)
> #C(1371.6895S0 1258.0725S0) #C(2177.7026S0 1666.8821S0) #C(-769.6029S0
> 2777.45S0) #C(-2410.9363S0 670.9099S0) #C(-171.37753S0 -956.9326S0)
> #C(2793.9885S0 -678.9689S0)))
> | but saw (#(#C(-34.5S0 8.24S0) #C(3.29S0 -8.93S0) #C(34.12S0 -6.15S0)
> #C(49.27S0 -13.49S0) #C(32.5S0 42.73S0) #C(-17.24S0 43.31S0) #C(-16.12S0
> -8.25S0) #C(21.44S0 -49.08S0)))
> |
> SCALE: 4 assertions passed, 2 failed.
>
> | Failed Form: (MULTIPLE-VALUE-LIST (INTEGRATION-QAGIU
> (INTEGRATION-TEST-F15 5.0) 0.0 0.0 1.0E-7 1000))
> | Expected (65536.00000000025 7.121667184124547E-4)
> | but saw (65536.00000000025 7.121667220555405E-4)
> |
> NUMERICAL-INTEGRATION: 41 assertions passed, 1 failed.
>
> | Failed Form: (MULTIPLE-VALUE-LIST (LET ((M1 (GRID:MAKE-FOREIGN-ARRAY
> '(COMPLEX DOUBLE-FLOAT) :DIMENSIONS '(3 3)))) (GRID:COPY-TO (SET-ALL M1
> #C(-34.5 8.24)))))
> | Expected (#2A((#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24)) (#C(-34.5
> 8.24) #C(-34.5 8.24) #C(-34.5 8.24)) (#C(-34.5 8.24) #C(-34.5 8.24)
> #C(-34.5 8.24))))
> | but saw (#2A((#C(6.93808738500125E-310 6.93808738500125E-310) #C(0.0
> 0.0) #C(0.0 0.0)) (#C(0.0 0.0) #C(0.0 0.0) #C(0.0 0.0)) (#C(0.0 0.0) #C(0.0
> 0.0) #C(0.0 0.0))))
> |
> | Failed Form: (MULTIPLE-VALUE-LIST (LET ((M1 (GRID:MAKE-FOREIGN-ARRAY
> '(COMPLEX SINGLE-FLOAT) :DIMENSIONS '(3 3)))) (GRID:COPY-TO (SET-ALL M1
> #C(-34.5S0 8.24S0)))))
> | Expected (#2A((#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0))
> (#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0)) (#C(-34.5S0
> 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0))))
> | but saw (#2A((#C(0.0S0 0.0S0) #C(-1.9980458S+7 2.2836375S0)
> #C(-0.24403502S0 1.7918347S0)) (#C(-54862.137S0 2.2802413S0)
> #C(-2.8170395S-11 -2.6114688S0) #C(-1.8720056S+36 2.430557S0))
> (#C(-60954.11S0 -2.0077076S0) #C(-5.3453843S-19 2.1910214S0)
> #C(5.721449S+18 1.6339746S0))))
> |
> MATRIX-SET-ALL: 10 assertions passed, 2 failed.
>
> | Failed Form: (MULTIPLE-VALUE-LIST (COUPLING-3J 0 1 1 0 1 -1))
> | Expected (0.7071067811865475 3.14018491736755E-16)
> | but saw (0.7071067811865476 7.850462293418876E-16)
> |
> COUPLING: 2 assertions passed, 1 failed.
>
> _______________________________________________
> Gsll-devel mailing list
> Gsll-devel at common-lisp.net
> http://mailman.common-lisp.net/cgi-bin/mailman/listinfo/gsll-devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.common-lisp.net/pipermail/gsll-devel/attachments/20150105/a07d4f52/attachment.html>