From ocorrain at gmail.com Mon May 21 20:32:45 2007 From: ocorrain at gmail.com (Tiarnan O'Corrain) Date: Mon, 21 May 2007 21:32:45 +0100 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL Message-ID: Hi-- The flexi-streams test suite is failing on OpenMCL "Version 1.0 (DarwinPPC32)" on Test "hebrew_utf8_lf.txt" (:UTF-8 :EOL-STYLE :LF) [INPUT] --> (:UTF-8 :EOL-STYLE :LF) [OUTPUT]. I think this is also preventing Hunchentoot from working on recent OpenMCL versions Backtrace: 0: (# #) 1: (READ-CHAR #) 2: (CCL::GENERIC-READ-LINE #) 3: (READ-LINE #) 4: (FLEXI-STREAMS-TEST::COPY-STREAM # # # #) 5: (FLEXI-STREAMS-TEST::COPY-FILE #P"home:src;site;flexi-streams-0.11.2;test;hebrew_utf8_lf.txt" # #P"/tmp/flexi-streams-test/hebrew_utf8_lf.txt" # ':OUTPUT ':INPUT) 6: (FLEXI-STREAMS-TEST::COMPARE-FILES "hebrew_utf8_lf.txt" "hebrew_utf8_lf.txt" '((#1="hebrew_utf8_lf.txt" #2=# "hebrew_utf8_cr.txt" #) (#1# #2# "hebrew_utf8_crlf.txt" #) (#1# #2# "hebrew_latin8_lf.txt" #) (#1# #2# "hebrew_latin8_cr.txt" #) ..))) '(#1="hebrew_utf8_lf.txt" ..) 7: (FLEXI-STREAMS-TEST::RUN-TESTS) 8: (CCL::%%BEFORE-AND-AFTER-COMBINED-METHOD-DCODE '(NIL #))> . 5339982)) 9: (CCL::%%STANDARD-COMBINED-METHOD-DCODE '(# #) #) 10: (ASDF:OPERATE 'ASDF:TEST-OP ':FLEXI-STREAMS) 11: (CCL::CALL-CHECK-REGS 'ASDF:OOS) 12: (SWANK::EVAL-REGION "(asdf:oos 'asdf:test-op :flexi-streams) " 'T) 13: (# "(asdf:oos 'asdf:test-op :flexi-streams) ") 14: (SWANK::CALL-WITH-BUFFER-SYNTAX #) 15: (SWANK:LISTENER-EVAL "(asdf:oos 'asdf:test-op :flexi-streams) ") 16: (CCL::CALL-CHECK-REGS 'SWANK:LISTENER-EVAL) 17: (# '(SWANK:LISTENER-EVAL "(asdf:oos 'asdf:test-op :flexi-streams) ") 16 "COMMON-LISP-USER") 18: (# # #) 19: (FUNCALL 'SWANK::EVAL-FOR-EMACS) 20: (#) 21: (# # #) 22: (SWANK::CALL-WITH-REDIRECTED-IO # #) 23: (SWANK::CALL-WITH-CONNECTION # #) 24: (SWANK::HANDLE-REQUEST #) 25: (SWANK::REPL-LOOP 'NIL) 26: (SWANK::CALL-WITH-BINDINGS 'NIL #) 27: (CCL::RUN-PROCESS-INITIAL-FORM '(#) #) 28: (# '(#) 0) 29: (# 788576 #) From edi at agharta.de Mon May 21 20:38:41 2007 From: edi at agharta.de (Edi Weitz) Date: Mon, 21 May 2007 22:38:41 +0200 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: (Tiarnan O'Corrain's message of "Mon, 21 May 2007 21:32:45 +0100") References: Message-ID: On Mon, 21 May 2007 21:32:45 +0100, "Tiarnan O'Corrain" wrote: > The flexi-streams test suite is failing on OpenMCL "Version 1.0 > (DarwinPPC32)" on > > Test "hebrew_utf8_lf.txt" (:UTF-8 :EOL-STYLE :LF) [INPUT] > --> (:UTF-8 :EOL-STYLE :LF) [OUTPUT]. Unfortunately, I don't have a Mac to investigate this, so we'll have to look if someone else wants to try their luck. Do you have at least an error message? > I think this is also preventing Hunchentoot from working on recent > OpenMCL versions Yes, I think so. From ocorrain at gmail.com Mon May 21 21:40:56 2007 From: ocorrain at gmail.com (Tiarnan O'Corrain) Date: Mon, 21 May 2007 22:40:56 +0100 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: References: Message-ID: Hi Edi-- the error message is value 1509 is not of the expected type (UNSIGNED-BYTE 8). [Condition of type TYPE-ERROR] If you'd like me to try anything, or could point to an area of investigation, let me know regards Tiarn?n On 5/21/07, Edi Weitz wrote: > On Mon, 21 May 2007 21:32:45 +0100, "Tiarnan O'Corrain" wrote: > > > The flexi-streams test suite is failing on OpenMCL "Version 1.0 > > (DarwinPPC32)" on > > > > Test "hebrew_utf8_lf.txt" (:UTF-8 :EOL-STYLE :LF) [INPUT] > > --> (:UTF-8 :EOL-STYLE :LF) [OUTPUT]. > > Unfortunately, I don't have a Mac to investigate this, so we'll have > to look if someone else wants to try their luck. Do you have at least > an error message? > > > I think this is also preventing Hunchentoot from working on recent > > OpenMCL versions > > Yes, I think so. > _______________________________________________ > flexi-streams-devel mailing list > flexi-streams-devel at common-lisp.net > http://common-lisp.net/cgi-bin/mailman/listinfo/flexi-streams-devel > From edi at agharta.de Tue May 22 06:38:24 2007 From: edi at agharta.de (Edi Weitz) Date: Tue, 22 May 2007 08:38:24 +0200 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: (Tiarnan O'Corrain's message of "Mon, 21 May 2007 22:40:56 +0100") References: Message-ID: On Mon, 21 May 2007 22:40:56 +0100, "Tiarnan O'Corrain" wrote: > the error message is > > value 1509 is not of the expected type (UNSIGNED-BYTE 8). > [Condition of type TYPE-ERROR] > > If you'd like me to try anything, or could point to an area of > investigation, let me know Hmm, and this happens in the STREAM-READ-CHAR method? Could you try to figure out what part of the program generates the 1509? From ocorrain at gmail.com Tue May 22 18:13:10 2007 From: ocorrain at gmail.com (Tiarnan O'Corrain) Date: Tue, 22 May 2007 19:13:10 +0100 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: References: Message-ID: Hi Edi-- the SLIME inspector gives me this for the flexi-stream, and 1509=0x05e5 which is "HEBREW LETTER FINAL TSADI". It looks like OpenMCL is attempting to read unicode rather than raw bytes. Hmm... An object. [type: FLEXI-STREAMS::FLEXI-UTF-8-INPUT-STREAM] -------------------- Class: # -------------------- All Slots: CLOSED = NIL [set value] [make unbound] DIRECTION = :INPUT [set value] [make unbound] ELEMENT-TYPE = CHARACTER [set value] [make unbound] EXTERNAL-FORMAT = # [set value] [make unbound] LAST-CHAR-CODE = 1509 [set value] [make unbound] LAST-OCTET = NIL [set value] [make unbound] OCTET-STACK = NIL [set value] [make unbound] POSITION = 3 [set value] [make unbound] SHARED-RESOURCE = NIL [set value] [make unbound] STREAM = # [set value] [make unbound] regards Tiarn?n From edi at agharta.de Tue May 22 20:25:57 2007 From: edi at agharta.de (Edi Weitz) Date: Tue, 22 May 2007 22:25:57 +0200 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: (Tiarnan O'Corrain's message of "Tue, 22 May 2007 19:13:10 +0100") References: Message-ID: On Tue, 22 May 2007 19:13:10 +0100, "Tiarnan O'Corrain" wrote: > the SLIME inspector gives me this for the flexi-stream, and > 1509=0x05e5 which is "HEBREW LETTER FINAL TSADI". It looks like > OpenMCL is attempting to read unicode rather than raw bytes. Hmm... > > An object. > [type: FLEXI-STREAMS::FLEXI-UTF-8-INPUT-STREAM] > -------------------- > Class: # > -------------------- > All Slots: > CLOSED = NIL [set value] [make unbound] > DIRECTION = :INPUT [set value] [make unbound] > ELEMENT-TYPE = CHARACTER [set value] [make unbound] > EXTERNAL-FORMAT = # > [set value] [make unbound] > LAST-CHAR-CODE = 1509 [set value] [make unbound] > LAST-OCTET = NIL [set value] [make unbound] > OCTET-STACK = NIL [set value] [make unbound] > POSITION = 3 [set value] [make unbound] > SHARED-RESOURCE = NIL [set value] [make unbound] > STREAM = # ("home:src;site;flexi-streams-0.11.2;test;hebrew_utf8_lf.txt"/8) > #x856FC86> [set value] [make unbound] Very strange. Could you confirm in the inspector that the underlying stream is really a binary stream with element type (UNSIGNED-BYTE 8)? And (using the debugger - I think, IIRC, you press v on the top frame) could you try to find the exact place where the error occurs? Thanks, Edi. From ocorrain at gmail.com Tue May 22 21:22:13 2007 From: ocorrain at gmail.com (Tiarnan O'Corrain) Date: Tue, 22 May 2007 22:22:13 +0100 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: References: Message-ID: Hi-- > Very strange. Could you confirm in the inspector that the underlying > stream is really a binary stream with element type (UNSIGNED-BYTE 8)? Here's the description of the underlying stream from the slime inspector -- I can't inspect this stream itself in slime... # Class: # Wrapper: # Instance slots CCL::DIRECTION: :INPUT CCL::CLOSED: NIL CCL::SHARED-RESOURCE: NIL CCL::IOBLOCK: #S(CCL::FILE-IOBLOCK :STREAM # :UNTYI-CHAR NIL :INBUF # :OUTBUF NIL :ELEMENT-TYPE (INTEGER 0 255) :ELEMENT-SHIFT 0 :CHARPOS 0 :DEVICE 10 :ADVANCE-FUNCTION CCL::INPUT-FILE-IOBLOCK-ADVANCE ..) CCL::ELEMENT-TYPE: (INTEGER 0 255) CCL::FILENAME: "home:src;site;flexi-streams-0.11.2;test;hebrew_utf8_lf.txt" CCL::ACTUAL-FILENAME: NIL CCL::EXTERNAL-FORMAT: :BINARY > And (using the debugger - I think, IIRC, you press v on the top frame) > could you try to find the exact place where the error occurs? the error is occurring in input.lisp, when stream-read-char is called from compare-files in test.lisp. regards Tiarn?n From edi at agharta.de Tue May 22 22:25:17 2007 From: edi at agharta.de (Edi Weitz) Date: Wed, 23 May 2007 00:25:17 +0200 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: (Tiarnan O'Corrain's message of "Tue, 22 May 2007 22:22:13 +0100") References: Message-ID: On Tue, 22 May 2007 22:22:13 +0100, "Tiarnan O'Corrain" wrote: > Here's the description of the underlying stream from the slime > inspector -- I can't inspect this stream itself in slime... That looks correct. >> And (using the debugger - I think, IIRC, you press v on the top >> frame) could you try to find the exact place where the error >> occurs? > > the error is occurring in input.lisp, when stream-read-char is > called from compare-files in test.lisp. No, I meant where /in/ STREAM-READ-CHAR. Doesn't SLIME locate a particular form in the function's definition? (Maybe it can't due to the macrology, dunno.) Thanks, Edi. From edi at agharta.de Wed May 23 09:49:16 2007 From: edi at agharta.de (Edi Weitz) Date: Wed, 23 May 2007 11:49:16 +0200 Subject: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: (Tiarnan O'Corrain's message of "Mon, 21 May 2007 21:32:45 +0100") References: Message-ID: On Mon, 21 May 2007 21:32:45 +0100, "Tiarnan O'Corrain" wrote: > The flexi-streams test suite is failing on OpenMCL "Version 1.0 > (DarwinPPC32)" on > > Test "hebrew_utf8_lf.txt" (:UTF-8 :EOL-STYLE :LF) [INPUT] > --> (:UTF-8 :EOL-STYLE :LF) [OUTPUT]. FWIW, I just borrowed my wife's iBook (PPC, OS X 10.3) for a couple of minutes and tried with OpenMCL Version 1.1 Prerelease 070512 (PPC-32). The test suite ran without problems for me. Could you check if it works for you as well? > I think this is also preventing Hunchentoot from working on recent > OpenMCL versions In the meantime, I've come to think this is another issue. I also had the problems others reported and the error message was something about some stream being "private" to some process. But I don't have enough time to dig into this, so if nobody steps up to resolve the issues with OpenMCL, I'll remove OpenMCL support from Hunchentoot for now. From ocorrain at gmail.com Wed May 23 10:12:36 2007 From: ocorrain at gmail.com (Tiarnan O'Corrain) Date: Wed, 23 May 2007 11:12:36 +0100 Subject: [hunchentoot-devel] Re: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: References: Message-ID: Hi Edi-- > I don't have enough > time to dig into this, so if nobody steps up to resolve the issues >with OpenMCL, I'll remove OpenMCL support from Hunchentoot for now. The nuclear option? I recall hunchentoot working on OpenMCL a few months ago -- I was using it for some development (deployment to be on FreeBSD/cmucl), without any problems. Then the Mac got sick for a while, and when I got it back, hunchentoot was broken. The unfortunate upshot of this (for me, at least), is that hunchentoot will no longer be deployable on a free Mac lisp, as SBCL/Mac doesn't have threading, and CMUCL/Mac is missing the multiprocessing package. I'll try it out on the version you suggested later on today -- I'm using Mac OS X 10.4, so perhaps that has something to do with it. Another possibility would be to ask Gary Byers on the OpenMCL mailing list -- I'll do that when I get a chance to look at the problem in more detail. Thanks, Tiarn?n From edi at agharta.de Wed May 23 14:19:50 2007 From: edi at agharta.de (Edi Weitz) Date: Wed, 23 May 2007 16:19:50 +0200 Subject: [hunchentoot-devel] Re: [flexi-streams-devel] Flexi-streams test suite failing on OpenMCL In-Reply-To: (Tiarnan O'Corrain's message of "Wed, 23 May 2007 11:12:36 +0100") References: Message-ID: On Wed, 23 May 2007 11:12:36 +0100, "Tiarnan O'Corrain" wrote: > The nuclear option? Yes. I don't necessarily /want/ to do that, but I can't test and maintain an OpenMCL version, so we either need someone who takes care of that or we'd better be honest and don't purport to support OpenMCL. > I recall hunchentoot working on OpenMCL a few months ago -- I was > using it for some development (deployment to be on FreeBSD/cmucl), > without any problems. Then the Mac got sick for a while, and when I > got it back, hunchentoot was broken. Are you still using the same OpenMCL version you used at that time? > I'll try it out on the version you suggested later on today -- I'm > using Mac OS X 10.4, so perhaps that has something to do with it. > Another possibility would be to ask Gary Byers on the OpenMCL > mailing list -- I'll do that when I get a chance to look at the > problem in more detail. OK, I'll wait for that.