[Langutils-devel] Period not correctly tokenized?

[Jianshi Huang]

Hey Kevin,

On Fri, Oct 7, 2011 at 2:57 PM, Jianshi Huang <jianshi.huang at gmail.com> wrote:
> Currently it works for me, but I'm not sure whether it will break
> something else...
>
> There must be a reason for not including #\. in the punctuation type.
>
> Anyway, here's the patch for git.
>

I messed up your repository with eslick's cl-langutils. LOL

So here's the patch for your langutils.


-- 
黄　澗石 (Jianshi Huang)
http://huangjs.net/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 0001-Fix-tokenization-for-sentence-ending-periods.patch
Type: text/x-patch
Size: 936 bytes
Desc: not available
URL: <https://mailman.common-lisp.net/pipermail/langutils-devel/attachments/20111011/b163357a/attachment.bin>