[antlr-interest] unicode 16bit versus new 21bit stuff

[John D. Mitchell]

>>>>> "Terence" == Terence Parr <parrt at cs.usfca.edu> writes:
>>>>>> On Jun 20, 2004, at 11:37 AM, John D. Mitchell writes:
[...]

>> Hmm... Is my senility setting in?  I thought I recalled that you had
>> some reason you needed them separated?

>> If not then rock on.

> Well, they are still separated by < or > operator.  For a second there, I
> thought I was masking out the upper 16 bits and then treating as a short
> 11-bit int, but I'm not.  I'm doing a simple comparison,

Cool.

> which leaves like 2^11 * unicode-size token types. :)

So you can e.g., fold the channels into that large space.

Have fun,
	John


 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
     http://groups.yahoo.com/group/antlr-interest/

<*> To unsubscribe from this group, send an email to:
     antlr-interest-unsubscribe at yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
     http://docs.yahoo.com/info/terms/