[antlr-interest] unicode 16bit versus new 21bit stuff

John D. Mitchell johnm-antlr at non.net
Sun Jun 20 12:15:30 PDT 2004


>>>>> "Terence" == Terence Parr <parrt at cs.usfca.edu> writes:
>>>>>> On Jun 20, 2004, at 11:49 AM, John D. Mitchell writes:
[...]

>> What does that mean?  That there wouldn't be any, independent lexer?
>> Or are you talking about some sort of coordination between the lexer and
>> the parser?

> I'm not sure...my intuition says there is something there.  For sure, I'm
> ultimately going to have a context-sensitive lexer where it is
> goal-oriented unlike existing lexers.  I.e., if your parser can match
> either an INT or a SEMI at a spot, it asks the lexer to match one of
> those two only--not the entire possible set.

Ah, I see.  So rather than having a passive lexer eating input and
providing it to the parser, the lexer is actually directed by the parser.

Go wild,
	John


 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
     http://groups.yahoo.com/group/antlr-interest/

<*> To unsubscribe from this group, send an email to:
     antlr-interest-unsubscribe at yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
     http://docs.yahoo.com/info/terms/
 



More information about the antlr-interest mailing list