[antlr-interest] Problems with lexing tokens containing blanks

Randall R Schulz rschulz at sonic.net
Wed Nov 29 13:19:55 PST 2006


Bernd,

On Wednesday 29 November 2006 08:44, Bernd Vogt wrote:
> Hi all,
>
> in my current project I have the requirement to lex some tokens like
> this:
>
> lexer grammar ExampleLexer;
>> INDEX : 'index' ;
> INDEX_OF : 'index of' ;
> INT : '0' | '1'..'9' '0'..'9'* ;
>
> ...
>
> How can I do that?

Wouldn't it just be easier to handle this sort of construct at the 
parsing level rather than the lexical analysis level?


> Kind regards
> Bernd


Randall Schulz


More information about the antlr-interest mailing list