[antlr-interest] Problems with lexing tokens containing blanks
Randall R Schulz
rschulz at sonic.net
Wed Nov 29 13:19:55 PST 2006
Bernd,
On Wednesday 29 November 2006 08:44, Bernd Vogt wrote:
> Hi all,
>
> in my current project I have the requirement to lex some tokens like
> this:
>
> lexer grammar ExampleLexer;
> …
> INDEX : 'index' ;
> INDEX_OF : 'index of' ;
> INT : '0' | '1'..'9' '0'..'9'* ;
>
> ...
>
> How can I do that?
Wouldn't it just be easier to handle this sort of construct at the
parsing level rather than the lexical analysis level?
> Kind regards
> Bernd
Randall Schulz
More information about the antlr-interest
mailing list