[antlr-interest] Token and EOL

[Sam Barnett-Cormack]

A common way is making the lexer bundle up strings - this means that \n 
doesn't become a whitespace token on a hidden channel until after the 
string has finished.

Put another way, lexer rules see all characters, regardless of any other 
rules saying those get shunted to hidden channel. The hiding only takes 
effect for the parser, not the lexer.

Sam

On 23/11/2011 07:20, Borneq wrote:
> End of Line not ends mutiline comments but in Pascal string literal
> must end at line end. How do it? Strings and \n are in other channel.
> How define in grammar that string must ends at EOL?
>
> List: http://www.antlr.org/mailman/listinfo/antlr-interest
> Unsubscribe: http://www.antlr.org/mailman/options/antlr-interest/your-email-address