[antlr-interest] case sensitivity for ANTLR v3 lexers

[Martin Probst]

Hi,

> If you need a case-insensitive lexer, the end user should implement  
> that by
> overriding an appropriate method in the lexer and use whatever  
> comparison is
> appropriate for their particular needs.  There is no universal  
> upper or
> lower-casing function that is appropriate for every possible  
> locale, so why
> even go down that road?   Keep the core of Antlr simple, and just  
> provide
> extensibility points (with samples) where appropriate.

It depends on how common the case insensitive lexer thing is. I have  
personally never used a case insensitive programming language since  
PASCAL (that was case insensitive, wasn't it?). It should only be an  
option if really a lot of people need it, otherwise allow for the  
overriding, provide a Wiki article and a FAQ entry and that's it.  
Maybe some more detailed Wiki article about using IBM ICU would be  
nice, but not really needed.

Martin