[antlr-interest] Lexer bug?

Gavin Lambert antlr at mirality.co.nz
Tue Oct 23 04:47:10 PDT 2007


At 13:47 23/10/2007, Clifford Heath wrote:
 >With regard to the suggestions offered, I'm not sure I
 >understand all of them, and if I do, I'm not sure I want
 >to implement that way. For example, it seemed that one
 >suggestion would have it that I should recognize
 >the string "0.12 ..  3.5" as a single token... and I'm
 >*sure* I don't want to do that!

True, although you could combine it with the method shown in the 
wiki regarding how to emit multiple tokens from a single lexer 
rule.  Which admittedly is a little messy too, but that's mostly 
glue code.  Once that's in place the actual procedure is pretty 
straightforward.



More information about the antlr-interest mailing list