[antlr-interest] Looking for reference to how ANTLR performs Lexing....

[Loring Craymer]

All of the lexer rules appear as alternatives (in order of definition) in a synthesized top-level Tokens rule; lexers do not use FOLLOW sets, and this sometimes causes problems.

--Loring


>
>From: "Sylvain, Gregory [USA]" <sylvain_gregory at bah.com>
>To: "antlr-interest at antlr.org" <antlr-interest at antlr.org>
>Sent: Thursday, September 10, 2009 11:02:22 AM
>Subject: [antlr-interest] Looking for reference to how ANTLR performs Lexing....
>
>
>Hello 
>all,
> 
>I have a bunch of 
>questions about how ANTLR (v3) is lexing it's input stream.  I am 
>continually chasing bugs about how ANTLR lexed some text as one token when I was 
>expecting it to Lex it as another token.
> 
>I've checked out 
>this list and elsewhere on the ANTLR.org site for references to lexical analysis 
>and how ANTLR is doing it, but I have not found much.  
> 
>Specifically, I am 
>trying to understand the order of evaluation of the lexer rules and how ANTLR 
>combines them in order complete the analysis of it's given 
>input.
> 
>Thanks in advance 
>for any clues or references.
>Greg
> 


      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.antlr.org/pipermail/antlr-interest/attachments/20090910/65ca993d/attachment.html