[antlr-interest] ANTLR3ea+ANTLWorks is *really cool*, but how do I insert PythonTokenStream.java

Terence Parr parrt at cs.usfca.edu
Mon Jul 11 14:50:05 PDT 2005


On Jul 11, 2005, at 2:40 PM, Rodrigo B. de Oliveira wrote:

> On 7/11/05, Terence Parr <parrt at cs.usfca.edu> wrote:
>
> Boo also needs virtual indent/dedent tokens. Our current approach is
> to insert a IndentTokenStreamFilter that preprocesses white space
> tokens and generates indent/dedent virtual tokens as necessary. Will
> this approach still be supported in antlr 3.0?

Yes, as long as ANTLR's lexer sees imaginary indent/dedent tokens,  
it's cool :)  We'll have to find a way to have this automatically  
detected and added to the input stream.

Ter
--
CS Professor & Grad Director, University of San Francisco
Creator, ANTLR Parser Generator, http://www.antlr.org
Cofounder, http://www.jguru.com



More information about the antlr-interest mailing list