[antlr-interest] ANTLR3ea+ANTLWorks is *really cool*, but how do I insert PythonTokenStream.java

Rodrigo B. de Oliveira rodrigobamboo at gmail.com
Mon Jul 11 14:40:52 PDT 2005


On 7/11/05, Terence Parr <parrt at cs.usfca.edu> wrote:
> 
> On Jul 10, 2005, at 10:49 PM, Elden Crom wrote:
> > Or the like into the token stream to make it Indention Sensitive?
> > (like python http://www.antlr.org/grammar/1078018002577/python.tar.gz)
> 
> Damn good question.  I forgot that the Python crew needs indented
> actions...that sucks.  Hmm...I guess I'll have to look at what they
> did for 2.x and add to 3.x :)
> 

Boo also needs virtual indent/dedent tokens. Our current approach is
to insert a IndentTokenStreamFilter that preprocesses white space
tokens and generates indent/dedent virtual tokens as necessary. Will
this approach still be supported in antlr 3.0?

Rodrigo


More information about the antlr-interest mailing list