[antlr-interest] Geting all tokens from lexer / token stream

Lars von Wedel lars.vonwedel at gmail.com
Wed May 11 04:40:35 PDT 2011


Hello,

I am writing an interactive interpreter and I would like to obtain all
tokens from a lexer of token stream to test, whether the input is complete
or continued on the next line.

What is the easiest approach to do this ? I tried a CommonTokenStream but I
am not sure how to tell it to pull all tokens from the lexer.

Thanks and Regards,
Lars


More information about the antlr-interest mailing list