[antlr-interest] Adding imaginary tokens to the TokenStream in the parser?

[Gavin Lambert]

At 12:44 30/07/2007, Susan Jolly wrote:
 >Is there some reason not to have the parser add imaginary tokens 
to
 >the TokenStream?

Assuming you meant 'lexer' instead of 'parser', then I don't think 
so, except that by definition (at least my definition), if a lexer 
outputs tokens then they're not imaginary any more :)