[antlr-interest] Does the C runtime support token rewrite?

[Kay Röpke]

On Apr 12, 2009, at 5:13 PM, Andy Grove wrote:

> Could you give me some pointers on how to get a version of the token
> stream including whitespace?

are you by any chance discarding the whitespace tokens (and not only  
placing them on a different channel)?
iirc the vector you get by calling getTokens() is the internal one.

i distinctly remember seeing "hidden" tokens in there just a few hours  
ago.

cheers,
-k