[antlr-interest] "Tokens"

[Johannes Luber]

Steve Bennett wrote:
> On 11/18/07, Johannes Luber <jaluber at gmx.de> wrote:
> Thanks for that explanation. I guess it would probably be preferable
> to do something like this:
> 
> minus: '-';
> hyphen: '-';

Not with the lowercase names though. ;)

> so that you can refer to the same token by either name without
> stuffing anything else up.
> 
> Incidentally, is there a way to visualise the tokenisation in
> ANTLRWorks? I seem to have so many problems with tokens, it would be
> great to just see the definitive list of how everything has been
> broken up. I guess it shouldn't be too hard for me to just add a dump
>>from the TokenStream in my java test rig, too...

AFAIK, there is no way. Not that it would be usable for other targets
than Java, thus limiting the usefulness - unless remote debugging would
support it.

Johannes