[antlr-interest] Custom Token Types (parallel to ASTLabelType, for lexer)?

[Ric Klaren]

On Wed, Oct 20, 2004 at 04:30:23PM -0400, Bryan Ewbank wrote:
> I've looked at the C++ generator, and it appears that RefToken is hardcoded.
> What I would like to do is extend the Token class to include filename
> information, as well as a symbol table reference, but it doesn't seem to be
> a supported model.
> 
> How do others use symbol tables and/or produce file and line information,
> given that the type returned by the Lexer is hardcoded?

It seems noone reported this in the past years. I ran across it while
tinkering with tokenstream filtering for my preprocessor prototype for the
C++ grammar. A recent snapshot should include fixes to the token classes
that make this possible. The C++ parser with preprocessor prototype has all
the code to do the above and a small patch to 2.7.4 to make it possible
(beware very rough code, read the readme).

http://wwwhome.cs.utwente.nl/~klaren/antlr/CPPParser.tar.bz2

Cheers,

Ric
-- 
-----+++++*****************************************************+++++++++-------
    ---- Ric Klaren ----- j.klaren at utwente.nl ----- +31 53 4893755  ----
-----+++++*****************************************************+++++++++-------
  Quidquid latine dictum sit, altum viditur.
                 (Whatever is said in Latin sounds profound.)



 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/antlr-interest/

<*> To unsubscribe from this group, send an email to:
    antlr-interest-unsubscribe at yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/