[antlr-interest] Token types

[Luke A. Guest]

Hi,

Are token types as defined in Token.java supposed to be a limited set,
i.e. can I define these inside an enumeration or are they allowed to be
extended via subclassing?

I'm considering:

package Token is

   Token_Type is (
     EOF,      -- (-1)
     INVALID,  -- ( 0)
     EOR,      -- ( 1) No idea what this means.
     DOWN,     -- ( 2) Something to do with parse trees?
     UP);      -- ( 3) Something to do with parse trees?

end Token;

Which means that they cannot be extended, and thus I don't actually need
to assign the same values to the enumeration as the Java implementation.

Thanks,
Luke.