[antlr-interest] ANTLR modification

[Ric Klaren]

On 10/22/05, Jim Crafton <jim.crafton at gmail.com> wrote:
> I have made a small modification to the ANTL Token, CommonToken, and
> CharScanner classes. The changes make it possible to for a Token (and
> an AST node as well) to have an offset assigned to it that represents
> the offset from the beginning of the character stream. I have a need
> for this, and I added and thought others might find it useful as well.
>
> The changes include added a virtual getOffset/setOffset method to the
> Token class, and re-implementing these in the CommonToken class. The
> CharScanner class has a new member var "offset" that is initially set
> to 0 in it's constructor(s) and then incremented for each call of the
> consume() method. This is member is then used when the CharScanner
> creates a new Token in the makeToken() method. The Token is then
> assigned this value by calling the Token's setOffset() method.
>
> Would there be any interest in having this merged into the general
> ANTLR codebase? If so, what's the best way to submit this?

I could have a look at it, just send me a diff or the changed files.
Not sure if I'll add it to the custom functionality though. I'd be
interested in changing it into an example though, and see if the
runtime can be modified to accomodate doing this on the 'outside'.

Cheers,

Ric