[antlr-interest] ANTLR 3 & hidden token management?
David Holroyd
dave at badgers-in-foil.co.uk
Sun Aug 6 13:17:34 PDT 2006
Hi!
On Sun, Aug 06, 2006 at 10:25:11AM -0700, Terence Parr wrote:
> As for trees, I automatically track start/stop token indexes for all
> rule invocations and hence I know the precise range of tokens
> associated with each rule tree construction. This includes all
> hidden channels simply because they are in range. Now, it does *not*
> track whitespace etc... before/after the rule...those will presumably
> be encompassed by other rule's AST construction.
I can see how that would give access to {channel=99} tokens produced by
lexing and parsing. However, I want to be able to insert 'synthetic'
nodes into the AST / token stream, as I'm building an API for
programmatic code generation. For instance, addComment() with ANTLR 2:
http://svn.badgers-in-foil.co.uk/metaas/trunk/src/java/uk/co/badgersinfoil/metaas/impl/ASTStatementList.java
Having to potentially update startIndex/endIndex values in the whole
tree on insertion/deletion sounds a bit hairy. Does this leave me
needing custom, linked-list Tree/Token implementations?
thanks!
dave
--
http://david.holroyd.me.uk/
More information about the antlr-interest
mailing list