[antlr-interest] Transforming Comments along with trees

[dsfsdf fdsfdsf]

Hi
What do you mean by the tree input output thing?
I have been transforming my Source Tree and the comments do
not appear to have been automatically brought acorss.
My code is something like this.
 
ASTPass1.setLocalIntelligence(li);
        ASTPass1.setASTNodeClass("antlr.CommonASTWithHiddenTokens");
        ASTPass1.select(sourceASTAnalyzer.getAST());
        t = (CommonASTWithHiddenTokens) ASTPass1.getAST();
showTree(t,"first pass")
 
In my ASTPass.g file will i have to handle comments manualy there?
thanks
ed
Terence Parr <parrt at cs.usfca.edu> wrote:


On Nov 11, 2004, at 3:13 AM, dsfsdf fdsfdsf wrote:

> ya i have seen the TokenStreamRewriteEngine doc on the website, i feel 
> it would be a bit complicated to implement as the input could be huge,

Bigger than virtual memory? ;)

> and it doesn't show how to handle comments,

They just work. You get the whole stream of tokens but the parser 
ignores comments. You do cut/paste operations to the buffer then say 
toString() and it comes back out with you rewrites. no fuss, no muss!

> besides i'm not too comfortable with it.

why not?

> As for the latter question, after each pass i generate a new tree.
> Should these passes automatically bring across the hidden tokens?
> how? why not?

If you're doing tree rewrites, then yes, they have to come along. The 
tree input->output thing should copy that stuff automatically I think.

> And how do i output these hidden tokens after all my transformations 
> are complete?

Do a tree walk and spit them out as you spit the other stuff out.

Ter

> thanks
> ed 
>
> Terence Parr 
wrote:
>
>
> On Nov 10, 2004, at 4:22 AM, dsfsdf fdsfdsf wrote:
>
> > Hi
> > I am building a parser that will convert a piece of t-slq to the
> > corresponding p-sql. I am using a TokenStreamHiddenTokenFilter to
> > ignore but preserve comments and builld up my source ast tree!
> > I than plan to do maybe one or to pass transformations to the tree!
> > However i am stuck on how to bring across my comments after each
> > transformations!
> > I would greatly appreciate any ideas on how this can be done!
>
> Hi. First, given the similarity of source / target languages, you
> might want to use TokenStreamRewriteEngine instead. have you seen that
> article on the site?
>
> For the above, are you saying that the auto construction of trees in
> the tree walker doesn't carry along the hidden stream stuff?
>
> Ter
> --
> CS Professor &am p; Grad Director, University of San Francisco
> Creator, ANTLR Parser Generator, http://www.antlr.org
> Cofounder, http://www.jguru.com
> Cofounder, http://www.knowspam.net enjoy email again!
>
>
>
>
>
>
> Yahoo! Groups Links
>
>
>
>
>
>
>
>
> ALL-NEW Yahoo! Messenger - all new features - even more fun!
>
> Yahoo! Groups Links
>
> • To visit your group on the web, go to:
> http://groups.yahoo.com/group/antlr-interest/
>  
> • To unsubscribe from this group, send an email to:
> antlr-interest-unsubscribe at yahoogroups.com
>  
> • Your use of Yahoo! Groups is subject to the Yahoo! Terms of 
> Service.
>
> 





Yahoo! Groups Links








		
---------------------------------
 ALL-NEW Yahoo! Messenger - all new features - even more fun!  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.antlr.org/pipermail/antlr-interest/attachments/20041112/a89f729d/attachment.html