[antlr-interest] Returning Multiple Tokens

[Ric Klaren]

On Mon, Jul 05, 2004 at 08:23:15PM -0700, Jason wrote:
> Thanks for the code.  I hadn't ever looked at the
> TokenStream interface and didn't realize how simple it
> was.  This is essentially, what I had in mind, but, of
> course, has the practical advantage that I don't have
> to modify the generated code.  Thanks again.

You could btw also come a nice way with subclassing the generated lexer and
overriding nextToken.

Cheers,

Ric
-- 
-----+++++*****************************************************+++++++++-------
    ---- Ric Klaren ----- j.klaren at utwente.nl ----- +31 53 4893755  ----
-----+++++*****************************************************+++++++++-------
  "You know how to use that thing?" [pointing to the sword]
  "Sure.. The pointy end goes into the other guy."
  --- The Mask of Zorro



 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/antlr-interest/

<*> To unsubscribe from this group, send an email to:
    antlr-interest-unsubscribe at yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/