[antlr-interest] Binary data

[joel at mentics.com]

I have data that is mixed text and binary, so it might have a text
field followed by a binary encoded number--2 bytes or something. Is
this something ANTLR can handle? How do I define binary tokens for the
lexer? Is there something where I can tell it to read a certain number
of bytes, or until a certain byte delimiter (that might be different
than the overall encoding--so even if in 2 byte char stream, look for a single
byte delimiter)?

Thanks!