[antlr-interest] parsing a very large file

Vladimir Konrad vladimir at ok2home.net
Thu Mar 26 15:13:52 PDT 2009


Hello Gavin,

Thank you for the pointers - will dig into it.

> Is there some way you can split up the input externally from ANTLR 
> first?  I've used it before to parse some large data files 
> (~80MB), but they were archive files that contained chunks of 
> about ~500KB each that could be parsed independently of each 
> other, so it was fairly straightforward.

The format is "record" based - a lot of small chunks enclosed
in /begin /end. So I could write a front end which only feeds the
records to ANTLR and parse those there.

Thanks for the hint.

Kind regards,

Vlad


More information about the antlr-interest mailing list