[antlr-interest] Encoding of grammar files

Johannes Luber jaluber at gmx.de
Sun Jun 29 08:58:17 PDT 2008


Петров Александр schrieb:
> Hello,
> 
> I want to add comments in my grammar files (.g) in Russian.
> 
> But it's seems to me, that antlr 3.0.1 have never been in the country
> of vodka and bears :)
> 
> grammar test;
> 
> options{ output = AST; ASTLabelType=CommonTree; language = CSharp; }
> 
> //Привет всем! -- Comment in Russian
> program : 'program';
> 
>> java -classpath "D:\antlr\antlr-3.0.1\lib\antlr-2.7.7.jar;D:\antlr\antlr-3.0
> .1\lib\antlr-3.0.1.jar;D:\antlr\antlr-3.0.1\lib\antlr-runtime-3.0.1.jar;D:\antlr
> \antlr-3.0.1\lib\stringtemplate-3.1b1.jar;" org.antlr.Tool test.g
> 
> ANTLR Parser Generator  Version 3.0.1 (August 13, 2007)  1989-2007
> error(10):  internal error: test.g : test.g:10:3: unexpected char: 0x41F
> org.antlr.tool.ANTLRLexer.nextToken(ANTLRLexer.java:321)
> antlr.TokenStreamRewriteEngine.nextToken(TokenStreamRewriteEngine.java:161)
> antlr.TokenBuffer.fill(TokenBuffer.java:69)
> antlr.TokenBuffer.LA(TokenBuffer.java:80)
> antlr.LLkParser.LA(LLkParser.java:52)
> org.antlr.tool.ANTLRParser.grammar(ANTLRParser.java:338)
> org.antlr.tool.Grammar.setGrammarContent(Grammar.java:521)
> org.antlr.tool.Grammar.<init>(Grammar.java:456)
> org.antlr.Tool.getGrammar(Tool.java:331)
> org.antlr.Tool.process(Tool.java:267)
> org.antlr.Tool.main(Tool.java:70)
> 
> How to change the encoding of input .g-files and tell antlr about it ?
> Thank you,
> Petrov Alexander

Currently ANTLR is implemented in ANTLR 2.7.7 which doesn't accept 
anything beyound ASCII. Until ANTLR has been bootstrapped there is no 
way to avoid this issue.

Johannes


More information about the antlr-interest mailing list