[antlr-interest] Encoding of grammar files
Johannes Luber
jaluber at gmx.de
Sun Jun 29 08:58:17 PDT 2008
Петров Александр schrieb:
> Hello,
>
> I want to add comments in my grammar files (.g) in Russian.
>
> But it's seems to me, that antlr 3.0.1 have never been in the country
> of vodka and bears :)
>
> grammar test;
>
> options{ output = AST; ASTLabelType=CommonTree; language = CSharp; }
>
> //Привет всем! -- Comment in Russian
> program : 'program';
>
>> java -classpath "D:\antlr\antlr-3.0.1\lib\antlr-2.7.7.jar;D:\antlr\antlr-3.0
> .1\lib\antlr-3.0.1.jar;D:\antlr\antlr-3.0.1\lib\antlr-runtime-3.0.1.jar;D:\antlr
> \antlr-3.0.1\lib\stringtemplate-3.1b1.jar;" org.antlr.Tool test.g
>
> ANTLR Parser Generator Version 3.0.1 (August 13, 2007) 1989-2007
> error(10): internal error: test.g : test.g:10:3: unexpected char: 0x41F
> org.antlr.tool.ANTLRLexer.nextToken(ANTLRLexer.java:321)
> antlr.TokenStreamRewriteEngine.nextToken(TokenStreamRewriteEngine.java:161)
> antlr.TokenBuffer.fill(TokenBuffer.java:69)
> antlr.TokenBuffer.LA(TokenBuffer.java:80)
> antlr.LLkParser.LA(LLkParser.java:52)
> org.antlr.tool.ANTLRParser.grammar(ANTLRParser.java:338)
> org.antlr.tool.Grammar.setGrammarContent(Grammar.java:521)
> org.antlr.tool.Grammar.<init>(Grammar.java:456)
> org.antlr.Tool.getGrammar(Tool.java:331)
> org.antlr.Tool.process(Tool.java:267)
> org.antlr.Tool.main(Tool.java:70)
>
> How to change the encoding of input .g-files and tell antlr about it ?
> Thank you,
> Petrov Alexander
Currently ANTLR is implemented in ANTLR 2.7.7 which doesn't accept
anything beyound ASCII. Until ANTLR has been bootstrapped there is no
way to avoid this issue.
Johannes
More information about the antlr-interest
mailing list