Hi,
Is it always clear cut whether to call something a token or make it part
of grammar.
For example, suppose we are parsing TeX and a command is something that
looks like this:
\name{stuff}
Should "command" be in the lexer section or grammar section?
Sorry for such a vague question, but I am just starting out...
Thanks!
PG