News

tokenize-rt adds ESCAPED_NL for a backslash-escaped newline "token"; tokenize-rt adds UNIMPORTANT_WS for whitespace (discarded in tokenize); tokenize-rt normalizes string prefixes, even if they are ...
tokenize-rt adds ESCAPED_NL for a backslash-escaped newline "token"; tokenize-rt adds UNIMPORTANT_WS for whitespace (discarded in tokenize); tokenize-rt normalizes string prefixes, even if they are ...