Invalid Syntax in Tensorflow Docs, Tokenizing with TF Text

Syntax error with classes having @abstractmethod.


Those are not code blocks. All those interfaces are used for tokenization and detokenization of text. They provide methods for splitting the text into tokens, getting byte offsets and assembling the tokens back into the original text.

Thank you!