What does "tokenization" mean?

The act or process of tokenizing.

What is a synonym for "tokenization"?

Common synonyms include: masking.

noun

noun ·Rare ·Advanced level

Noun

1
The act or process of tokenizing. countable, uncountable
2
Something tokenized. countable, uncountable
"This was an unlikely tokenization of the input string."

"This was an unlikely tokenization of the input string."

From token + -ization.