Tokenize
//ˈtoʊ.kən.aɪz// verb
verb ·Rare ·Advanced level
Definitions
Verb
- 1 To reduce to a token or set of tokens by lexical analysis. transitive
- 2 To substitute sensitive data with meaningless placeholders. transitive
- 3 To treat as a token minority. transitive
Etymology
From token + -ize.
More for "tokenize"
Data sourced from Wiktionary, WordNet, CMU, and other open linguistic databases. Updated March 2026.