Mistokenize
verb
verb ·Rare ·Advanced level
Definitions
Verb
- 1 To tokenize incorrectly.
"C++ considers ::*, .* and ->* each to be a single token and a single operator. Some pre-Release 2.0 implementations mistokenize expressions involving pointer-to-pointer-to-member."
Example
More examples"C++ considers ::*, .* and ->* each to be a single token and a single operator. Some pre-Release 2.0 implementations mistokenize expressions involving pointer-to-pointer-to-member."
Etymology
From mis- + tokenize.
More for "mistokenize"
Data sourced from Wiktionary, WordNet, CMU, and other open linguistic databases. Updated March 2026.