Mistokenize

verb

verb ·Rare ·Advanced level

Definitions

Verb
  1. 1
    To tokenize incorrectly.

    "C++ considers ::*, .* and ->* each to be a single token and a single operator. Some pre-Release 2.0 implementations mistokenize expressions involving pointer-to-pointer-to-member."

Example

More examples

"C++ considers ::*, .* and ->* each to be a single token and a single operator. Some pre-Release 2.0 implementations mistokenize expressions involving pointer-to-pointer-to-member."

Etymology

From mis- + tokenize.

Data sourced from Wiktionary, WordNet, CMU, and other open linguistic databases. Updated March 2026.