lexeme

A minimal lexical unit of a language. Lexical analysis converts strings in a language into a list of lexemes. For a programming language these word-like pieces would include keywords, identifiers, literals and punctuation. The lexemes are then passed to the parser for syntactic analysis.