0

what are c++ tokens

20th Jun 2016, 4:27 PM
s.imtiyaz fazal
s.imtiyaz fazal - avatar
3 ответов
+ 4
tokens are the smallest elements of the program ->tokens are of 5 types * keywords *identifiers *constants *operators *special characters
22nd Jun 2016, 3:13 PM
Lovish Sharma
Lovish Sharma - avatar
+ 1
Hi fazal, "C++ tokens" refers to words in the C++ language. "Token" is the word used in compiler theory and especially in context of parsers that refers to an element of the language that makes sense. This can be a type, a name of a variable or a class, the plus sign and many, many others.
20th Jun 2016, 5:48 PM
Stefan
Stefan - avatar
+ 1
c++ tokens are literals such as integer string boolean character
20th Jun 2016, 7:03 PM
Abhinav Kumar
Abhinav Kumar - avatar