Wednesday, February 24, 2016

What Is Tokens


   >>> The Smallest individual units in a program are known as tokens. Tokens ate usually separated by "white space."

   C++ has the following tokens:

    >>> Keywords.
    >>> Identifiers.
    >>> Constants.
    >>> Strings.
    >>> Operators.

  A C++ program is written using tokens, white spaces and the syntax of the language.


    Example:

                  a = i + + + j;

                 The Programmer who wrote the code might have intended either of these two statements:


                a = i + (+ + j)

                a = (i + +) + j