Sonoma State University
Department of Computer Science
CS-460: Programming Languages
Exercise 2a: Tokenization

Objective:

In a team of three or four students, list the tokens and token type (e.g. String, Integer, Right Parenthesis, etc.) which comprise the program below. The program below is defined by the ChagaLite programming programming language.

How do I know what a token is?

Please use the document, Definitions for tokens in Backus-Naur Form.

Please use the following program to identify and label tokens:

procedure main (void)
{
  int counter;
  int state;

  counter = 1;
  while (counter <= 100)
  {
    state = 0;
    if ((counter % 3) == 0)
    {
      state = 1;
    }
    if ((counter % 5) == 0)
    {
      state = state * 2 + 2;
    }
    if (state == 1)
    {
      printf ("Fizz");
    }
    else
    {
      if (state == 2)
      {
        printf ("Buzz");
      }
      else
      {
        if (state == 4)
        {
          printf ("Fizzbuzz");
        }
        else
        {
          printf ("%d", counter);
        }
      }
    }
    counter = counter + 1;
    if (counter <= 100)
    {
      printf (", ");
    }
    else
    {
      printf ("\n");
    }
  }
}

Submission Instructions:

Since this is a group assignment, please write the names of each member of the team student on your assignment submission along with "Exercise 2a: Tokenization".

Exercise 2a Rubric

CRITERIA RATINGS POINTS
Tokenization Proficient
10 points
A partial or complete list of tokens is labeled and identified which are relevant to the assignment guidelines above.		 Below Expectation
0 points
No solution submitted.		 10 points
Total points: 10