String Tokenizer in Java II

Refer the first post on String Tokenizer here.

Lets play with a little complicated string in this post! This will just demonstrate how you can use Tokenizer in more often encountered string parsing situations.

Lets run....

package org.chandan.string.tokenizer;

import java.util.StringTokenizer;

public class StringTokenizerSample {

/*

* Notice that, first we need to tokenize with respect to ';' as

* delimiter.

* Then on generated tokens, we have to again tokenize

* with '=' as delimiter.

*/

private static final String SAMPLE_STRING_1=

    "name=myName;address=myAddress;phone=myPhone";

private static final String DELIM_EQUAL="=";

private static final String DELIM_SEMICOLON=";";

 

public static void main(String args[])

{

       System.out.println("PROCESSING STRING =     ["+SAMPLE_STRING_1+"]");

       System.out.println("----------------------------------------");

       processString(SAMPLE_STRING_1,DELIM_SEMICOLON,DELIM_EQUAL);

    System.out.println("");

    System.out.println("*********************************************");

}

private static void processString(String sample,String     delimiter1

,String delimiter2)

{

/*

* First tokenize whole string with respect to first delimeter.

* Then iterate over generated tokens to perform further tokenization.

*/

    StringTokenizer stringTokenizer=new    StringTokenizer(sample,delimiter1);

    System.out.println("TOTAL NO OF MAIN TOKENS FOUND: "

   +stringTokenizer.countTokens());

    int tokenCount=1;

   while(stringTokenizer.hasMoreElements())

   {

     String mainToken=stringTokenizer.nextElement().toString();

     System.out.println("");

     System.out.println("MAIN TOKEN["+tokenCount++ +"] -> "

+mainToken);

     System.out.println(".................................");

    StringTokenizer stringTokenizer2=new StringTokenizer(

mainToken,delimiter2);

    System.out.println("");

    System.out.println("TOTAL NO OF SUB TOKENS FOUND: "

    +stringTokenizer2.countTokens());

    int subTokenCount=1;

    while (stringTokenizer2.hasMoreElements())

    {

        System.out.println("SUB TOKEN["+subTokenCount++ +"] -> "

        +stringTokenizer2.nextElement());

     }//END OF INNER WHILE LOOP

   }//END OF OUTER WHILE LOOP

  }//END OF METHOD

}

OUTPUT:

PROCESSING STRING = [name=myName;address=myAddress;phone=myPhone]

----------------------------------------

TOTAL NO OF MAIN TOKENS FOUND: 3

MAIN TOKEN[1] -> name=myName

.................................

TOTAL NO OF SUB TOKENS FOUND: 2

SUB TOKEN[1] -> name

SUB TOKEN[2] -> myName

MAIN TOKEN[2] -> address=myAddress

.................................

TOTAL NO OF SUB TOKENS FOUND: 2

SUB TOKEN[1] -> address

SUB TOKEN[2] -> myAddress

MAIN TOKEN[3] -> phone=myPhone

.................................

TOTAL NO OF SUB TOKENS FOUND: 2

SUB TOKEN[1] -> phone

SUB TOKEN[2] -> myPhone

*********************************************

If you are looking for some tutorials on parsing an xml document, then check HERE.


Happy coding :)



.