If you are using characters other than whitespaces as delimiters, you will probably want to trim the string before tokenizing; otherwise, the leading and/or following whitespaces will become part of the first and/or last token.

Question

Quizplus · Accepted Answer

Trimming a string before tokenizing removes leading and trailing whitespaces, ensuring they do not become part of the first and last tokens when using non-whitespace delimiters.

If You Are Using Characters Other Than Whitespaces as Delimiters