Hi All,
how many tokens exist in the address field.
Thanks in Advance
how many tokens exist in the address field
-
mallikharjuna
- Participant
- Posts: 81
- Joined: Thu Nov 30, 2006 7:46 am
- Location: india
how many tokens exist in the address field
Last edited by mallikharjuna on Sat Mar 27, 2010 1:52 pm, edited 2 times in total.
MALLI
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
No idea until you explain what you mean by "tokens" and "address".
If I may guess that you mean "how many tokens exist in the address field" then, yes, a Word investigation using an address rule set will yield patterns. The number of characters in the pattern is the number of parsed tokens in the address field.
If I may guess that you mean "how many tokens exist in the address field" then, yes, a Word investigation using an address rule set will yield patterns. The number of characters in the pattern is the number of parsed tokens in the address field.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
mallikharjuna
- Participant
- Posts: 81
- Joined: Thu Nov 30, 2006 7:46 am
- Location: india
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
That's what I thought you meant, and why I answered that particular question.
To read the entirety of that answer you will need to get yourself a premium membership. Premium membership is one of the ways that the hosting and bandwidth costs of DSXchange (which you will notice carries no advertising) are defrayed.
To read the entirety of that answer you will need to get yourself a premium membership. Premium membership is one of the ways that the hosting and bandwidth costs of DSXchange (which you will notice carries no advertising) are defrayed.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
JoshGeorge
- Participant
- Posts: 612
- Joined: Thu May 03, 2007 4:59 am
- Location: Melbourne
Have a look at STRIPLIST and SEPLIST in the rule set you are going to use in word investigation. Any character that is in both lists separates tokens in a given string.
mallikharjuna wrote:Yes Ray you are correct. my question is "how many tokens exist in the address field"
Joshy George
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
<a href="http://www.linkedin.com/in/joshygeorge1" ><img src="http://www.linkedin.com/img/webpromo/bt ... _80x15.gif" width="80" height="15" border="0"></a>
-
stuartjvnorton
- Participant
- Posts: 527
- Joined: Thu Apr 19, 2007 1:25 am
- Location: Melbourne
As JoshGeorge says, look at the sep and strip lists.JoshGeorge wrote:Have a look at STRIPLIST and SEPLIST in the rule set you are going to use in word investigation. Any character that is in both lists separates tokens in a given string.
mallikharjuna wrote:Yes Ray you are correct. my question is "how many tokens exist in the address field"
If a character is in the seplist, it will split a token into separate tokens.
If it is in the striplist, it will remove it from the text completely.
If it is in both, it will separate the text and then be removed.
eg:
Original Text: 14/25
Seplist:
Striplist:
Result: 14/25
Tokens: 1
Seplist: /
Striplist:
Result: 14 / 25
Tokens: 3
Seplist:
Striplist: /
Result: 1425
Tokens: 1
Seplist: /
Striplist: /
Result: 14 25
Tokens: 2
Hope this helps.