Hi,
I have a source field "DATA_VALUE" which can have any kind of data i.e. char or number or date.
Iam making a look up with hashed file to get non matching records from source. But look up is NOT matching(even if both records are same) for few records which is having long string approx string length is 2500 characters
Please advice
Thanks,
Santosh
problem in look up when it is long string
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 9
- Joined: Sat Jun 03, 2006 7:06 am
DataStage hashed files have a configurable maximum length; I believe the default value is 768; you can check this value by looking into the uvconfig file or executing the command 'smat -t' from the command line. This would mean that the hashed file keys are truncated to this length, which explains why your match didn't work.
I'd have to check my docs to see what the impact of increasing the MAXKEYSIZE parameter in the uvconfig is - offhand I would guess that the overall impact shouldn't be too great.
I'd have to check my docs to see what the impact of increasing the MAXKEYSIZE parameter in the uvconfig is - offhand I would guess that the overall impact shouldn't be too great.
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Re: problem in look up when it is long string
Since the field can contain any of the metadata like char or number or date, I assume that the datatype of that field is given as char.
So one of the solution is to split this single field to multiple field and mention all these splitted fields as key.
In case of splitting also make sure that while splitting some of the data for that field may be very low so in that case the splitted fields may have null, so for these just assign some default value so that exact match occurs when it is compared with that of the input field. Please check if this could solve your problem.
So one of the solution is to split this single field to multiple field and mention all these splitted fields as key.
In case of splitting also make sure that while splitting some of the data for that field may be very low so in that case the splitted fields may have null, so for these just assign some default value so that exact match occurs when it is compared with that of the input field. Please check if this could solve your problem.
----------------
Abu
Abu
In this case just split that single field into multiple hashed file fields, say have that splitted and stored into 5 hashed file(500 chars in eash hashed file).
Have a condition like if it matches with all the hashed files then True, even if one of the hash file returns as NOTFOUND, then it would mean like the input field column does not match with the looked up data. Please check if this can be done. Arnd, can you advice if this is feasible.
Have a condition like if it matches with all the hashed files then True, even if one of the hash file returns as NOTFOUND, then it would mean like the input field column does not match with the looked up data. Please check if this can be done. Arnd, can you advice if this is feasible.
----------------
Abu
Abu