DSXchange

I think that this is not the way actually the job would work. Even though link ordering is mentioned in the transformer. Its not like, first all the records of the first link would be loaded into the hash file followed by the second and the third. Based on the input the loading process would differ....

You are welcome

Replacing IPC stage with transformer improves the performance.
But if the records involved is very high, then it will result in abort of the job. I have heard about such problems which my friends encountered.

I agree that its not a good way. But the requirement he specified is that he needs to do that in a single job. If sequencer is to be used then the job should be split into two. So I could'nt get any other solution other than trying this one. If what I have mentioned is a very bad suggetion, then ple...

I forgot to mention this in my previous post.
Since the hash file has Id as key, so the previous "Y" for 1 & 2 will be overwritten by "N" when the duplicates come. So the hash file would have only the content that I have mentioned.

Have I cleared your doubt.

I think you have not understood my solution properly. If you see my previous reply. I have mentioned that the hash file would have like Id Flag 1 N 2 N 3 Y 4 Y If you are getting these values in your hash file. Then it means that Id's having 1 & 2 have duplicates and 3 & 4 are unique records...

There is two different flow in a single job. One flow is populating to the parent table. Second flow is populating to the child table. I want to execute the parent flow first and then the child flow. src->tfm->parent table scr->tfm->child table Please suggest. If you can change the job, then do thi...

Have a job like this 1) Dummy-File ---------->Hashed File(Just create empty hash file - H1) ...................................... ^ ...................................... | ...................................... |lookup ...................................... | 2) I/P File --------------> Trns----> ...

In this case just split that single field into multiple hashed file fields, say have that splitted and stored into 5 hashed file(500 chars in eash hashed file). Have a condition like if it matches with all the hashed files then True, even if one of the hash file returns as NOTFOUND, then it would me...

Thanks a lot Arnd. Now its clear for me.

Thanks a lot Chulett. All these days I have using the term hash file only. From now on I will change and use as hashed file.

Is it that even if we have 10 keys in hash file. It internally combines and has it only as a single fileld. So it will be the same whether it is split or not. Is this the way hash file works.

Since the field can contain any of the metadata like char or number or date, I assume that the datatype of that field is given as char. So one of the solution is to split this single field to multiple field and mention all these splitted fields as key. In case of splitting also make sure that while ...

I have a doubt in hash file. Please excuse me if it is very basic.

I find the term hash file & hashed file being used in the forum in all messages.

Could anyone please say me the diffference if any between hash & hashed files.

One of the option is to use UNION ALL to check in the query. If the count matches with that of UNION then there is a problem. If not then there are duplicates in keys. For performance no two transformers should be continuous. It will decrease the performance and sometimes the job even aborts if the ...