DSXchange

If you want to make the Parallel jobs run on your single CPU system. You can have the datastage server component installed on a Virtual computer which runs the Unix operating system. And the access it from Windows XP which has the Datastage client components installed.

Hope that helps.

I doubt if we can accomplish this with Remove Duplicate stages.

Isn't there a special stage in Datastage which accomplishes this?

Thank you Maverick.
But I forgot to mention that I had more than one column(Almost 10 columns). And I need to check the duplicates on a single column. Just for the sake of simplicity I posted it using a single column.

Thanks for all the help.

Hi, I have a scenario where I need to delete all the duplicates from the source file. Say I have this i/p data --> EmpID ==== 1 1 2 3 4 4 O/P Data--> EmpID ==== 2 3 Here since 1 and 4 are repeating I need to remove all the rows which have 1 or 4 as the EmpID. I am implementing it this way --> Here I...

Can you post, How you got it solved?. That would help future searches. :D

Hi Vincent, Your blog was very helpful. Got a lot of insight into the past, present and the future of Datastage. Thank you :D

Hi all,
Please feel free to post any trivia on Datastage.

Hi Ray,
It's not a standard IBM training class. It's developed independently.

Thank you Chulett, DSguru and Ray for giving me the link to this beautiful blog.


And Thank you Vincent for writing this blog :D..........

Hi all, I am about to give a training session for Datastage Parallel edition. And to make the session interesting, I want to start it with a little trivia on Datastage, like How it got it's name etc,. It would be great if you guys helped me on this. Anything which would help in making the session in...

Can you get some more details about your job?

Hi raji, Here you said you wanted to Unprotect the jobs I have to make the read only (protected) jobs to un protected mode and i have to run the jobs. And here you want to make the protected mode to unprotected which means you want to unprotect the jobs.. :wink: If the admin gave me that rights, the...

But just a word of caution!

Don't re-partition your data unless you really need it.

As partitioning is an overhead and if you do repartitioning it definitely reduces the performance of the jobs.

You can do this by checking the checkbox in Administrator.

The check box is

--> Add Checkpoints so sequence is restartable.


Just check this option.

Thanks for all the Help DSguru2B :D

Hi there, Can we look at the code of the different stages in the Parallel Jobs(Join, Sort, Merge, Transformer) , Like we can look at the OSH code and the Job Score of the Jobs. Is there some place where the code for these stages is stored?(Repository?) As looking at the code of the different stages ...