DSXchange

Hello all, I was wondering why one should use modify stage when other stages can be used instead of modify stage? As per my understanding renaming columns, dropping columns, changing datatype can be achieved using Copy stage instead of Modify Stage. I know Modify stage performs better since it's a p...

Sorry for 3 posts above. Problem with my browser.

The 2nd job is taking 5 hours to complete since there are 2 transformers which are having few complex transform and i wanted to reduce number of stages in this job. So i thought of partitioning & sorting in previous job and storing them in Dataset.

The 2nd job is taking 5 hours to complete since there are 2 transformers which are having few complex transform and i wanted to reduce number of stages in this job. So i thought of partitioning & sorting in previous job and storing them in Dataset.

The 2nd job is taking 5 hours to complete since there are 2 transformers which are having few complex transform and i wanted to reduce number of stages in this job. So i thought of partitioning & sorting in previous job and storing them in Dataset.

In the 1st job before writing into the dataset I have used Sort stage hash partition on keys and to sort records and in dataset I have used same partition.

In the 2nd job, i have used same partition in input link of join

Thanks throbinson for your reply.

I removed the Sort1 stage and ran the 2nd job but number of records after join were different.

Does this mean that Dataset maintains partition only but not sort order ?

Hi, I have 2 jobs. Output of first job is a Dataset which is the input to the 2nd job. The 2nd job looks like this ----- |DB2| ----- | ------ |Sort2| ----- | |DS of 1 | --> | Sort1 |-->|join | ---> |ouput | In the 2nd job shown above, we have hash partitioned and sorted based on keys in Sort1 stage....

Thanks all !

Hi All, To use a join stage the data should be Hash partitioned and sorted. In our jobs we join 2 tables. We use Sort stage for each input link, to sort data and to Hash partition, before the Join stage. By using an explicit Sort stage is there any advantage over the in-stage sorting ? By in-stage s...

Hi,

Thanks Kumar and Ray.

The issue has been resolved by FTP'ing files from Mainframe to UNIX box in Binary Mode.

Thanks.

Hi, Here are the details - The source file is directly FTP'ed from mainframe to UNIX (Sun OS) without any reformatting. I am using 2 stages, one being the Complex Flat file stage to read the source file in UNIX and the other being a sequential file to collect the output. ============================...

Hi, We have a COBOL file which is pushed from MAINFRAME to UNIX using FTP program in MAINFRAME. I am able to import the copy book into DS and also read the contents of the file(pushed from Mainframe) on UNIX using Complex flat file stage. The data in the non COMP columns are being displayed correctl...

Thanks DSguru2B

Hi, Thanks for your reply.I went through that post and i find that only job status are given in that sample unix script and not the status code. Correct me if i am wrong - I find that the job status and status codes are different. The status codes are the ones that are returned by dsjob command and ...