DSXchange

Hello Is there any way to read only 1 row from a dataset? (For testing of a job) I can use filter stage after DataSet stage but still job is going to read all the rows from dataset. The problem is that this is a huge input dataset and I want to test my job with just 1 row. Do we have some stage to r...

Sorry another meaningful information would be

Datasets are hashed partitioned

Hi There is a job with 2 input datasets. The task performed in the job is to find the different between the data in 2 datasets. First dataset have 2 keys A and B Second has 2 keys A and C Now B and C contain same values just they have different names. Other characteristics like data type, values etc...

Ok. I stated it as a general rule. But by looking at your message I think thats not the case. Can 2 jobs share same RT_CONFIG file? Is this file any way related to hash partitioning?

Thanks

Thanks for reply.

2 jobs would not have same config file. So basically I will need to repartition the 2 datasets in the transform job..

This doubt is related to partitioning basics. Please let me know the answer or pointer to the answer. Here is the situation: I have 2 extract jobs. Both jobs create populate 1 dataset each. Extract 1 fetches 17 million rows. Extract 2 fetches 7 million rows. Both the datasets have a key viz. 'KEY' N...

Hi I am creating a job which uses a join stage. Now, as per documentation, if I use auto partitioning join will take care of sorting. But if I use hash partioning (which is possible according to job logic) I will have to sort the data on both the input links. Which method is efficient? using auto pa...

How to export one job from command line?

As we cant export a category, I am planning to select a list of jobs pertaining to a category and then export the jobs one by one. But for that I need a command to export a job....

Please let me know..

Thanks

No. That column is not null. I have done null handling for all the columns.

Hi All, I am using pivot stage in my job for horizontal pivoting. The derivation is given below: colx:icolx(key) coly:icoly colz:icol1, icol2, icol3,icol4....... icol108 o/p shoul be like: icolx,icoly,icol1 icolx,icoly,icol2 . . . . icolx,icoly,icol108 It should give me 108 rows in the out put but i...

From command prompt can we find out names of all the jobs used in a sequence? Is there any table which can be used?

I was thinking of reading the log file of sequence, but is there any better option?

Thanks

Thanks!!

Hi Ray Thanks for a quick reply. I think JOBTYPE 2 is sequence, 3 is PX job and 0 is server job. Is there any other table where we can map the meanings of 0,2 and 3? Like in typical database, generally we get mapping/reference tables which explain meaning of numeric values used in database...? Thanks

From command prompt, is there any way to fetch Job type of a job? Like how to identify if the job is a sequence/server job/PX job etc. Do we get any qualifier in DS_JOBS?

I can read the logs. But apart from that..is there any other way?

Thanks

Hi Ray
It worked!! Thanks a lot...
I will mark the topic as resolved..

Thanks