DSXchange

The Job is doing several joins. ( all the joins are necessary) and the data is sorted within the database stages itself using the order by clause. but the partitioing i have left it to auto since there were several joins and i thought specifying the partitioing and sorting would probably degrae the ...

I have set the partitioning to Auto itself

Hi All, There is this job which is curently running on 1 node , i made few changes to this job and ran the job on 1 node itself and its working fine , now i wanted to check the performance running on 4 nodes . the job ran successfully but when i checked the dataset ( which is what i load at the end ...

Here is the copy of the dsenv file i'm using. i see that the PATH is in a different location than what i have specified in mine but was not sure if i had to change it . Any guidance on how to change will be of great help ..... # PLATFORM SPECIFIC SECTION set +u # added 2006-03-06 umask 002 if [ -z &...

Thanks Sai , that removed the coment but now when i tried to delete one of my dataset using orchadmin delete command i get the following error message orchadmin: error while loading shared libraries: liborchgenerali686.so: cannot open shared object file: No such file or directory where do you think ...

Hi I tried setting all the variables and also tried to execute the dsenv file but when i log into the session i get the information as ksh: /home/sshettar/.profile 36]: ./opt/IBM/dstage/Ascential/DataStage/DSEngine/ dsenv: not found this is how i have defined in my .profile file export APT_ORCHHOME=...

Well currently the time taken to complete the job is just about 4 minutes. I did check with my lead and he says the data that this job deals with is very less and is not intending to grow much . So i was thinking it would be better for now to just leve the job as it is with the 11 join stages and th...

Thanks Srinivas, with You need to set PATH to make orchadmin work. export PATH=$PATH:$APT_ORCHHOME/bin do you mean to say i need to add this one command in addition to the rest that i have already mentioned? and should my export APT_ORCHHOME="PATH" coomand be written before the export PATH...

Hi All, I am having the issue in executing the orchadmin commands ,whenever i execute the orchadmin commands i get the following message " ksh: orchadmin: not found" . i have figured out that we need to set few paths before making orchadmin commands work ie set the APT_ORCHHOME and set the...

Thanks Mark!!!!
will try and use lookup stage ( where ever possible)

Hi All, I have this one job which is currently using like 11 join stages to load a dataset. It is joining like 14 tables .Well the job needs those many join stages though cause each join is based on the previous join results and the join keys are also based on the result of previous join stage. The ...

Thanks Craig!!! but One small confusion , Is "YES" for the first part of my question or for my second part of my question. i know this confusion is because of the way i framed the question. i have put two contradicting question out there. the first part says :does the dataset causes proble...

Hi All, I know datasets are very useful in terms of performance, but i was just curious to know if the datasets causes a problem if we decide to use different config file as compared to when cretaed it As in lets say we are using 4 nodes and we create a dataset , just wondering if we can read the sa...

Hi Craig, Thanks for the suggestion . I'm trying to do that .I have an issue with it , my sql has div number as parameter and looks like the sql that we run from a file will not accept any parameter . Is there a way to acheive this ? I tried this with one simple query which is like this SELECT COUNT...

Hi Craig. Well it sems like i am not explaining the senario well.there are this two jobs which exist for different division numbers. the 2 jobs that already exist differ only by the sql in the db2 stage and the sql difference is that one job just selects couple of fields from the table1 while the ot...