DSXchange

Thank you all, will try and post my results here.

Hi, I am aware that one can get Link Names attached with the stage. However, how does one get Link Direction. Seq_1 --> Trfm(Transformer) --> Seq_2 If one wants to know that transformer has only one o/p link to Seq_2 and one i/p link from Seq_1. How does one find the direction of the link name. I ca...

I currently do not have access to Datastage, however would inform the forum on trying it out.

Thanks again for your continued help.

Will be careful in analysing metrics. Thanks. The Revised design is : Dataset(30 million) --> Lkp1 (363)--> Lkp2(392)-->Lkp3(991343)--> Lkp4(35116) --> Datasets I understand that in Lookup3 , could have been a join condition, however with the input stream being a bit more, getting them sorted and pa...

Hi, We have a simple job design. (30 Million ) Dataset -----> Small Lkp(393) -----> Small Lkp (392) --> Datasets. The dataset is not sorted. More than half of my cpu's are idle for more than 55%(using 'topas'). However, the throughput of reading this dataset is no more than 8000 rows/sec. Am i missi...

I was going through the link which Craig posted, how does one to set LDR_CNTRL env variable in AIX and check the current value already set. While going through the log, i was confused on reading the error message below:- [img]Lkp_Rd_Opr_Dist_Bnd_Mob,6:%20Could%20not%20map%20table%20file%20"/db2...

Hi, I checked the Scratch disk space and also pointed my TMPDIR to the same scratch disk space. While executing the jobs, i monitored the usage of this disk, GB of free space continued to remain available. However, while running 'topas', out of the 16 cpu's only 4 cpu's were getting very heavily use...

Hi, The OS indeed being AIX. The Url currently points to non-existing page.However, i have checked the partition's Dataset directory, which has sufficient space. The volumes here are just around 0.3 million in lookups and 30 million as input stream. We have 490 MB in /tmp. Would it be possible to li...

Hi,

Yes, different executions do change the system. I need to be more careful.

There was some background process runnning on the AIX box, resulting in the box. Got it sorted out.

Thanks all once again.

Thank you all for pointers. Will try and will post on this thread my findings. Hi what turn RCP on will do in this case. Thanks Sanjay Hi, You are joining 2 sequential files with huge data. As DataSatge is reading from sequential files, this is anyway serial. In this case the conversion is Sequentia...

Hi, I have a simple job flow design/ Seq File(47 Mill Rec) is getting joined with Another Seq File.(20 Mill ).After doing join, there are some transformation and my target file is dataset file. Since we are dealing with huge volumes, we have sort stage using Hash partition on join keys in both the s...

Hi, Yes i am having a collector on the Seq Stage. I am not able to find the error message, maybe i am missing something here. The log is hereby inline attached. For the actual filename of my job, i have replaced '<<ACTUAL_FILE_NAME>>' in the log. This particular file had 1000 records and i had to ki...

Yes,That is the most confusing. Without any changes to the job, it works in parallel mode. However, it fails on processing some random file in sequential mode. Job Design From sequential files i read 4 records( since delimiter check) For header i use a head stage and i check in transformer depending...

kumar_s wrote:What is the command been wrapped in Wrapper stage?

Hi,

It's a simple command of "wc -l " having <<filename>> as an argument with value option within the wrapper stage.

Hi, OS: AIX PX :7.5.1 Config file:-8 nodes I have a job which does the following:- a) Extraction of Header Record b) Extraction of Tail Record c) Row Count d) Delimiter Sanity Check e) FileName Check To do this, i have couple of wrappers and a transform in a job. (Multiple instance is not checked). ...