DSXchange

We have migrated a couple of jobs from our DEV environment to a NEW STAGE environment. The Hardware configurations of these two environments are identical. Post deployment, we are facing the following problems : a) Jobs which used to complete within an hour, are taking close to 10-12 hours to comple...

Checked the job log , and found what I was looking for .

Sorry for posting.

I have created a job which joins two datasources namely, a) MEMBER table b) VOUCHER table based on MEMBER_NUMBER column. Post join, I am fetching data of TWO columns MEMBER_NAME (from MEMBER table) and VOUCHER_TYPE(from VOUCHER table), and I am UPDATING TWO columns (MEM_NAME and TYPE) of THE SAME VO...

I am taking the reference of a topic marked RESOLVED where a few specification expresssions are mentioned like: UPC:string[20] = string_from_decimal [suppress_zero](UPC) where the name of the column in the output link is SAME as the name of the input column whose DATATYPE is being altered by the mod...

I am having a source table named PRODUCT . Its schema is given below. PROD_ID VARCHAR2(11 CHAR) NAME VARCHAR2(50 CHAR) PRICE VARCHAR2(5 CHAR) GROUP_CODE VARCHAR2(4 CHAR) Examples of data in column PRICE are 80, 70, 170, 90, 70 My intention is to use the looping feature of tranformer stage and create...

Let consider the following job scenario : Oci_Src--> Tfm1--> Dataset1 Dataset2--> Tfm2--> Oci_Tgt In the above situation > The first flow uses Dataset1 to write to a file f1.ds > Dataset2 is used to read data written in the file f1.ds an perform any subsequent functions as part of the second flow > ...

@craig: As you say , THE JOB DESIGN IS SAME AS TWO SEPERATE JOBS RUNNING AT THE SAME TIME, lets say the the job is running over a 4 node MPP system , how will the nodes execute each stage if the job ? Will it be like EACH FLOW WILL BE CATERED BY 2 nodes ? I'm confused ......

Thanks
Kumarjit.

I have been longing for quite sometime to ask this quetion here , but was too much tied up in other issues lately. In out Datastage Repository ,there are many jobs, any one of which when I open the job in the Designer Canvas , I see TWO OR MORE INDEPENDENT Data flows within the same job. Someting li...

I debugged the job and used a PEEK stage in place of the target Oci, and the job wrapped up in close to 10 mins, but the problem shows up again when Oci is in place. The target table that I want my data to go into has multiple(close to 20 ) indexes declared, that I dare not to touch .. So is there a...

:D

Yeps, the one with Sort Mode as "Dont sort , previuosly sorted "......
Works wonders Andrew..........


Regards,
Kumarjit.

Dumy in the sense that these sort stages are used to PArtition+Sort data flowing into the JOIN stages , so that the JOIN stage doesnt have to worry about the sorting over 10 million records when Hash+Sorted on the Join keys.......

Oci_Src --Sort1(key=Member ID)-- Join1 --Sort2(key=address_id)- Join2 - Oci_Tgt | | | | | | Oci_Member_master Sort3(key=ADDRESS_ID) | | Oci_Address_master @BI-RMA : Its plain INSERT , and there are many other jobs handling similar volumes of data with plain INSERT in the target table, but they are ...

My datastage parallel job is expected to handle more than 10 Million records as input. The input data is basically a combination of MEMBER_ID and their relevant addresses indicated by ADDRESS_ID The requirement of this job is to validate the MEMBER_ID and ADDRESS_ID values of a single record of the ...

I already have the partition and sort done IDENTICALLY on both the links to the join stage,on ADDRESS_ID column , and still the jobs runs long enough to raise my eyebrow...... As Andrew said , can I have any of the algorithms to compact my ADDRESS_ID field size ....... I just need to give it a try ...

Thanks J for your response . But the business logic demands that a join must be made on ADDRESS_ID (basically to lookup the ADDRESS_ID of the input against a reference data), so cant escape the join. What I am looking for is like this : If there is a way that we can encode the ADDRESS_ID column in s...