Search found 143 matches

by devesh_ssingh
Tue Sep 20, 2011 9:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pre-look up condition Failing even values are matching
Replies: 9
Views: 2556

Pre-look up condition Failing even values are matching

Hi, I have one multi-instace job which is failing due to pre-look condition mistmatch even though the values are matching. thr condition is NullToZero(total_row_Amt)=NullToZero(Source_TOT_AMT) values are 000159981855319403.000= 000159981855319403.000 however when i remove NullToZero function job run...
by devesh_ssingh
Tue Jun 28, 2011 2:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job consuming long time to execute..
Replies: 10
Views: 4079

@jwiles the count is number of records as mentioned in figure Db2_1 is my ref data. i shouldn't be limiting since i need to see all data in table... i am not sure how do i adjust memory usage because we are restricate to any enviormental setting.. also our Staging server is confifured with 4 nod onl...
by devesh_ssingh
Sun Jun 26, 2011 11:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job consuming long time to execute..
Replies: 10
Views: 4079

whatever i have explained is the actual volumne of data... also the transfomer used is bot just to copy but carry some transformation. its running of 4-node configuration.. first join reads 4567 rows/sec from referance seems like after 1st join perfromance degrades drastiaclly and after trx2 reading...
by devesh_ssingh
Sun Jun 26, 2011 1:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job consuming long time to execute..
Replies: 10
Views: 4079

db2_1 db2_2 rej1 |4 bill |2.5 mill | sort_2 sort_4 | | | | src-->trx1-->sort_1--->join1----trx2--sort_3-->join2--->trx3-->Load_OP | | rej2 Join1 key is Mer_no( char 10) join 2 key is MKT_code( char3)
by devesh_ssingh
Sun Jun 26, 2011 1:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job consuming long time to execute..
Replies: 10
Views: 4079

the design of job doesn't appered properly... i have two joins in a job..both referance and source followed by sort stage(hash partition and sort on key) ...Join have been given same partition on both referance and source... similar operation on join 2. in the last transformer there is 3 o/p dataset...
by devesh_ssingh
Sun Jun 26, 2011 1:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job consuming long time to execute..
Replies: 10
Views: 4079

Job consuming long time to execute..

Hi mentors, One of my job which have 2 joins subsequently followed by sort on key for both reference and Source as shown below..i m performing left outer join on both occassion......... db2_1 db2_2 rej1 |4 billion |2.5 millli | sort_2 sort_4 | | | | src-->trx1-->sort_1--->join1----trx2--sort_3-->joi...
by devesh_ssingh
Tue May 24, 2011 7:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dimension Negative surrogate ID created in table
Replies: 4
Views: 2616

That would do but , for all the -ve values needs to correct..
since restoring last positive value in .sk file and will correct all -ve id with new one.
by devesh_ssingh
Tue May 24, 2011 6:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dimension Negative surrogate ID created in table
Replies: 4
Views: 2616

Thanks craig for Quick response...

no issuew with negative id but they will again exhausted with in 2-3 years.
our data volume is 12 billion...

need to find out long term solution :)
by devesh_ssingh
Tue May 24, 2011 3:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential FIle Scenario
Replies: 5
Views: 3987

use index function to search 1st occurance of pattern then pass the same in jp.
search same in forum you will get more info
by devesh_ssingh
Fri May 20, 2011 2:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String to Date fatal error
Replies: 12
Views: 5548

@DSguru, when i apply buisness rules, used below conditions If TrimLeadingTrailing(lnk_user_dataset.ENROLL_DT) = '0000-00-00' Or TrimLeadingTrailing(lnk_user_dataset.ENROLL_DT) = '' Then StringToDate('0001-01-01',"%yyyy-%mm-%dd") Else StringToDate(lnk_user_dataset.ENROLL_DT,"%yyyy-%mm...
by devesh_ssingh
Thu May 19, 2011 12:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String to Date fatal error
Replies: 12
Views: 5548

@Etler21
i need to convert string to date, not timestamp..

as i said how do i tackle somthing 0000-00-00 comming from source....
by devesh_ssingh
Thu May 19, 2011 12:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String to Date fatal error
Replies: 12
Views: 5548

hey craig...

its Db2..
by devesh_ssingh
Thu May 19, 2011 9:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String to Date fatal error
Replies: 12
Views: 5548

String to Date fatal error

Hi, i have searched the forum regarding this error but nothing worked for me i have input col Enroll_DT char(26) UNenroll_DT char(26) target is Enroll_DT date(10) UNenroll_DT date (10) i have getting error Fatal Error: Invalid Julian day the input value is ENROLL_DT:2010-09-02-17.09.46.399604 UNENRO...