Search found 144 matches

by sam334
Thu Apr 30, 2015 3:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Merge/Join Stage
Replies: 6
Views: 2384

Craig,yes this the master record match issues. I am not getting 100 as 16 are getting rejected. Is there anyway we can stop merge stage to reject records..
by sam334
Thu Apr 30, 2015 2:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Merge/Join Stage
Replies: 6
Views: 2384

Yes Craig.I tried many times. Below are the errors.
Update record (0) of data set 2 is rejected; there is no master record.
and
Master record (1) is a duplicats.

When i used reject file , it shows multiple reject records from update link.
by sam334
Thu Apr 30, 2015 11:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Merge/Join Stage
Replies: 6
Views: 2384

Merge/Join Stage

All, Have a confusion. I have one query in db2 which (Source 1) looks like, DATE,COUNTRY,PRODUCT,NUMOFPRODUCTS There are total 200 rows with product count Country and Product wise. Source 2 - DB2, looks like, DATE,COUNTRY,PRODUCT,NUMOFPRODUCTSFILTERED but it has a filter so number of records are 100...
by sam334
Thu Apr 23, 2015 10:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Calculation in Stage Variable
Replies: 5
Views: 2283

Perfectly worked. Many thanks....
by sam334
Wed Apr 22, 2015 3:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Calculation in Stage Variable
Replies: 5
Views: 2283

Thanks Ray and Craig. But the source table data type is date, then we don't need to use STRINGTODATE right?
by sam334
Wed Apr 22, 2015 3:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Calculation in Stage Variable
Replies: 5
Views: 2283

Calculation in Stage Variable

All, I need to do a calculation in transformer. Kind of confused. We have data in below format: ID,DATE,STATUS A,20150228,Active B,20150228,Active Now, if the process runs on March 31st, and if current date is more than DATE+31days then change status to Expired. So, if process runs on 2015-03-15 and...
by sam334
Wed Apr 22, 2015 1:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DELETE MULTIPLE RECORD AFTER DB2 STAGE
Replies: 6
Views: 2886

Craig, did that and it worked. I sorted the data and removed duplicates based on the key and it is removing the old one.

Thanks.
by sam334
Tue Apr 21, 2015 8:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DELETE MULTIPLE RECORD AFTER DB2 STAGE
Replies: 6
Views: 2886

Thanks everyone.
@Craig, both the record are in single excel file. So, when we get the first file it has both the records.but we want to store one which has recent start date,
by sam334
Fri Apr 17, 2015 3:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DELETE MULTIPLE RECORD AFTER DB2 STAGE
Replies: 6
Views: 2886

DELETE MULTIPLE RECORD AFTER DB2 STAGE

All , I have a question regarding loading and deleting from a same table. Initial job design, File-Tranformer-lookup-Join-DB2Connector. Data looks like, ID, NAME,START,END,STATUS 1234,John Smith,01/01/2015,12/31/2016,Pending 1234,John Smith,04/17/2015,12/31/2016,Pending Now, as first record is the o...
by sam334
Thu Mar 05, 2015 2:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove bad rows before loading
Replies: 2
Views: 1487

Remove bad rows before loading

All need a help in removing bad rows while loading. We have a job which reads a pipe delimited file and load in DB2 database. Issue is that, sometimes in one or two records before pipe we are getting # sign. Datastage assuming it is a delimiter and aborting the job. Can we do something to reject the...
by sam334
Fri Feb 13, 2015 2:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance tuning of Job
Replies: 3
Views: 1682

Performance tuning of Job

All, Have a question on performance tuning. We have a job design like, FTP PLUG IN -- TRANSFORMER--DB2 CONNECTOR. It is almost 14 million record refresh everyday and taking almost 22 minutes to run. In log, it says, FTP Plug in "Logging delayed metadata" and finishes the job in 22 minutes....
by sam334
Fri Feb 13, 2015 2:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: AGAIN DATE CONVERSION
Replies: 3
Views: 1525

Okay Thanks Craig.Looking it now.
by sam334
Fri Feb 13, 2015 1:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: AGAIN DATE CONVERSION
Replies: 3
Views: 1525

AGAIN DATE CONVERSION

All, Need a help again in date conversion. I have a parallel job which reads CSV file in sequential file stage. Now, in server job it is working fine but in parallel SEQ, giving lots of trouble. Have an input column (Varchar), data looks like. 7/14/2014 and 10/28/2013 and so on. So, M/DD/YYYY for Ja...
by sam334
Sat Feb 07, 2015 4:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup design
Replies: 2
Views: 1521

Okay. Thanks Ray. Awaiting for my membership activation though it is renewed almost 5 days back, it should be under process. As soon as it is done, will see your suggestion and try to implement. Thanks again.
by sam334
Sat Feb 07, 2015 11:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup design
Replies: 2
Views: 1521

Lookup design

All, Have a question in lookup design. we have a complex jobs which loads Table A everyday. Now, i want to make sure next day whatever record is there in Table A should not load. Used look up stage before loading into Table A. --------------- Table A ------------------ | Source-- Lookup- Table A. Ki...