Thanks Sura for the Suggestion.
I started writing the PROC, before that I just want to know whether any others come across the same situation and their ideas about this?
And regarding the Indexes, Yes the tables are having the indexes on the columns which I am using in joins.
Search found 87 matches
- Tue Aug 16, 2011 6:22 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ETL Job v/s Stored Procedure
- Replies: 3
- Views: 2581
- Tue Aug 16, 2011 5:40 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ETL Job v/s Stored Procedure
- Replies: 3
- Views: 2581
ETL Job v/s Stored Procedure
Hi All, I have a query regarding the tuning a datastage job. My requirement is to read 10 millions of data from a table and do a lookup (Left outer join) on some other table which is on same database, then insert the data into some other table. My ETL job for above requirement is taking more than 10...
- Thu Jul 14, 2011 11:38 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Issue with Message Handler
- Replies: 3
- Views: 2876
Hi theone, Thanks for the reply. But in some cases, we can see these two different kinds of warnings from same table. That means, job is having only one table with PRIMARY_KEY and NOT NULL columns, so records are rejected due to PRIMARY_KEY violations and some other are due to NON NULL constraint. B...
- Wed Jul 13, 2011 12:03 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Issue with Message Handler
- Replies: 3
- Views: 2876
- Tue Jul 12, 2011 5:33 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Issue with Message Handler
- Replies: 3
- Views: 2876
Issue with Message Handler
Hi All, I need to insert data coming from a file into two different target tables. First table is having a PRIMARY-KEY and second table is having some NON NUL able columns. I added a message handler in my job to handle PRIMARY KEY violation warnings (I created a new message handler to handle the mes...
- Tue Dec 21, 2010 4:04 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Copying Dataset Data into a Sequential file
- Replies: 2
- Views: 2337
- Tue Dec 21, 2010 3:31 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Copying Dataset Data into a Sequential file
- Replies: 2
- Views: 2337
Copying Dataset Data into a Sequential file
Hi All,
Is there any way to copy the dataset data into a sequential file?
I need to write a UNIX script which will accept dataset name as input parameter, read that dataset and copy the data into a specified sequential file.
Is it possible to do this using shell scripting?
Is there any way to copy the dataset data into a sequential file?
I need to write a UNIX script which will accept dataset name as input parameter, read that dataset and copy the data into a specified sequential file.
Is it possible to do this using shell scripting?
- Mon Sep 27, 2010 2:57 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: problem in reading sequential file in parallel job
- Replies: 1
- Views: 1751
problem in reading sequential file in parallel job
I need to read a sequential file that is created in some other processses .It is created with the following options Record Level Final delimeter =end Record Delimeter String =Dos format Field Defaults Delimeter = tab Null field value = ' ' I need to read the file as a single row. By using server job...
- Thu Mar 04, 2010 10:38 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: NVARCHAR issue while updating Data in Oracle
- Replies: 4
- Views: 8803
- Thu Mar 04, 2010 9:39 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: NVARCHAR issue while updating Data in Oracle
- Replies: 4
- Views: 8803
NVARCHAR issue while updating Data in Oracle
Hi All, I have a job which update data in a table in Oracle. While importing the metadata from datastage by using ODBC meta data connectivity, Datastage converted all VARCHAR datatypes into NVARCHAR type. I am using the same meta data while updating the same table after few joins in my job. This job...
- Wed Nov 18, 2009 9:32 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performance with Change Capture Stage
- Replies: 7
- Views: 7520
Thanks Arndw, I am not doing the updates. Some other system will do the updates and that updates will flow into my system. I can find changes only by comparing before and after images. Any performace tunning methods before using CHANGE CAPTURE stage. I am sorting the data other than this any other t...
- Wed Nov 18, 2009 9:32 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performance with Change Capture Stage
- Replies: 7
- Views: 7520
Thanks Arndw, I am not doing the updates. Some other system will do the updates and that updates will flow into my system. I can find changes only by comparing before and after images. Any performace tunning methods before using CHANGE CAPTURE stage. I am sorting the data other than this any other t...
- Wed Nov 18, 2009 8:23 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performance with Change Capture Stage
- Replies: 7
- Views: 7520
Performance with Change Capture Stage
Hi, I have a requirement to compare a table before update and after update. I have 10 columns in each record and table is having around 20 millions of records. I want to run a comparison over 20 millions of records. In this case, is it feasible to use CHANGE CAPTURE stage to get the differences (ins...
- Wed Oct 21, 2009 11:23 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Extra character at the end of file
- Replies: 2
- Views: 1737
- Wed Oct 21, 2009 9:34 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: FTP a file with TIMESTAMP in name
- Replies: 3
- Views: 2958