Hi
Suppose we have records like
zip,age,apt
48201,20,2
48201,20,1
77058,60,2
77058,20,2
48201,30,5
85674,35,90
77058,10,60
48201,60,30
If we partition the data using all three keys in order zip,age,apt on two nodes ,does all records with zip 48201 arrive on the same node always.
Thanks
Arif
Search found 87 matches
- Tue Jun 27, 2006 5:22 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash Partitioning
- Replies: 8
- Views: 3322
- Wed Jun 21, 2006 1:10 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: records dropped in transformer
- Replies: 7
- Views: 3782
Re: records dropped in transformer
Hi In one of my job , a transformer which checks the following null condition if ISNULL(RM_NULLS.COL1) And IsNotNull(RM_NULLS.COL2) then RM_NULLS.COL3= RM_NULLS.COL4 else RM_NULLS.COL3 for which I am getting warning APT_CombinedOperatorController,0: Field 'COL1' from input dataset '0' is NULL. Reco...
- Wed Jun 21, 2006 12:04 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: records dropped in transformer
- Replies: 7
- Views: 3782
records dropped in transformer
Hi In one of my job , a transformer which checks the following null condition if ISNULL(RM_NULLS.COL1) And IsNotNull(RM_NULLS.COL2) then RM_NULLS.COL3= RM_NULLS.COL4 else RM_NULLS.COL3 for which I am getting warning APT_CombinedOperatorController,0: Field 'COL1' from input dataset '0' is NULL. Recor...
- Thu Jun 15, 2006 3:52 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Avoiding Data disappear
- Replies: 6
- Views: 1523
Yes , what you can do is create a procedure to refresh the materialised view and call this procedure in the close command of your target stage in the job or call the procedure through datastage after the loading job finishes. Since your users will always be hitting the materialised view, they will ...
- Thu Jun 15, 2006 2:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Avoiding Data disappear
- Replies: 6
- Views: 1523
Or load a second copy of the table and when the load completes, swap it in for the original. :wink: Exactly, this is called mirroring. It is infact pretty easy to achieve this through materialised views. Maintain a materialised view for your table and make sure that users always hit the materialize...
- Thu Jun 15, 2006 12:31 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Avoiding Data disappear
- Replies: 6
- Views: 1523
Avoiding Data disappear
Hi One of my jobs refreshes the datamart using ODBC enterprise stage's truncate and write option.The job runs for about 10 minutes during which the data gets deleted and loaded and user sees an inconsistent data. Is it any way possible to see the old data in the table during the run time ,and after ...
- Tue Jun 13, 2006 9:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC Performance
- Replies: 3
- Views: 1217
ODBC Performance
Hi I have three jobs which loads the data in oracle database.The jobs are simple with only two stage jobs ,the first stage extracts the data from sybase using sybase ocpx stage and loads it into database using ODBC enterprise stage ,I have set the array size to 10000 and isolation level to read comm...
- Fri Jun 09, 2006 2:59 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sybase error
- Replies: 7
- Views: 5673
I have never seen that error message before but i can certainly point you in the right direction. Lets start with analyzing the sql error. For that click here And try to investigate on the error and see why in your sql giving this kind of error. I just love google university :wink: The sql is prett...
- Fri Jun 09, 2006 11:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sybase error
- Replies: 7
- Views: 5673
Sybase error
Hi I am sorcing the data from sybase database using the Sybase OCPX stage and user defined sql. I got the following warnings Sybase_OC_0,0: Warning: CopyOf end_st .Sybase_OC_0: Sybase Server warning 2762 (severity 16) from stored procedure 'sp_tables', line 209: The 'CREATE TABLE' command is not all...
- Fri Jun 09, 2006 10:20 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC error
- Replies: 5
- Views: 1210
- Fri Jun 09, 2006 10:19 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC error
- Replies: 5
- Views: 1210
- Thu Jun 08, 2006 5:09 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Capture rejects with ODBC write load option
- Replies: 1
- Views: 850
Capture rejects with ODBC write load option
Hi
Is it possible to get the records which are not inserted (or rejected) in the database while loading the data using ODBC stage with write option .
Thanks
ARif
Is it possible to get the records which are not inserted (or rejected) in the database while loading the data using ODBC stage with write option .
Thanks
ARif
- Thu Jun 08, 2006 5:04 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: ODBC error
- Replies: 5
- Views: 1210
ODBC error
Hi
When I use an Oracle OCI stage the job runs fine but when using ODBC stage with write option I get an error
Can somebody suggest me what is this error APT_CombinedOperatorController,0: [DataDirect][ODBC Oracle driver]Invalid precision value. Error in parameter 5.
Thanks
Arif
When I use an Oracle OCI stage the job runs fine but when using ODBC stage with write option I get an error
Can somebody suggest me what is this error APT_CombinedOperatorController,0: [DataDirect][ODBC Oracle driver]Invalid precision value. Error in parameter 5.
Thanks
Arif
- Thu Jun 08, 2006 3:44 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Rejects in DRS
- Replies: 3
- Views: 893
Have you even tried to create a Rejects link? Let us know the result. I doesnt accept any reject links ,even the ODBC enterprise stage with the property truncate and write doesnt supports reject links. Is there a way to capture records that are not inserted in databse to a sequential file . Thanks ...
- Thu Jun 08, 2006 1:26 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Rejects in DRS
- Replies: 3
- Views: 893
Rejects in DRS
Hi
Is it possible to give a reject link to DRS stage while doing truncate and insert,so that all the records not inserted goes to a sequential file .
Thanks for help
Arif
Is it possible to give a reject link to DRS stage while doing truncate and insert,so that all the records not inserted goes to a sequential file .
Thanks for help
Arif