Search found 8 matches
- Tue Jan 12, 2016 5:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job design for two way range join
- Replies: 2
- Views: 3306
Thanks for the input Naveen! Any thoughts on how this design will perform when there is large amounts of data? Won't the first potentially produce a huge amount of data that has to be processed by the Transformer? Say table A has 3 mill rows, and that each of these hits 100 rows in table B, that wil...
- Mon Dec 21, 2015 5:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job design for two way range join
- Replies: 2
- Views: 3306
Job design for two way range join
Hi! I am trying to implement a join between two tables with history in Datastage. In sql I would do something like: select * from tableA a left outer tableB b on a.key = b.key and (a.valid_from_date between b.valid_from_date and b.valid_to_date or b.valid_from_date between a.valid_from_date and b.va...
- Fri Oct 02, 2015 5:40 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Tips on how to implement SCD type 6 in Datastage
- Replies: 3
- Views: 3431
Tips on how to implement SCD type 6 in Datastage
Hi! Anyone have some tips or best practice on how to implement SCD type 6 dimension loading in Datastage? My case: I have a large profile table that is incrementally loaded with combination of codes and their corresponding descriptions each day. If a code gets a new description this should be reflec...
- Wed Feb 11, 2015 2:55 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Rollback when using multiple input links
- Replies: 2
- Views: 1989
Rollback when using multiple input links
If I have two or more links going into a DB2-connector, will whatever the first link does be rolled back if the second link fails? E.g. if I first do a delete operation, and then an insert, and the insert fails, will the delete be automatically rolled back? If not, is there any quick way of fixing t...
- Mon Oct 27, 2014 7:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Truncation warning
- Replies: 5
- Views: 3418
- Mon Oct 27, 2014 3:07 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Truncation warning
- Replies: 5
- Views: 3418
Truncation warning
I get the following warning when using the PXPivot-stage in a job: "When checking operator: When binding output interface field "TYPE" to field "TYPE": Implicit conversion from source type "string" to result type "string[max=1]": Possible truncation of va...
- Thu Oct 23, 2014 1:01 pm
- Forum: General
- Topic: Best practice for triggering data load
- Replies: 1
- Views: 1611
Best practice for triggering data load
I guess my scenario is pretty common: I have a source database which has a log table that indicates that table x, y, z (and so on) is ready to be loaded into my DWH. The tables get ready at different times during the night, and I would like to be able to 1) load them one-by-one as they get ready, or...
- Tue Sep 09, 2014 9:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: No updates done on SQL Server using ODBC connector
- Replies: 1
- Views: 1564
No updates done on SQL Server using ODBC connector
I'm running a parallel job with an ODBC connector to update a table in an SQL Server database. The update statement is read from file. The job always runs fine, and reports back "Number of rows consumed by the user-defined SQL statement: x". But, sometimes it takes longer than usual to run...