Search found 520 matches
- Wed Aug 25, 2010 2:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reducing Swap Usage in Simple Jobs
- Replies: 9
- Views: 2780
Doug, Swap will be used when a page in memory needs to be freed. Normal IBM recommendation for swap is 8gb * number of CPU's. Based on your configuration which I assume is 16 logical nodes (based on your 16 partitions) and at least 3 players per job (possibly more) plus one section leader for each n...
- Fri Aug 20, 2010 8:26 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Get records rejected from reference link
- Replies: 6
- Views: 2720
What exactly would you expect to see? If a stream row does not find a match in the reference lookup - what would you reject from the reference lookup? The only thing that can be sent down the reference link is the stream data - that, at least, is known. Flip them and all you have is a bunch of rejec...
- Fri Aug 20, 2010 8:07 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unable to load data to a DB2 Table
- Replies: 3
- Views: 3057
Since you indicate that this job has run before and I presume there have been no changes then I would focus my attention on 1) The data has changed 2) The DPF environment has somehow changed. 3) A patch has been installed on the ETL server If #1 and #3 above can be ruled out then I would focus on #2...
- Fri Aug 20, 2010 2:43 pm
- Forum: DSXchange Testimonials
- Topic: Thanks to my friends
- Replies: 7
- Views: 27413
Well Kim, I am honored to be recognized as someone that helped and is a friend! We did have some fun at BS and we did learn a bunch! I really do look back on that contract with a bit of fondness - we were all pretty far from home, on a contract that had no chance of success but we still were able to...
- Fri Aug 20, 2010 2:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DB2 EE stage
- Replies: 12
- Views: 5256
- Fri Aug 20, 2010 2:23 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: To get Record count in Transformer
- Replies: 15
- Views: 21656
- Fri Aug 20, 2010 2:18 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: lookup error - no space left on device
- Replies: 2
- Views: 2791
The lookup operator will attempt to use memory and when it cannot use memory it will use scratch as defined in your configuration file. If this fills up then it will move to TMPDIR as defined in the environment and if it is not defined then it will use /tmp on Unix and c:\TMP on windoze. If you are ...
- Fri Aug 20, 2010 2:14 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: To get Record count in Transformer
- Replies: 15
- Views: 21656
If you want to get a sequential count of rows processed regardless of the configuration file used then - @PARTITIONNUM + (@NUMPARTITIONS * (@INROWNUM-1)) will do the trick. If you want the total number of rows sourced then this can work, but an agg with a dummy column will output 1 row. You could so...
- Fri Aug 20, 2010 12:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DB2 EE stage
- Replies: 12
- Views: 5256
>##E TNDB 000000 10:35:38(002) <DB2_UDB_Enterprise_3> Program not bound to database >Attempting to bind to the database /DataStageApp/Ascential/DataStage/PXEngine/bin/db2esql.bnd ....failed Just have your DBA's rebind the package in the DB and you will be good to go. This usually happens after a DB...
- Fri Feb 06, 2009 10:24 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Problem using Convert in Transformer
- Replies: 31
- Views: 12156
Please make sure that in your routine definition that you have added a fully qualified pathname pointing to your .o or .so. If you have then make sure that you have the correct permissions on the library or object. you could put the object/library in the search path by putting it in PXEngine/usr_lib...
- Thu Nov 08, 2007 10:45 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Header, Detail design issue
- Replies: 5
- Views: 2954
- Thu Nov 08, 2007 8:23 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Header, Detail design issue
- Replies: 5
- Views: 2954
If the header and 3 detail have the same key you could do a join or merge or even a simple lookup to handle this situation. I would refrain from using stage variables and messing with what node is processing what record etc... not a good way to handle the logic. You could load the headers into a loo...
- Wed Nov 07, 2007 9:53 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: NextSurrogateKey()
- Replies: 18
- Views: 14970
- Wed Nov 07, 2007 8:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: NextSurrogateKey()
- Replies: 18
- Views: 14970
In version 8.x there is a new tab of the parallel transformer properties called Surrogate Key. Within this tab you define how you want to manage the surrogate key - either flat file or DB Sequence and then in the transformer derivation of the output column you simply invoke NextSurrogateKey(). If yo...
- Tue Nov 06, 2007 5:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: handling nulls in timestamp
- Replies: 3
- Views: 1203