Search found 200 matches
- Thu Feb 08, 2007 8:38 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: row too big for inter stage rowbuffer
- Replies: 17
- Views: 9012
I happened to read this while searching and it struck me that the suggestions are way off the mark. I'm sure you must have solved this by now but thought I would attempt to clarify the problem when others see it. So here goes; When XML is being parsed by the XMLInput stage, it must be read in it's e...
- Mon Feb 05, 2007 11:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Enterprise Stage Read
- Replies: 12
- Views: 6528
Can your Teradata installation accept (16 x 15) sessions? Maximum sessions is number of TPAs multiplied by number of AMPs per TPA. It certainly appears able to. I see rows returned for all 16 nodes with minimal skew in the same amount of time per node. I am marking this resolved! The problem was wi...
- Wed Jan 31, 2007 12:33 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Enterprise Stage Read
- Replies: 12
- Views: 6528
Are the indexes properly setup? BTW how much speed you want to attain with it? for me its a pretty good speed There is no where clause, it's a dump of a single table. I will verify that the table doesn't have issues by itself. 726 rows/sec from anywhere going straight to the bit bucket is acceptabl...
- Wed Jan 31, 2007 12:23 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Enterprise Stage Read
- Replies: 12
- Views: 6528
Nervezzo - I don't see one answer set from FastExport. I see many processes, all delivering data. In my case, I see 16 Teradata Enterprise Stage UNIX processes, all with 15 sessions per player. This means 240 sessions on the Teradata side returning into 16 nodes. It is my belief that Teradata IS ret...
- Wed Jan 31, 2007 12:05 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Enterprise Stage Read
- Replies: 12
- Views: 6528
- Wed Jan 31, 2007 10:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Teradata Enterprise Stage Read
- Replies: 12
- Views: 6528
Teradata Enterprise Stage Read
I have a job that reads 1.4 million rows into 81 columns, 1000 bytes per row from teradata. It is a simple SELECT from a single table. The db is on a separate machine within a 100 ft of the DS machine. The db has 248 amps. The job reads with 16 players, 15 sessions per player. The output is to 16 Se...
- Fri Jan 26, 2007 8:05 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Fact to Fact
- Replies: 8
- Views: 3076
- Thu Jan 25, 2007 3:01 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: CDC Internal Functionality
- Replies: 2
- Views: 1314
- Thu Jan 25, 2007 2:35 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Fact to Fact
- Replies: 8
- Views: 3076
I assume your design is in the classic Kimball model and the compound key to the fact table is, in fact (hah!), the foreign keys to the dimensions. Therefore joining fact tables is really joining by dimension across fact tables - A federated Data Warehouse! Naturally all facts are at the same level ...
- Thu Jan 25, 2007 2:23 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Populating A user defined enviroment variable TIMESTAMP Data
- Replies: 17
- Views: 5269
- Thu Jan 25, 2007 1:57 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Populating A user defined enviroment variable TIMESTAMP Data
- Replies: 17
- Views: 5269
Why would you EVER touch the DSParams file Programmatically? Is there some problem with $ENV on a Windows platform? I thought $ENV allows one to capture the shell value of a user defined environment variable at runtime. Is this not correct? Assuming dsjob is wrapped could one select the db2 CURRENT_...
- Wed Jan 17, 2007 2:42 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: When checking operator: Dropping component
- Replies: 2
- Views: 5575
A join stage will never be able to combine 3 fields into a single row into a single field. The best you can do is pass all three fields in a output row to a transformer and build logic to choose which 4 char source field to put into a single 4 char target field. Going back to the SQL example, the on...
- Thu Jan 11, 2007 7:00 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: catching rejected records - parallel job
- Replies: 15
- Views: 9019
- Thu Jan 11, 2007 6:54 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reset if required - change in the Dsx
- Replies: 4
- Views: 1693
- Tue Jan 09, 2007 1:34 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to build an Oracle query string containing quotes
- Replies: 15
- Views: 7948
I don't have Oracle available to me right now or I would test this myself and not waste your time should this suggestion be whacked but I gotta believe some combination of triple tick marks (definitely not double quotes) would work. '''A690','R456','F1234''' select * from table where codes IN (#p_in...