Search found 14 matches

by ian_bennett
Wed Nov 02, 2005 5:56 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Partitioner Stage outputs zeros
Replies: 8
Views: 3518

Thanks Propogating did the trick! Not sure what the problem was though since I had originally defined the columns by using a Transformer stage to copy columns and then moving the link to the Partitioner stage (old habits die hard). Just to make sure, you did check the KEY attribute on each output li...
by ian_bennett
Tue Nov 01, 2005 10:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Partitioner Stage outputs zeros
Replies: 8
Views: 3518

Yep, all the columns match. Works fine for Round-Robin so shouldnt be anything like that. I dont use a link collector. The partitioner is to allow me to do a parallel sort and then each stream will insert to database independently. Make sure that the key columns in all of the Output links of the Lin...
by ian_bennett
Mon Oct 31, 2005 10:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Partitioner Stage outputs zeros
Replies: 8
Views: 3518

Partitioner Stage outputs zeros

When using the partitioner stage with either Modulus or Hash option it outputs "0" for every column. Works fine for Round Robin. I am using a single Decimal column for the hash key and was going to use Modulus to ensure that records with the same value are sent down the same output link. A...
by ian_bennett
Tue Oct 25, 2005 6:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job process dies at around 1GB RAM usage
Replies: 7
Views: 3495

Job process dies at around 1GB RAM usage

When the job process hit around the 1GB of RAM mark it soon aborts - no error message given.

This is occuring when using the XML reader to parse large files and we have noticed it with a few jobs.

Anyone else experienced this behaviour?
by ian_bennett
Tue Oct 18, 2005 7:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sourcing XML from URL
Replies: 0
Views: 1006

Sourcing XML from URL

We have a datasource that is XML published as a URL. Obviously I could (but would rather not have to) use some sort of script to extract this to a file to be processed by DataStage, but does anyone have any ideas on how this could be collected directly by DataStage? The XML Pack 2 reader seems to be...
by ian_bennett
Wed Sep 28, 2005 1:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Oracle Performance Tuning - Bulk / Direct / OCI / Updates
Replies: 14
Views: 31476

If you set transaction size to 1 then every record is a transaction, hence your problem if you hit Oracle with more than 255 records at once. If you set transaction size to say, equal to the array size, this should remove the limitation, while still performing a regular commit. I havent tested this,...
by ian_bennett
Tue Sep 27, 2005 9:37 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Oracle Performance Tuning - Bulk / Direct / OCI / Updates
Replies: 14
Views: 31476

Re: Oracle Performance Tuning - Bulk / Direct / OCI / Update

Is this the case with Transaction Size set to 0? I would have thought that with that setting then only 1 of the possible 255 transactions would be counted for the whole job. Array Size .... Performance benefits tend to tail off at higher numbers, and there are some tricky issues with values over 255...
by ian_bennett
Thu Sep 22, 2005 5:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Cant delete component in Version Control
Replies: 5
Views: 3225

roy wrote:Hi,
You can however filter the view not to show "deleted" components.
Nope, this doesnt work when I delete directly from the VC project. I assume it works only when the delete is done from the VC interface itself.
by ian_bennett
Thu Sep 22, 2005 12:51 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Cant delete component in Version Control
Replies: 5
Views: 3225

VC has a copy of the job. It is a project so you can delete within the VC project. Sorry, when I said I delete the job from the project, I meant from the VC project not the original project. It appears that VC stores another list somewhere and does not refresh based on the actual jobs in its project.
by ian_bennett
Wed Sep 21, 2005 8:10 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Log hangs when trying to view
Replies: 6
Views: 3326

Re: Log hangs when trying to view

Try filtering the view (e.g. last 100 entries).
by ian_bennett
Wed Sep 21, 2005 8:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Cant delete component in Version Control
Replies: 5
Views: 3225

Cant delete component in Version Control

When we try to delete a component we get the following error: "Unable to delete component through Version. Would you like do so in the Manager?" If I delete the job from the project it still appears in VC (regardless of the user option). Any ideas of what might be stopping me deleting in V...
by ian_bennett
Mon Sep 19, 2005 1:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: User Defined SQL
Replies: 7
Views: 3863

They do not appear in this case.

I'm guessing the error is occuring during this process.
ray.wurlod wrote:Same advice to you, Ian, also look at the start up entries to determine the actual SQL statement that was sent to the database to be prepared.
by ian_bennett
Sun Sep 18, 2005 11:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: User Defined SQL
Replies: 7
Views: 3863

I am having the same problem, but in my case it may be due to using a bit more complex SQL (i.e. contain subqueries). If I run either the UPDATE or INSERT statement by themselves it runs fine but put them together and I get the abnormal termination. Error is DataStage Job 2057 Phantom 11843. Doesnt ...
by ian_bennett
Sun Sep 01, 2002 7:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Changed Data Capture
Replies: 2
Views: 1200

The easiest way is to access the Logs for Oracle Materialized Views to identify the changes made to a table. These Logs are implemented as tables and can be created without needing to actually create the Materialized Views themselves. I suggest reading the Oracle Data Warehousing Guide for more info...