Search found 11 matches

by vercama
Tue Feb 17, 2009 4:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RTI Output and RTI Input
Replies: 4
Views: 2788

RTI Output and RTI Input

I'm investigating whether or not Datastage can provide webservices functionalities. I know, and already used, that a job can be invoked via WS. However: - I'd like to have the possibility to invoke a webservice stored on Datastage, may be passing some job parameters, and wait for the response. This ...
by vercama
Fri Feb 13, 2009 2:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture with 1.5 million rows
Replies: 4
Views: 2617

Performances?

But what about performances with so many rows? The current solution is that if the count() in the two tables are different of at least one row, then target table is truncated and then everything is loaded from scratch.
by vercama
Thu Feb 12, 2009 10:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture with 1.5 million rows
Replies: 4
Views: 2617

Change Capture with 1.5 million rows

Hi all, I've never used the Change Capture stage in a PX, but I know that it can be used to extract the differences between two tables, in particular the T1-T2 (probably it would need to run twice, T1-T2 and T2-T1, to get all the differences). What about performances? I had to check whether or not I...
by vercama
Fri Sep 05, 2008 9:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Passing parameters in PX
Replies: 3
Views: 2962

Passing parameters in PX

Hi All, I've two PX jobs to be runned in a Sequence job: 1) the first query an Oracle DB_1 table and get the max_date from a table 2) the second accept a parameter that's a date and performs queries on Oracle DB_2 There are no possibilities of DBLinks. How can I pass the result of the first job to t...
by vercama
Fri Sep 05, 2008 7:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Passing parameter out of datastage job
Replies: 21
Views: 37597

UserStatus in PX

No need for an additional stage if it's already available in the User Status area of one of the jobs in the Sequence job. Besides, that wasn't the question. Juls asked about accessing it from two sub-sequence jobs called from a third top level sequence job. The User Variables stage won't help here....
by vercama
Tue Aug 19, 2008 3:35 am
Forum: General
Topic: Load more tables -> loading order and one transaction
Replies: 15
Views: 8786

Of course they can be "undone" but I've never run into a situation where I've had to do anything of the sort in say, parent tables because of problems in the child tables. At least not in Production. :wink: As noted, constraints are fully qualified / checked / handled in the job designs s...
by vercama
Mon Aug 18, 2008 6:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: String to timestamp
Replies: 7
Views: 7849

DS manual

keshav0307 wrote:
If i dont specify the format what happens..???
then what will be your command??


it will fail to convert.


Hi,
does anybody know where I can find a DS manual with the list of available transformation functions, please?

Thanks!
by vercama
Fri Aug 08, 2008 1:23 am
Forum: General
Topic: Load more tables -> loading order and one transaction
Replies: 15
Views: 8786

My solution is perfectly valid, I have thousands of production jobs that do this very thing. The jobs are properly designed so they do not violate constraints of any kind. I ha ... My concern wasn't about your jobs, but about the outcome of your post. It could be possible that an insert statement f...
by vercama
Thu Aug 07, 2008 10:02 am
Forum: General
Topic: Load more tables -> loading order and one transaction
Replies: 15
Views: 8786

Ugh. I use separate jobs for each table and run them in the proper order. Transaction Size is always 0 so there's no "inconsistent data", it is all or nothing and the jobs ensure no "exceptions" occur ... By doing what you're saying, seems to me you have the risk to load (and co...
by vercama
Thu Aug 07, 2008 4:10 am
Forum: General
Topic: Load more tables -> loading order and one transaction
Replies: 15
Views: 8786

Re: Load more tables -> loading order and one transaction

I'm designing a datamart that takes data from various sources and load into a couple of tables which structure is connected with some constrainst. That means that: 1) I need to load tables in a certain order (master first, detail after) 2) I need to load tables in a unique transaction to avoid inco...
by vercama
Thu Aug 07, 2008 3:37 am
Forum: General
Topic: Load more tables -> loading order and one transaction
Replies: 15
Views: 8786

Re: Load more tables -> loading order and one transaction

I'm designing a datamart that takes data from various sources and load into a couple of tables which structure is connected with some constrainst. That means that: 1) I need to load tables in a certain order (master first, detail after) 2) I need to load tables in a unique transaction to avoid inco...