Search found 199 matches

by jreddy
Thu Feb 19, 2004 2:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to improve performance of server jobs
Replies: 10
Views: 4765

we did drop all the indexes.. the main culprit could be the referential integrity, check, primary key and not null constraints on the target columns though.. which we cannot drop
by jreddy
Thu Feb 19, 2004 12:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to improve performance of server jobs
Replies: 10
Views: 4765

yes, i did work with bulk loader before and never used that ever again, coz i thought it was useless, in the sense it was so slow. .. from all your suggestions i thought that i might've been wrong and wanted to learn more about its options and features to improve performance... anyway.. yeah, actual...
by jreddy
Thu Feb 19, 2004 10:51 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to improve performance of server jobs
Replies: 10
Views: 4765

yes, i do agree that TOAD may have misled me (my query was the exact view defintion that i copied), but in the Datastage job data starts flowing in from the oraoci stage that reads from that view pretty soon, i mean in couple minutes and not hours.. its the processing thats taking so long. About the...
by jreddy
Thu Feb 19, 2004 10:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to improve performance of server jobs
Replies: 10
Views: 4765

record length is about 300bytes average pretty small actually.. but you are right about array size.. though in this case it seems okay. Generally, even i try to use 500 for medium sized files and 1000 when i think its a small record..byte wise.. but apart from these 2 things.. i read about buffer si...
by jreddy
Thu Feb 19, 2004 10:15 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to improve performance of server jobs
Replies: 10
Views: 4765

yeah.. actually there is not much happening on the database when the job is run ..usually coz its after hours..same reason why network traffic might not play much part.. but about replacing oraoci with orabulk.. let me ask this.. i am doing a lot of user-defined sql on target end.. can i still do it...
by jreddy
Thu Feb 19, 2004 10:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to improve performance of server jobs
Replies: 10
Views: 4765

how to improve performance of server jobs

Guys, I havent worked with jobs that populate more than a couple hundred thousands records in the past, so very naively i want to ask this question.. how long should a simple server job that reads from a view (view joins 4 tables.. but when i run this view in Toad, it gives results in 7 mins) return...
by jreddy
Wed Feb 18, 2004 4:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Retrieving stage/link error messages
Replies: 0
Views: 2013

Retrieving stage/link error messages

I have to capture the stage or the link last err into a reject table/file. I used to use DSLinkLastErr or DSStageLastErr in a server job.. i was looking if anybody would know about similar macros or routines which i could use to get the same kind of details.

thanks in advance for the help.
by jreddy
Wed Feb 18, 2004 3:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Capturing rejects in px jobs
Replies: 5
Views: 1679

actually, i have the correct the summary that you have assumed In Transformer, you have a constraint field for the first Oracle table. You want "rejects" from that constraint to go to the second Oracle table. Then you have a second constraint to the third Oracle table. I do not have a spec...
by jreddy
Wed Feb 18, 2004 3:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: commit frequency in oracle enterprise stage
Replies: 2
Views: 4070

wow Teej,
you are really a geek..works perfectly well.. and i do have administrator and access to it as well :)

Thanks a ton
by jreddy
Wed Feb 18, 2004 1:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: capturing rejects in px jobs
Replies: 3
Views: 3204

error message is

Link perfHdrRejectORAIn, Constraint: perfHdrORAIn.REJECTED
Variable 'perfHdrORAIn.REJECTED' not defined
by jreddy
Wed Feb 18, 2004 1:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: commit frequency in oracle enterprise stage
Replies: 2
Views: 4070

commit frequency in oracle enterprise stage

Guys, I need to be able to set the commit frequency on the target Oracle Enterprise stage to be able to avoid problems with rollback segments. would like suggestions from anyone who has done that before. I know there was a Transaction Handling feature in server jobs that enabled us to specify 'rows ...
by jreddy
Wed Feb 18, 2004 1:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: capturing rejects in px jobs
Replies: 3
Views: 3204

capturing rejects in px jobs

i have a source stage (oracle), a transformer and 3 target oracle stages. My requirement is that i have to capture rejects of first target ONLY into second oracle table. I tried using otherwise in transformer (with the link ordering as first target, second target reject table, third target),but it d...
by jreddy
Wed Feb 18, 2004 11:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Capturing rejects in px jobs
Replies: 5
Views: 1679

Capturing rejects in px jobs

hey guys, back with another question.. i have a source stage (oracle), a transformer and 3 target oracle stages. My requirement is that i have to capture rejects of first target ONLY into second oracle table. I tried using otherwise in transformer (with the link ordering as first target, second targ...
by jreddy
Wed Feb 18, 2004 11:13 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to use an oracle sequence to generate surrogate key
Replies: 6
Views: 2260

unfortunately no.., atleast according to the manuals too.. the transformer can accept only one input (reference/stream irrespective) in a parallel job.. such a big constraint on development of parallel jobs...
by jreddy
Wed Feb 18, 2004 8:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: how to use an oracle sequence to generate surrogate key
Replies: 6
Views: 2260

Yeah, actually thats what i tried meanwhile, i wrote a user-defined sql on source oracle stage, with just the sequence name as one column. It worked fine. I am sure we can do it at the target end also. The lookup part .. Since my design has one source, one target oracle stage and one transformer, if...