Search found 336 matches

by Raftsman
Tue May 26, 2009 9:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle 10G Internal Parms
Replies: 0
Views: 900

Oracle 10G Internal Parms

Would anyone have a list of the optimal Oracle 10G parms that best fit the DataStage tool. I inquired with IBM and they have no documentation on this. Has anyone experimented with Oracle 10G and achieved an optimal solution. We current use a Windows 32 bit server for our development Warehouse and a ...
by Raftsman
Mon May 11, 2009 12:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Question regarding Sort and Partitioning
Replies: 1
Views: 1010

Question regarding Sort and Partitioning

When would we implement a sort routine prior to the aggregator? I know that if the aggregator input tab partitioning is set to Auto, Datastage takes care of the sorting and grouping. What concerns me is the documentation. It states that we should sort and repartition the data prior to the aggregator...
by Raftsman
Thu Mar 12, 2009 12:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best Practice SCD
Replies: 1
Views: 1006

Best Practice SCD

The SCD stage requires two output files. One for changes and one containing all records. If we do not need the one containing all records, what is the best practice in order not to create files that will never be used. I would put them to the same file but multiple jobs may run at the same time and ...
by Raftsman
Thu Mar 12, 2009 12:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance concern for SCD stage for very large dimension
Replies: 3
Views: 2771

Appending to your question, we have found the internal surrogate key generator in the SCD very slow for large volumes on the initial load. Is there a way to incorporate the Surrogate key generator stage into this mechanism. It is much more efficient.
by Raftsman
Mon Feb 16, 2009 8:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: backup of folder using dsexport command
Replies: 14
Views: 11887

There is a way but you would need to use a DOS bat file. Follow this link to Kim Dukes website http://www.duke-consulting.com/. The is a BAT script that will help you accomplish your request.
by Raftsman
Mon Jan 05, 2009 5:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate Surrogate Keys
Replies: 10
Views: 3466

What is the purpose of the NextSurrogateKey function if it can't control multiple nodes. Since this is a version 8.0 function, I would of assumed it to work correctly. If I understand the internal mechanism, should it not assign unique number even though multiple node are being used. I know it will ...
by Raftsman
Mon Jan 05, 2009 2:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate Surrogate Keys
Replies: 10
Views: 3466

Duplicate Surrogate Keys

While running a job using 2 nodes, I encountered an issue with duplicate surrogate keys. A previous collegue created all job stages using sequential processing. In order to take advantage of parallel processing, I switched all stages back to Default (parallel). I used the transformer stage (Next Sur...
by Raftsman
Wed Dec 17, 2008 12:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Monioring fails in designer
Replies: 6
Views: 2920

We have this problem. Sometime, the JOBMON process ceases to run and must be restarted. It is still unknown why it stops but to quickly resolve the issue, I get the network admin to run a restart on the process and the problem is resolved. Before asking for a restart, check friend.kak solution to se...
by Raftsman
Wed Nov 19, 2008 2:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup and Defaults (NULLS)
Replies: 6
Views: 2282

We did initially and it was still a problem. All I am trying to determine is how to set the value defaulted to nulls in a Lookup if not found. If the datatype is nullable, I thought the value initially would contain Nulls.
by Raftsman
Wed Nov 19, 2008 8:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup and Defaults (NULLS)
Replies: 6
Views: 2282

No, from the Lookup Stage I did a Peek.
by Raftsman
Tue Nov 18, 2008 9:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup and Defaults (NULLS)
Replies: 6
Views: 2282

Lookup and Defaults (NULLS)

I am retrieving multiple fields from the Lookup reference data when matched. One of these fields is a date. When a match is not found, the target link receives "*******" in the date field. Because it's nullable, I would of assumed it to contain nulls when not found. If this is not the case...
by Raftsman
Mon Sep 08, 2008 12:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Hangs
Replies: 6
Views: 3059

Will there ever be any updates? If not, when insert then update is selected, it will only insert.
by Raftsman
Mon Sep 08, 2008 11:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Certification - Some basic questions
Replies: 11
Views: 3930

Please note that version 8.0 had many issues but it was replaced with 8.0.1. Also, you need Fixpack 1A. It fixes many issues. In the Windows environment, you need the new version of the MKS toolkit otherwise you will received broken pipe errors.
by Raftsman
Mon Sep 08, 2008 11:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Hangs
Replies: 6
Views: 3059

I think the where clause is your problem. I understand that you don't want to use the update. You can use the OPEN command in the input ORACLE stage to truncate the table and then the update clause would never get actioned unless you have duplicate keys.
by Raftsman
Mon Sep 08, 2008 9:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage Director Scheduler running with specific userid
Replies: 3
Views: 3653

You will need to update the password.