Search found 28 matches

by speedsterrules
Fri Feb 23, 2007 11:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fact Load Performance
Replies: 10
Views: 1957

I think I have got significant performance enhancing input from all of you.

Thanks
by speedsterrules
Thu Feb 22, 2007 10:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fact Load Performance
Replies: 10
Views: 1957

Thanks for all your input. Since we are on the subject, when we "Enable" the pre_load file to memory option, I think the maximum size is 2 GB for hashed file. Do you think its a best pratice to do it for all your hashed files? If so, are there any memory usage concerns when I have 10 hashe...
by speedsterrules
Thu Feb 22, 2007 10:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fact Load Performance
Replies: 10
Views: 1957

Thanks for your input gateleys.

I am using sequential files for staging now and the process is faster. I think I will do the same with creating the hash files.

Do I need an active stage between DRS and hashed file stage? I know its a trivial question but want to be sure.

Thanks
by speedsterrules
Thu Feb 22, 2007 9:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Fact Load Performance
Replies: 10
Views: 1957

Fact Load Performance

I am doing a FACT table load with lookups from 12 tables. The source has about 2 million rows. The primary link is DRS (extract) -> XFM -> DRS (load) The lookup links are DRS (dimension lookup) -> HASH_FILE -> XFM -> DRS(load) (last 2 stages are same as above) The job is taking about 30 mins. Please...
by speedsterrules
Wed Feb 21, 2007 1:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Phantom Warning
Replies: 6
Views: 1799

Thanks Craig and dsguru. That information surely helps.
by speedsterrules
Wed Feb 21, 2007 1:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Phantom Warning
Replies: 6
Views: 1799

I reset the job and there were no pop-ups or warnings.

I am not sure what you mean by "where are you creating "D_SDKSequences" inside your job"

Its a simple job with some tranformations from source to target.

Thanks
by speedsterrules
Wed Feb 21, 2007 1:31 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Phantom Warning
Replies: 6
Views: 1799

Phantom Warning

I am getting this warning in my job log. The job runs fine. DataStage Job 400 Phantom 5440 Creating file "SDKSequences" as Type 2, Modulo 1, Separation 1. Creating file "D_SDKSequences" as Type 3, Modulo 1, Separation 2. Added "@ID", the default record for Retrieve, to ...
by speedsterrules
Thu Feb 15, 2007 2:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DRS or ODBC
Replies: 1
Views: 743

DRS or ODBC

Hello All,

I want to execute one SQL statement after my table load.
The database is MS SQL Server.
DS on Windows Server.

Initially, I was using ODBC to load the table but now I am thinking of using DRS stage.

Are there any performance implications or anything that I should be aware of?

Thanks
by speedsterrules
Wed Nov 29, 2006 11:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuring ODBC connection
Replies: 6
Views: 1478

thanks for the information. I have got the .odbc.ini file setup. What do I need to add in the dsenv file ?
by speedsterrules
Wed Nov 29, 2006 11:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuring ODBC connection
Replies: 6
Views: 1478

thanks .. that helped .. Can we create a connection to SQL Server 2005 from DS 7.5.1 ?
by speedsterrules
Wed Nov 29, 2006 10:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuring ODBC connection
Replies: 6
Views: 1478

Thanks for your reply. I have the db Server Name, login information and port numbers. Do you think I would need any additional information ?
by speedsterrules
Wed Nov 29, 2006 10:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Configuring ODBC connection
Replies: 6
Views: 1478

Configuring ODBC connection

I am trying to setup a connection from our DS Server (7.5.1) to SQL Server 2000 db. Since we do not have a direct driver, I am using ODBC to set up the connection. I have gone through the documentation provided with DS. Can anyone please list down any information or problems they encountered which I...
by speedsterrules
Thu Jun 01, 2006 11:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup table issue
Replies: 1
Views: 1744

Lookup table issue

Hi All, I have seen a post about this issue but wanted to know what this problem means. I created a copy of a lookup dataset and changed the column names to use for another lookup in the same job. I get this error message and am not sure what it means. "Cannot read old version of contiguous loo...