Search found 139 matches

by shawn_ramsey
Wed Sep 15, 2004 1:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: One input record to multiple output records
Replies: 10
Views: 3849

Re: One input record to multiple output records

I am assuming that you really want to represent a single line 10 times and that the link collector is the only way that you figured out how to do it. What I would do is use a transformer to take the and replicate the source column into 10 columns. I would then feed that transformer into a pivot stag...
by shawn_ramsey
Tue Sep 14, 2004 2:01 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: IPC Stage Vs Inter-Process Row Bufferring
Replies: 3
Views: 1620

It was my understanding that turning on the inter-process buffering at the project level would cause DataStage to implicitly set up IPC between 2 active stages when it compiled the job.
by shawn_ramsey
Tue Aug 10, 2004 8:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: OLEDB stage
Replies: 4
Views: 2290

I have tried creating a temp table and then reading the results back in another query all within the same stage, however, I get a "Link initialization failure" every time. Therefore I wasn't sure that temp tables were possible within DataStage but if it is possible I will have to keep try...
by shawn_ramsey
Tue Jul 06, 2004 11:15 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Partitioning Algorithms (Pros and Cons)
Replies: 2
Views: 1352

Re: Partitioning Algorithms (Pros and Cons)

Hi, With Datastage server (not PX), I would like to use the link partitioner to improve the performance of some of my jobs. I know that there are 4 Partitioning algorithms available for Link Partitioner (Round Robin, Random, Hash, Modulus). I will be thankful if someone tell me what are the pros an...
by shawn_ramsey
Mon Apr 19, 2004 1:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: COMP-3 conversion in Datastage - Strategies
Replies: 5
Views: 4811

Re: COMP-3 conversion in Datastage - Strategies

Hai We are trying to convert flat file from Mainframe to load DB2 dataware house hosted on Unix. In this process to convert COMP-3 fields we have comeout with following three approaches . 1) Using server Job and CFF Stage . But we are apprehensive of "Performance Issue" , Are we correct 2...
by shawn_ramsey
Thu Apr 15, 2004 9:42 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Accessing files on Novell server through Datastage on Win 2k
Replies: 4
Views: 1367

Re: Accessing files on Novell server through Datastage on Wi

Have you tried referencing the file using UNC (\\server\share\folder\...) instead of the G:\? I suspect that it is a drive mapping issue or a Novell rights issue with the account that the scheduler runs under. We are doing something similar with an Access database but we have a script that copies th...
by shawn_ramsey
Wed Apr 14, 2004 3:57 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading from oracle table on remote server
Replies: 4
Views: 1598

Ascential provided both the Wire and Non-Wire drivers with the Windows version and I would assume it is the same with the Unix version.
by shawn_ramsey
Wed Apr 14, 2004 3:26 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reading from oracle table on remote server
Replies: 4
Views: 1598

kcbland wrote:In a parallel job, you're using OCI, so it's sqlnet. In a Server job, using an OCI stage, it's also sqlnet. Using an ODBC stage obviously is ODBC.
A little more clarification with the ODBC. If you are using the Wire Protocol ODBC drivers it is ODBC, if not then the ODBC driver calls the OCI.
by shawn_ramsey
Tue Mar 16, 2004 11:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: CoSort success
Replies: 4
Views: 1931

I don't think anyone would disagree with that. :D
by shawn_ramsey
Mon Mar 15, 2004 2:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: CoSort success
Replies: 4
Views: 1931

Re: CoSort success

A consultant that we had in 2 years ago recommended Opttech sort (http://www.opttech.com/). He stated that he had used it successfully on several projects but I have not looked into using it myself since we have not had a need to augment DataStage. The tool is really cheap too.
by shawn_ramsey
Fri Feb 27, 2004 9:56 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Long running SQL server bulk load
Replies: 7
Views: 2379

Ken "right in line" give me a break. Are you seriously suggesting that DataStage would actually only bulk load the data at 185 rows a second as apposed to the native bulk loader 6000+ rows a second? There is obviously something else going on here since we are loading some pretty wide table...
by shawn_ramsey
Mon Feb 23, 2004 1:53 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Importing Copybooks with Comp-3
Replies: 2
Views: 1250

Thanks but that did not work either. In the end I just imported them without the decimal then edited the metadata.
by shawn_ramsey
Fri Feb 20, 2004 12:35 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Importing Copybooks with Comp-3
Replies: 2
Views: 1250

Importing Copybooks with Comp-3

All, I am creating a copy book from scratch to load data from files that we are FTPing (binary) from and AS400. The problem that I am having is that for some reason the import copy book fails on lines where I have a structure like: 10 PHTOTN PIC S9(7)V99 COMP-3. 10 PHTA01 PIC S9(7)V99 COMP-3. 10 PHT...
by shawn_ramsey
Mon Feb 09, 2004 10:56 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RAM / swap usage
Replies: 13
Views: 9673

Thanks for your answers ! (... Well, not to Craig, who laughes at those using DataStage on Windows :lol: ) The facts are : - OS takes about 100-150 MB of RAM (seen at the server startup) - SQL server can take up to 1 GB of RAM and 100% CPU ressources (this is, by the way, really annoying when it oc...
by shawn_ramsey
Mon Feb 09, 2004 10:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: RAM / swap usage
Replies: 13
Views: 9673

Re: RAM / swap usage

It is my understanding that a single process in windows cannot use more than 2 GB of memory so it will never make the 3.5 GB with a single thread anyway. Now the other issue is if you have only 1.5 GB of ram and 1 GB is taken up by the UVSH you are not leaving much for the OS and other items running...