Search found 37 matches

by shaimil
Thu Sep 04, 2008 6:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: see the data in the dataset in UNIX
Replies: 2
Views: 2732

Re: see the data in the dataset in UNIX

kananthan wrote:How to see the data in the Dataset in UNIX. What command we have to use to see the data in Dataset in UNIX?
Use the Dataset Management tool from the tools menu in any of the client tools.
by shaimil
Tue Aug 05, 2008 4:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read and write from single dataset in job
Replies: 13
Views: 13285

Ray, I guess the lookup file set doesn't suffer from the same restrictions as that seemed to work, although I'm still testing to establish whether the lookup fileset does the equivalent of a truncate and load rather than an append. What in yor mind would be a reasonable approach to replicating the S...
by shaimil
Tue Aug 05, 2008 9:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read and write from single dataset in job
Replies: 13
Views: 13285

So is it not possible to implement the equivalent of a hash file r/w in a single job using PX?
by shaimil
Tue Aug 05, 2008 7:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read and write from single dataset in job
Replies: 13
Views: 13285

Read and write from single dataset in job

I'm trying to use a single dataset(once as lookup and again as target) in the same job. Can someone please let me know if this is possible as I keep getting the following error. Operator initialization: A link between two operators should be named with a .v; insert a copy operator to save a persiste...
by shaimil
Mon Sep 18, 2006 10:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: record delimiter problems
Replies: 12
Views: 6387

What is the file type?

Do you mean it has a variable record lengths within the same file?

Shai
by shaimil
Mon Sep 18, 2006 10:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Dataset metadata when using aggregator
Replies: 1
Views: 859

Dataset metadata when using aggregator

Can anyone explain the following. I'm loading some numeric data into a dataset. Datatypes are integer. I use an aggregator prior to the ds which throws out a dfloat, which I then modify. Without the aggregator the ds is created with int32 datatypes. However, with the aggregator the datatype is dfloa...
by shaimil
Tue Jun 21, 2005 3:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance issue with SQL Inserts
Replies: 6
Views: 2928

Sorry, let me expand. I have a single input stream inserting into multiple tables on SQL server. The commit level is set to 0 and the record lengths vary depending on the jobs, but all seem to follow the same degradation of performance path. I have been told that it may be the way the box is configu...
by shaimil
Mon Jun 20, 2005 8:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance issue with SQL Inserts
Replies: 6
Views: 2928

Performance issue with SQL Inserts

I have a set of jobs that each insert records into a SQL Server 2000 db. I'm finding that some jobs insert at rates of around 800 rows/sec wheras others do as few as 25 rows/sec. The main differences between the jobs seems to be the number of tables/connections that the jobs make (ie the number of c...
by shaimil
Wed Mar 16, 2005 10:57 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Memory allocation for application called from Command Line
Replies: 3
Views: 1076

A bit of everything, but QAS actually launched a front-end showing the throughput and memeory usage. We have also checked this against the Performance Monitor.

Not only this, but visibly (in duration) it takes hours longer from within DS then from the command line.
by shaimil
Wed Mar 16, 2005 9:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Memory allocation for application called from Command Line
Replies: 3
Views: 1076

Memory allocation for application called from Command Line

Can anyone explain the following. I am making a call to an application called QAS (address cleansing) from within Datastage, using the command line stage. When this runs it is allocated upto 3MB of memory. When I make the same call from the Windows command line the QAS app is allocated upto 300MB. I...
by shaimil
Tue Nov 09, 2004 3:13 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to count rows extracted from MS Sql table
Replies: 10
Views: 4080

I'm trying to use the DSLinkInfo to obtain a row count. I keep getting a value of -1.

Any ideas why this may be.

I'm calling the command from a sequencer after the job in question has run.

Thanks
Shay
by shaimil
Tue Nov 02, 2004 9:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issues
Replies: 7
Views: 1915

This has all been very useful thanks. I've narrowed the problem down to the target load and the commit size. Can anyone tell me how I now optimise the Parameter Array Size. I'm currently using 250, but when i used a higher value the job gave a compile time error. Should this value be the same as the...
by shaimil
Tue Nov 02, 2004 3:56 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performance Issues
Replies: 7
Views: 1915

Performance Issues

Does anyone know the best way for me to figure out what's strangling my Datastage jobs. I have several jobs that run in sequence, some parallel some serially. They either read from flat files or hashed files and all write to SQL Server tables. In between they do some very simple transformations invo...
by shaimil
Fri Oct 29, 2004 2:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Automatically handle activities that fail
Replies: 11
Views: 11687

What about User Status

For routines to work correctly I see that 0 is required for a success. What is the case for User Status. How can I use this with restartable sequences?
by shaimil
Thu Oct 14, 2004 2:06 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Phantom Error - Variable previously undefined
Replies: 3
Views: 1610

Phantom Error - Variable previously undefined

Does anyone know how I can stop phantom error messages appearing on the log. I have a simple outine that receives a parameter and checks for Null or an empty string. The problem is that when the routine is passed a null I get the message "variable previously undefined....." as a phamtom in...