Search found 402 matches

by Ultramundane
Mon Dec 05, 2005 11:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to divide a file into 8 parts
Replies: 10
Views: 5252

Re: How to divide a file into 8 parts

You might be able to use the external target stage like the example I gave in the wrapped stage thread. You can use the following code fragment to split the file into as many files as you specify up to 99. The default record seperator for awk is a line feed. If you need to modify this you can specif...
by Ultramundane
Mon Dec 05, 2005 9:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to divide a file into 8 parts
Replies: 10
Views: 5252

Re: How to divide a file into 8 parts

Will your records be fixed width? If not, do you require that each file contain a full record?
by Ultramundane
Mon Dec 05, 2005 8:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wrapped stage
Replies: 12
Views: 5438

Make sure that you mark the script as executable and readable. I setup the stage as follows. Input -> Properties -> Target -> Destination Program /Work/Ascential/script/example_awk.ksh -D"?" -F"/Work/Ascential/tmp/mystuff.txt" Input -> Properties -> Target -> Target Method Specif...
by Ultramundane
Mon Dec 05, 2005 8:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Stored Procedure Stage Performance Issue
Replies: 2
Views: 875

It is blowing up memory!!! IT IS NOT USING THE SCRACTH DISK AT ALL!!! That is problem. It is buffering the entire result set in memory and not using disk at all.
by Ultramundane
Fri Dec 02, 2005 9:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Stored Procedure Stage Performance Issue
Replies: 2
Views: 875

Stored Procedure Stage Performance Issue

Hi, We are using Ascential DS 7.5.1A with the following patches applied: 75003, 80895, 80559, 80036, 76017, 20959 The Stored Procedure Stage caches all rows before it starts to write its output. This causes many gigabytes of memory to be used and the job to be aborted. I have tried to use no buffer ...
by Ultramundane
Thu Dec 01, 2005 4:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata Performance Issue.
Replies: 3
Views: 1176

We had wrote up two cases for Teradata. This was the second case. But, they found this same issue while they were testing for the first case: if the sessions and players are not equal n = n, which forces only one player :(, the job will just hang. We encounter these issues with parallel jobs. I don'...
by Ultramundane
Thu Dec 01, 2005 3:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata Performance Issue.
Replies: 3
Views: 1176

Re: Teradata Performance Issue.

Ooops,

The difference is 1 hour vs ~60 hours.
by Ultramundane
Thu Dec 01, 2005 3:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata Performance Issue.
Replies: 3
Views: 1176

Teradata Performance Issue.

Hi, We are using Ascential DS 7.5.1A with the following patches applied: 75003, 80895, 80559, 80036, 76017, 20959 Occassionally the teradata enterprise stage (about 20% of the time), will have a major performance issue. The stage will suddenly process at 4000 rows/second for a job instead of 250,000...
by Ultramundane
Thu Dec 01, 2005 3:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I configure for multiple network interfaces on SMP?
Replies: 27
Views: 12913

After slightly over two weeks Ascential finally said that it cannot be done. That is, a single SMP server with just one OS and multiple network interfaces cannot be load balanced for network traffic.
by Ultramundane
Thu Dec 01, 2005 9:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SIGSEGV, SIGBUS
Replies: 6
Views: 8569

Re: SIGSEGV, SIGBUS

Usually bad code that caused a segmentation fault. It could also be failing hardware. Did anything get logged by the error daemon?
by Ultramundane
Thu Dec 01, 2005 8:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I configure for multiple network interfaces on SMP?
Replies: 27
Views: 12913

Thanks Ray. I found it. I had to search on copy-orchdist and not copyorchdist. I will do some reading like track_star has suggested. However, I have been working with Ascential support now for about 2 weeks on this issue as well. They have no clue how to do it. At least I am getting some suggestions...
by Ultramundane
Thu Dec 01, 2005 8:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wrapped stage
Replies: 12
Views: 5438

Could you use the External Target Stage. The External Stage will call your script one time and you will need to process standard input in a loop. You can also invoke your script with command line arguments. I typically use awk to process the contents, but you could also use just korn shell and not a...
by Ultramundane
Wed Nov 30, 2005 3:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I configure for multiple network interfaces on SMP?
Replies: 27
Views: 12913

Hmmm. I cannot find any information on copyorchdist and I believe that I have searched all of the PDFs that were installed on my pc. Well, that is another issue. The lousy documentation and the lack of a good interface. I guess a nice interface like dynatext would have been too expensive. Anyways, d...
by Ultramundane
Tue Nov 29, 2005 10:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: APT_BadAlloc: Heap allocation failed.
Replies: 8
Views: 5254

I had this same issue on AIX. I had to increase the amout of memory that the osh program could allocate. I modified it so that it could allocate 2 gb instead of the default 512 MB.

cd $APT_ORCHHOME/bin
/usr/ccs/bin/ldedit -bmaxdata:0x80000000/dsa osh
by Ultramundane
Mon Nov 14, 2005 12:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How do I configure for multiple network interfaces on SMP?
Replies: 27
Views: 12913

Argh, it would not be for the same job. The first job uses file 1, the second job uses file 2, the third job uses file1. Thus, Each job would use a file according to its natural number ordering for when it is deployed. You know, if x%2 = 1 then use file 1, if x % 2 = 0 then use file 2. Something sim...